-- Logs begin at Mon 2022-08-29 20:53:03 UTC, end at Mon 2022-08-29 21:57:06 UTC. -- Aug 29 21:24:24.743467 dv-cinder-854267-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 29 21:24:24.750866 dv-cinder-854267-3-smb devstack@keystone.service[81644]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 29 21:24:24.756202 dv-cinder-854267-3-smb devstack@keystone.service[81644]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 21:24:24 2022] *** Aug 29 21:24:24.756202 dv-cinder-854267-3-smb devstack@keystone.service[81644]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 21:24:24.756202 dv-cinder-854267-3-smb devstack@keystone.service[81644]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 21:24:24.756202 dv-cinder-854267-3-smb devstack@keystone.service[81644]: nodename: dv-cinder-854267-3-smb Aug 29 21:24:24.756202 dv-cinder-854267-3-smb devstack@keystone.service[81644]: machine: x86_64 Aug 29 21:24:24.756202 dv-cinder-854267-3-smb devstack@keystone.service[81644]: clock source: unix Aug 29 21:24:24.756202 dv-cinder-854267-3-smb devstack@keystone.service[81644]: pcre jit disabled Aug 29 21:24:24.756202 dv-cinder-854267-3-smb devstack@keystone.service[81644]: detected number of CPU cores: 4 Aug 29 21:24:24.756202 dv-cinder-854267-3-smb devstack@keystone.service[81644]: current working directory: / Aug 29 21:24:24.756202 dv-cinder-854267-3-smb devstack@keystone.service[81644]: detected binary path: /usr/bin/uwsgi-core Aug 29 21:24:24.756202 dv-cinder-854267-3-smb devstack@keystone.service[81644]: your processes number limit is 47680 Aug 29 21:24:24.756202 dv-cinder-854267-3-smb devstack@keystone.service[81644]: your memory page size is 4096 bytes Aug 29 21:24:24.756202 dv-cinder-854267-3-smb devstack@keystone.service[81644]: detected max file descriptor number: 2048 Aug 29 21:24:24.756202 dv-cinder-854267-3-smb devstack@keystone.service[81644]: lock engine: pthread robust mutexes Aug 29 21:24:24.756202 dv-cinder-854267-3-smb devstack@keystone.service[81644]: thunder lock: enabled Aug 29 21:24:24.756202 dv-cinder-854267-3-smb devstack@keystone.service[81644]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 29 21:24:24.756202 dv-cinder-854267-3-smb devstack@keystone.service[81644]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 21:24:24.793526 dv-cinder-854267-3-smb devstack@keystone.service[81644]: Python main interpreter initialized at 0x55b6f11949c0 Aug 29 21:24:24.793526 dv-cinder-854267-3-smb devstack@keystone.service[81644]: python threads support enabled Aug 29 21:24:24.793526 dv-cinder-854267-3-smb devstack@keystone.service[81644]: your server socket listen backlog is limited to 100 connections Aug 29 21:24:24.793526 dv-cinder-854267-3-smb devstack@keystone.service[81644]: your mercy for graceful operations on workers is 90 seconds Aug 29 21:24:24.793939 dv-cinder-854267-3-smb devstack@keystone.service[81644]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 21:24:24.794016 dv-cinder-854267-3-smb devstack@keystone.service[81644]: *** Operational MODE: preforking *** Aug 29 21:24:24.794247 dv-cinder-854267-3-smb devstack@keystone.service[81644]: *** uWSGI is running in multiple interpreter mode *** Aug 29 21:24:24.794247 dv-cinder-854267-3-smb devstack@keystone.service[81644]: spawned uWSGI master process (pid: 81644) Aug 29 21:24:24.794456 dv-cinder-854267-3-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 29 21:24:24.795284 dv-cinder-854267-3-smb devstack@keystone.service[81644]: spawned uWSGI worker 1 (pid: 81658, cores: 1) Aug 29 21:24:24.795378 dv-cinder-854267-3-smb devstack@keystone.service[81644]: spawned uWSGI worker 2 (pid: 81659, cores: 1) Aug 29 21:24:24.796228 dv-cinder-854267-3-smb devstack@keystone.service[81644]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 21:24:29.215128 dv-cinder-854267-3-smb devstack@keystone.service[81658]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:24:29.215128 dv-cinder-854267-3-smb devstack@keystone.service[81658]: from cryptography.utils import int_from_bytes Aug 29 21:24:29.215913 dv-cinder-854267-3-smb devstack@keystone.service[81658]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:24:29.215913 dv-cinder-854267-3-smb devstack@keystone.service[81658]: from cryptography.utils import int_from_bytes Aug 29 21:24:29.217127 dv-cinder-854267-3-smb devstack@keystone.service[81659]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:24:29.217127 dv-cinder-854267-3-smb devstack@keystone.service[81659]: from cryptography.utils import int_from_bytes Aug 29 21:24:29.217590 dv-cinder-854267-3-smb devstack@keystone.service[81659]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:24:29.217590 dv-cinder-854267-3-smb devstack@keystone.service[81659]: from cryptography.utils import int_from_bytes Aug 29 21:24:29.267345 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 21:24:29.267616 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 21:24:29.267752 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] command line args: [] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 21:24:29.268006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 21:24:29.268166 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ================================================================================ {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 21:24:29.268431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] admin_token = **** {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.268685 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] config_dir = [] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.269199 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.269199 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] config_source = [] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.269199 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] debug = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.269866 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.269866 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.271456 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 21:24:29.271603 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.271777 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 21:24:29.271901 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.272037 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] command line args: [] {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 21:24:29.272166 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.272348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 21:24:29.272475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] list_limit = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.272605 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ================================================================================ {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 21:24:29.272735 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] log_config_append = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.272864 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] admin_token = **** {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.272992 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.272992 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] log_dir = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.273308 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] config_dir = [] {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.273439 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] log_file = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.273570 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.273704 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.273822 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] config_source = [] {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.273822 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] debug = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.274064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.274194 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.274348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.274476 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.274605 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.274734 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.274865 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.274993 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.275111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.275242 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.275381 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.275512 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] list_limit = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.275641 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.275779 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] log_config_append = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.275903 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.276038 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.276038 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] log_dir = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.276303 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.276426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] log_file = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.276541 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.276664 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.276790 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.276915 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.277053 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.277171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.277301 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.277432 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.277573 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.277700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.277700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.277700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.278036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.69/identity {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.278036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] publish_errors = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.278282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.278419 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.278546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.278674 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.278808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.278935 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.279056 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.279177 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.279307 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.279424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.279562 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.279784 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] standard_threads = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.279913 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.280032 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.280147 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.280292 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.280292 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.280292 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] use_journal = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.280636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.69/identity {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.280762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] use_json = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.280870 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] publish_errors = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.280981 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] use_stderr = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.281100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.281218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] use_syslog = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.281384 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.281503 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.281611 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.281729 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.281852 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.281961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.282082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.282200 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.282309 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] standard_threads = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.282420 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.282530 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.282641 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.282762 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.282883 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.283009 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.283009 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] use_journal = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.283224 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.283348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] use_json = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.283473 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.283590 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] use_stderr = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.283590 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] use_syslog = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.283802 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.283921 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:29.284040 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.284164 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.284365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.284493 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.284601 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.284722 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.284832 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.284960 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.285069 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.285069 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.285290 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.285290 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.285494 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.285494 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.285711 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.285711 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.286230 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.286344 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.286464 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.286464 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.286680 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.286808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.286919 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.287030 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.287143 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.287337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.287445 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.287445 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.287675 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.287796 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.287907 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.287907 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.288673 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.288803 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.288915 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.289026 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.289148 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.289266 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.289375 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.289495 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.289613 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.289722 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.289844 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.289962 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.290070 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.290181 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.290291 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.290410 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.290530 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.290639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.290751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.290861 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.290980 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.291088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.291211 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.291319 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.291432 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.291542 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.291660 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.291781 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.291903 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.292016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.292126 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.292258 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.292390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.292496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.292620 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.292730 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.292842 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.292954 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.293088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.293196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.293407 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.293518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.293636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.293746 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.293911 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.294016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.294139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.294248 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.294360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.294471 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.294582 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.294691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.294814 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.294922 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.295041 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.295150 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.295267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.295377 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.295500 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.295618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.295736 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.295844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.295955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.296076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.296228 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.296357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.296474 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.296583 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.296583 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.296840 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.296960 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.297064 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.297169 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.297288 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.297392 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.297494 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.297606 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.297706 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.297806 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.297916 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.298017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.298114 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.298233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.298353 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.298463 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.298586 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.298696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.298807 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.298917 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.299039 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.299147 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.299258 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.299377 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.299488 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.299598 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.299723 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.299833 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.299958 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.300079 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.300422 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.300555 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.300690 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.300814 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.300939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.301059 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.301183 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.301308 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.301448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.301575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.301697 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.301823 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.301942 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.302065 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.302201 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.302327 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.302450 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.302577 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.302696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.302829 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.302966 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.303102 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.303231 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.303352 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.303469 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.303579 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.303742 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.304415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.304529 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.304643 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.304772 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.304893 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.304893 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.305112 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.305224 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.305337 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.305458 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.305591 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.305786 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.305897 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.306008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.306120 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.306233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.306345 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.306468 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.306597 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.306719 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.306829 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.306959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.307079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.307189 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.307314 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.307426 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.307548 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.307658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.307770 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.307883 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.308009 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.308141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.308272 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.308391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.308515 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.308626 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] auth.external = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.308749 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.308859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.308978 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.309089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.309202 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.309324 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.309445 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.309568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] auth.password = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.309693 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.309804 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] auth.token = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.309954 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.310076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.310192 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.310309 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.310435 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.310549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.310689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.310801 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.310917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.311033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.311163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.311277 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.311401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.311523 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.311636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] auth.external = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.311759 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] credential.caching = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.311886 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.312000 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.312117 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.312307 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.312419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.312537 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.312675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] auth.password = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.312789 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.312924 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] auth.token = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.313037 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.313155 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.313272 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.313401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.313529 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.313641 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.313752 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.313862 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.313985 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.314114 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.314229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.314345 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.314345 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.314561 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.314677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] credential.caching = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.314806 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.314919 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.315035 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.315153 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.315270 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.315388 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.315522 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.315636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.315752 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] federation.caching = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.315869 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.315986 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.316101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.316275 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.316390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.316507 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.316622 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.316739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.316857 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.316987 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.317101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.317224 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.317351 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.317466 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.317583 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.317712 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.317826 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.317940 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.317940 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.318158 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.318273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.318403 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.318523 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.caching = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.318638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] federation.caching = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.318767 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.318887 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.319015 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.319129 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.319254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.319370 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.319491 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.319607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.319811 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.319924 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.320055 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.320170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.320313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.320430 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.320570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.320682 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.320799 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.320915 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.321033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.321149 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.321278 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.321390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.321506 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.321623 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] identity.caching = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.321744 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.321867 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.321995 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.322107 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.322230 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.322346 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.322463 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.322579 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.322708 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.322820 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.322938 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.323055 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.323170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.323296 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.323427 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.323541 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.323652 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.323764 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.323876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.323988 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.324118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.324273 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.324404 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.324517 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.324635 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.324750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.324879 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.325001 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.325116 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.325233 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.325350 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.325474 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.325604 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.325716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.325835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.325835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.326053 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.326168 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.326298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.326298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.326513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.326629 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.326748 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.326875 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.327090 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.327204 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.327317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.327430 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.327590 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.327704 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.327834 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.327834 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.328049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.328163 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.328310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.328430 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.328567 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.328681 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.328792 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.328914 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.329034 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.329154 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.329298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.329419 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.329546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.329666 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.329779 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.329903 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.330022 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.330143 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.330263 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.330385 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.330509 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.330640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.330754 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.330876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.330995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.331125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.331242 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.331371 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.331489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.331609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.331735 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.331854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.331974 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.332111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.332299 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.332411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.332530 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.332645 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.332777 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.332904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.333018 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.333135 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.333252 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.333369 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.333485 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.333613 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.333728 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.333840 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.333964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.334078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.334194 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.user = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.334324 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.334437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.334554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.334672 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.334789 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.334907 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.335036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.335157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.335273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.335395 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.335511 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.335511 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.335740 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.335853 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.335969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.336085 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.336221 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.336350 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.336486 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.336601 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.336722 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.336722 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.336946 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.337070 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.337206 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.337321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.337441 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.337561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.337681 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.337801 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.337931 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.338048 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.338169 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.338288 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.338406 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.338527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.338658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.338778 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.338778 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.339002 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.339120 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.339240 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.339372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.339488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.339609 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.339729 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.339848 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.339968 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] resource.caching = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.340097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.340302 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.340414 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.340538 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.340653 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.340770 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.340903 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.341016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.341133 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.341249 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.341365 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.341482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.341617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.341729 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.341846 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.341962 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.342083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.342201 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.342328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.342441 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] role.caching = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.342559 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.342676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] role.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.342792 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.342910 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.343108 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] resource.caching = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.343221 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.343338 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.343502 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.343612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.343731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.343864 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.344003 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.344117 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.344267 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.344384 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.344514 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.344627 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.344745 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.344867 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.344981 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.345094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.345234 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.345404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.345537 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.345654 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] role.caching = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.345771 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.345887 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] role.driver = sql {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.346018 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.346132 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.346247 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.346363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.346363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.346581 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.346706 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.346822 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.346938 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.347075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.347198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.347314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.347446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.347561 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.347677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.347793 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.347912 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.348028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.348156 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.348333 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.348447 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.348568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.348687 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.348813 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.348950 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.349105 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.349217 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.349338 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.349338 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.349562 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.349562 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.349833 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.349946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.350067 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.350067 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.351069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.351198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.351198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.351420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.351544 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.351544 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] token.caching = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.351777 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.351893 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.351893 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.352115 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.352268 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.352381 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.352521 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.352634 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.352752 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.352876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.352993 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.353108 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.353238 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.353352 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.353468 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.353585 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.353701 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.353820 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.353948 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.354062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.354174 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.354292 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.354414 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.354528 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.354658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.354771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.354889 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.355003 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.355120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.355248 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] token.caching = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.355372 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.355498 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.355498 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.355713 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.355827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.355945 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.connection = **** {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.356066 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.356212 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.356336 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.356455 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.356573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.356692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.356811 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.356948 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.357060 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.357178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.357178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.357398 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.357537 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.357676 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.357799 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.357920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.357920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.358143 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.358143 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.358377 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.358492 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.358612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.358732 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.358851 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.359009 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.359137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.359254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.359394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.359510 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.359631 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] database.connection = **** {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.359749 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.359869 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.359988 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.360121 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.360307 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.360422 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.360539 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 21:24:29.360658 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.360658 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.360658 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.360658 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.360658 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.360658 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.360658 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.360658 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.360658 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.361588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.361588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.361588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.361588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.361588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.361588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:29.361588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 21:24:29.385624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.385854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.386081 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.388850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.389083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.389313 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.394777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.398533 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.424934 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.424934 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.427101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.427333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.481446 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.482196 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.531606 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.531830 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.532557 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.532800 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.691120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.691338 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.691556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.691784 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.692004 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.692252 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.699769 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.699996 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.700240 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.700464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.700688 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.700899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.717370 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.717609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.717845 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.718073 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.718293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.718511 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.718727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.718966 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.719197 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.719424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.719646 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.719878 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.720072 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.720309 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.731090 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.731736 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.744416 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.744686 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.744870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.745096 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.745315 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.745455 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.745597 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.745733 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81658) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.745867 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.746112 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.746401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.746683 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.746967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.747245 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81659) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:24:29.763525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.763729 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.763818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 21:24:29.763898 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 21:24:29.764072 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.764217 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.764320 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 21:24:29.764450 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 21:24:29.764579 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.764668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.764845 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.764985 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.765126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.765357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.765490 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.765691 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.776356 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.776633 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.776633 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.778352 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.778495 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.778632 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.778765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.778908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.783625 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81659) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.783892 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.786693 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81659) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.786875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.787074 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.787264 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.787411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.787592 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.787741 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.787877 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.788038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.788280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.788430 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.795696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.795914 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.796088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.796252 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.796664 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.797054 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.797200 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.797350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.797482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.797616 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.797616 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.812644 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.813587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.814154 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.814445 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.815073 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81659) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.815359 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.819044 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.819872 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.820163 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.820791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81659) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.821076 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.821354 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.826729 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.827022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.827696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81659) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.827988 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.831035 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.831329 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.831620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.831912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.832214 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81659) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.832365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.832500 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.832784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.833069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.833347 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.833629 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.833899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.834224 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.834371 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.834669 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.835019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.851793 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.852070 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.853215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.853516 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.855941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.857379 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81659) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.859062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.859363 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.860704 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.860998 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.863687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.865292 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81659) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.866850 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.868477 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81659) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.869950 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.870256 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.870550 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.870844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.871132 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.871530 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.871688 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.871965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.872280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.872581 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.872877 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.873172 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.888207 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.888702 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.888846 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.889148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.891560 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81659) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.891865 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.892139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.892435 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.896173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.898523 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.900138 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.900353 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.900513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.901788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.903162 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.903348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.903551 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.903741 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.903891 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.904021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.904329 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.906332 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81659) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.906632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.907053 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.907341 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.907705 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.916093 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.916438 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.916711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.917004 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.917297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.917603 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.917909 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.919321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81659) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.919686 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.920138 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.920544 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.920972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.921422 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.921769 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.933726 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.936857 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.939819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.940138 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81659) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.941341 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.942850 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.943114 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81659) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.943298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.943454 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.947035 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.948635 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.950289 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81659) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.950587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.950773 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.950983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.952340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.955349 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.955664 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.955961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.956279 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.957929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.959450 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81659) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.963122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.963657 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.963955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.964265 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.965065 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.965383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.965674 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.972626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81659) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.972935 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81658) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.973128 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.973410 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.973549 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.973679 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.973824 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.973976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.974234 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.974518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.974804 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.975094 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.976270 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.976270 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.976270 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.976686 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.976870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81658) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.982618 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81659) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:24:29.982848 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.983108 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.983463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.983661 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.983937 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.984256 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.984532 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.984835 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.985115 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.985390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.985650 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.986371 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:29.986371 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81659) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:24:30.011926 dv-cinder-854267-3-smb devstack@keystone.service[81658]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b6f11949c0 pid: 81658 (default app) Aug 29 21:24:30.015658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c703afb-eac5-4eea-a4c7-b59df1c8a513 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:30.015947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c703afb-eac5-4eea-a4c7-b59df1c8a513 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:30.016249 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c703afb-eac5-4eea-a4c7-b59df1c8a513 None None] PATH_INFO: `/v3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:30.021178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1/1] 10.222.0.69 () {50 vars in 791 bytes} [Mon Aug 29 21:24:30 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:24:30.023162 dv-cinder-854267-3-smb devstack@keystone.service[81659]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b6f11949c0 pid: 81659 (default app) Aug 29 21:24:36.802202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985670a-1d22-4eae-8dd6-7207b725d92e None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:36.802718 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985670a-1d22-4eae-8dd6-7207b725d92e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:36.802803 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985670a-1d22-4eae-8dd6-7207b725d92e None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:36.804657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 2/2] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:24:36.812469 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738bf85-ac2a-46de-bf82-700d0286f1ec None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:36.813093 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738bf85-ac2a-46de-bf82-700d0286f1ec None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:36.813093 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738bf85-ac2a-46de-bf82-700d0286f1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:36.884044 dv-cinder-854267-3-smb devstack@keystone.service[81659]: INFO dbcounter [None req-f738bf85-ac2a-46de-bf82-700d0286f1ec None None] Registered counter for database keystone Aug 29 21:24:36.903792 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG oslo_db.sqlalchemy.engines [None req-f738bf85-ac2a-46de-bf82-700d0286f1ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:24:36.910312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writer thread running {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:24:37.098948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG passlib.handlers.bcrypt [None req-f738bf85-ac2a-46de-bf82-700d0286f1ec None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81659) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 21:24:37.099265 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG passlib.handlers.bcrypt [None req-f738bf85-ac2a-46de-bf82-700d0286f1ec None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81659) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 21:24:37.159094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-f738bf85-ac2a-46de-bf82-700d0286f1ec None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:37.160779 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f738bf85-ac2a-46de-bf82-700d0286f1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:37.305739 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1/3] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:24:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 497 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 29 21:24:37.764500 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985670a-1d22-4eae-8dd6-7207b725d92e None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:37.836388 dv-cinder-854267-3-smb devstack@keystone.service[81658]: INFO dbcounter [None req-3985670a-1d22-4eae-8dd6-7207b725d92e None None] Registered counter for database keystone Aug 29 21:24:37.858922 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG oslo_db.sqlalchemy.engines [None req-3985670a-1d22-4eae-8dd6-7207b725d92e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:24:37.866131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writer thread running {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:24:37.999104 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985670a-1d22-4eae-8dd6-7207b725d92e None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:38.003514 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa3e95-024c-4f21-9b95-ec53c556b859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:38.004279 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa3e95-024c-4f21-9b95-ec53c556b859 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:38.004629 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa3e95-024c-4f21-9b95-ec53c556b859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:38.004938 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa3e95-024c-4f21-9b95-ec53c556b859 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:38.014831 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa3e95-024c-4f21-9b95-ec53c556b859 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:38.067309 dv-cinder-854267-3-smb devstack@keystone.service[81658]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b8fa3e95-024c-4f21-9b95-ec53c556b859 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 21:24:38.067646 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa3e95-024c-4f21-9b95-ec53c556b859 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:38.078024 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 3/4] 10.222.0.69 () {58 vars in 1324 bytes} [Mon Aug 29 21:24:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:24:38.084107 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738bf85-ac2a-46de-bf82-700d0286f1ec None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:38.099014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738bf85-ac2a-46de-bf82-700d0286f1ec None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:38.104332 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec35b2-df51-43ff-ac06-cecabdb0722b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:38.105450 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec35b2-df51-43ff-ac06-cecabdb0722b admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:38.105734 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec35b2-df51-43ff-ac06-cecabdb0722b admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:38.106019 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec35b2-df51-43ff-ac06-cecabdb0722b admin admin] PATH_INFO: `/v3/projects/4b8cd30653804c0ead71897871920ce2` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:38.107594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec35b2-df51-43ff-ac06-cecabdb0722b admin admin] RBAC: Authorizing `identity:get_project(project_id=4b8cd30653804c0ead71897871920ce2)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:38.159876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1fec35b2-df51-43ff-ac06-cecabdb0722b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 21:24:38.160241 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec35b2-df51-43ff-ac06-cecabdb0722b admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:38.165547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 2/5] 10.222.0.69 () {56 vars in 1207 bytes} [Mon Aug 29 21:24:38 2022] GET /identity/v3/projects/4b8cd30653804c0ead71897871920ce2 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:24:40.190866 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f1260-9d07-483b-9bfd-95d119ad6012 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:40.191512 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f1260-9d07-483b-9bfd-95d119ad6012 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:40.191512 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f1260-9d07-483b-9bfd-95d119ad6012 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:40.196595 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 4/6] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:24:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:24:40.205966 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0711aea-0861-46f1-b61e-bcd140c47bdb None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:40.206800 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0711aea-0861-46f1-b61e-bcd140c47bdb None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:40.206966 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0711aea-0861-46f1-b61e-bcd140c47bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:40.241751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-b0711aea-0861-46f1-b61e-bcd140c47bdb None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:40.244667 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-b0711aea-0861-46f1-b61e-bcd140c47bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:40.258973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 3/7] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:24:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 29 21:24:40.579712 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f1260-9d07-483b-9bfd-95d119ad6012 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:40.594306 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f1260-9d07-483b-9bfd-95d119ad6012 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:40.599783 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c608753-12dc-4e40-8730-fb3f6019e7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:40.600438 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c608753-12dc-4e40-8730-fb3f6019e7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:40.601496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c608753-12dc-4e40-8730-fb3f6019e7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:40.601779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c608753-12dc-4e40-8730-fb3f6019e7f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:40.610831 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c608753-12dc-4e40-8730-fb3f6019e7f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:40.612783 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c608753-12dc-4e40-8730-fb3f6019e7f7 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:40.624255 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 5/8] 10.222.0.69 () {58 vars in 1324 bytes} [Mon Aug 29 21:24:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:24:40.630383 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0711aea-0861-46f1-b61e-bcd140c47bdb None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:40.640601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0711aea-0861-46f1-b61e-bcd140c47bdb None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:40.645588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a06c90-7753-40d6-abae-78e1d72019cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:40.646304 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a06c90-7753-40d6-abae-78e1d72019cc admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:40.646584 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a06c90-7753-40d6-abae-78e1d72019cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:40.646859 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a06c90-7753-40d6-abae-78e1d72019cc admin admin] PATH_INFO: `/v3/users/3e753cc042b14c47bd5d1c6394848500` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:40.648928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a06c90-7753-40d6-abae-78e1d72019cc admin admin] RBAC: Authorizing `identity:get_user(user_id=3e753cc042b14c47bd5d1c6394848500)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:40.651456 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a06c90-7753-40d6-abae-78e1d72019cc admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:40.653319 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 4/9] 10.222.0.69 () {56 vars in 1198 bytes} [Mon Aug 29 21:24:40 2022] GET /identity/v3/users/3e753cc042b14c47bd5d1c6394848500 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:24:42.733478 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43216e5c-67f1-4111-a0ca-5066d428c2b7 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:42.734018 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43216e5c-67f1-4111-a0ca-5066d428c2b7 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:42.734110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43216e5c-67f1-4111-a0ca-5066d428c2b7 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:42.735389 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 6/10] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:24:42.741177 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b28f58-46af-42c2-8d27-8c13b41747e4 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:42.741671 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b28f58-46af-42c2-8d27-8c13b41747e4 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:42.741765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b28f58-46af-42c2-8d27-8c13b41747e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:42.760770 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-15b28f58-46af-42c2-8d27-8c13b41747e4 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:42.761966 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-15b28f58-46af-42c2-8d27-8c13b41747e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:42.793891 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa910d80-f06f-470e-900c-d71b896e3ad2 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:42.794196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa910d80-f06f-470e-900c-d71b896e3ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:42.794424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa910d80-f06f-470e-900c-d71b896e3ad2 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:42.795766 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 7/11] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:24:42.801079 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4752ed-c424-4d4a-b9d7-6630d05719c5 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:42.801369 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4752ed-c424-4d4a-b9d7-6630d05719c5 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:42.801647 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4752ed-c424-4d4a-b9d7-6630d05719c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:42.846485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG passlib.handlers.bcrypt [None req-4a4752ed-c424-4d4a-b9d7-6630d05719c5 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81658) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 21:24:42.847186 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG passlib.handlers.bcrypt [None req-4a4752ed-c424-4d4a-b9d7-6630d05719c5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81658) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 21:24:42.858353 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 5/12] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:24:42.897193 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-4a4752ed-c424-4d4a-b9d7-6630d05719c5 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:42.899389 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4a4752ed-c424-4d4a-b9d7-6630d05719c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:43.017087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 8/13] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:24:43.130020 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b28f58-46af-42c2-8d27-8c13b41747e4 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:43.155559 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:43.268662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b28f58-46af-42c2-8d27-8c13b41747e4 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:43.287845 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4752ed-c424-4d4a-b9d7-6630d05719c5 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:43.313028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310deb5d-2c00-4dfd-88a8-3c1d22378fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:43.313687 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310deb5d-2c00-4dfd-88a8-3c1d22378fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:43.313979 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310deb5d-2c00-4dfd-88a8-3c1d22378fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:43.314793 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310deb5d-2c00-4dfd-88a8-3c1d22378fe5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:43.326455 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310deb5d-2c00-4dfd-88a8-3c1d22378fe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:24:43.335565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-310deb5d-2c00-4dfd-88a8-3c1d22378fe5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:24:43.335565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:24:43.335565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:24:43.335565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:24:43.335565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:24:43.335565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:24:43.335565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:24:43.335565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:24:43.335565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:24:43.335565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:24:43.335565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:24:43.335565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:24:43.335565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:24:43.335565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:24:43.335565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:24:43.335565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:24:43.336771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:24:43.336771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:24:43.336771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:24:43.336771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:24:43.336771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:24:43.336771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:24:43.336771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:24:43.336771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:24:43.336771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:24:43.336771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:24:43.336771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:24:43.336771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:24:43.336771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:24:43.336771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:24:43.336771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:24:43.336771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:24:43.337615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:24:43.337615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:24:43.337615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:24:43.337615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:24:43.337615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:24:43.337615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:24:43.337615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:24:43.337615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:24:43.337615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:24:43.337615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:24:43.337615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:24:43.337615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:24:43.337615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 6/14] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:24:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:24:43.346347 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310deb5d-2c00-4dfd-88a8-3c1d22378fe5 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:43.428020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4752ed-c424-4d4a-b9d7-6630d05719c5 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:43.431222 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:43.444717 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:43.472905 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310deb5d-2c00-4dfd-88a8-3c1d22378fe5 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:43.489124 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff80c2-1e02-4b46-8f8c-a98cd267cef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:43.490034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff80c2-1e02-4b46-8f8c-a98cd267cef8 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:43.490318 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff80c2-1e02-4b46-8f8c-a98cd267cef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:43.490588 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff80c2-1e02-4b46-8f8c-a98cd267cef8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:43.530589 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06bbbc-deed-41ec-b6d0-eaf274c5f292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:43.531280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06bbbc-deed-41ec-b6d0-eaf274c5f292 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:43.531684 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06bbbc-deed-41ec-b6d0-eaf274c5f292 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:43.532073 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06bbbc-deed-41ec-b6d0-eaf274c5f292 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:43.533036 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06bbbc-deed-41ec-b6d0-eaf274c5f292 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:24:43.533457 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06bbbc-deed-41ec-b6d0-eaf274c5f292 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:43.535966 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06bbbc-deed-41ec-b6d0-eaf274c5f292 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:43.550912 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 7/15] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:24:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:24:43.559794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06bbbc-deed-41ec-b6d0-eaf274c5f292 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:43.584166 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff80c2-1e02-4b46-8f8c-a98cd267cef8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:43.585765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff80c2-1e02-4b46-8f8c-a98cd267cef8 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:43.700761 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06bbbc-deed-41ec-b6d0-eaf274c5f292 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:43.718798 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 9/16] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:24:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:24:43.725085 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff80c2-1e02-4b46-8f8c-a98cd267cef8 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:43.728969 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:43.743448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324152e-e635-4471-bbb2-009cf45b8b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:43.744096 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324152e-e635-4471-bbb2-009cf45b8b46 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:43.744408 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324152e-e635-4471-bbb2-009cf45b8b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:43.744693 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324152e-e635-4471-bbb2-009cf45b8b46 None admin] PATH_INFO: `/v3/users/3e753cc042b14c47bd5d1c6394848500` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:43.745845 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324152e-e635-4471-bbb2-009cf45b8b46 None admin] RBAC: Authorizing `identity:get_user(user_id=3e753cc042b14c47bd5d1c6394848500)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:43.747319 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324152e-e635-4471-bbb2-009cf45b8b46 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:43.748936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 8/17] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:24:43 2022] GET /identity/v3/users/3e753cc042b14c47bd5d1c6394848500 => generated 247 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:24:43.754614 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324152e-e635-4471-bbb2-009cf45b8b46 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:43.775043 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:43.848660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff80c2-1e02-4b46-8f8c-a98cd267cef8 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:43.879638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324152e-e635-4471-bbb2-009cf45b8b46 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:43.888785 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba964b-2a8e-4951-ab44-94d67268cb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:43.889645 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba964b-2a8e-4951-ab44-94d67268cb3a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:43.889924 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba964b-2a8e-4951-ab44-94d67268cb3a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:43.890198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba964b-2a8e-4951-ab44-94d67268cb3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:43.909651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba964b-2a8e-4951-ab44-94d67268cb3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:43.911126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba964b-2a8e-4951-ab44-94d67268cb3a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:43.916612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6bf68-9314-41c7-b2de-0e7ba89f4050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:43.917259 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6bf68-9314-41c7-b2de-0e7ba89f4050 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:43.917542 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6bf68-9314-41c7-b2de-0e7ba89f4050 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:43.917821 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6bf68-9314-41c7-b2de-0e7ba89f4050 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:43.918964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6bf68-9314-41c7-b2de-0e7ba89f4050 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:43.920437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6bf68-9314-41c7-b2de-0e7ba89f4050 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:43.922204 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 9/18] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:24:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:24:43.927897 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6bf68-9314-41c7-b2de-0e7ba89f4050 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:43.930297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-4bba964b-2a8e-4951-ab44-94d67268cb3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:24:43.930297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:24:43.930297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:24:43.930297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:24:43.930297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:24:43.930297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:24:43.930297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:24:43.930297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:24:43.930297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:24:43.930297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:24:43.930297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:24:43.930297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:24:43.930297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:24:43.930297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:24:43.930297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:24:43.930297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:24:43.931449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:24:43.931449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:24:43.931449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:24:43.931449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:24:43.931449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:24:43.931449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:24:43.931449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:24:43.931449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:24:43.931449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:24:43.931449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:24:43.931449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:24:43.931449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:24:43.931449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:24:43.931449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:24:43.931449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:24:43.931449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:24:43.931449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:24:43.932296 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:24:43.932296 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:24:43.932296 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:24:43.932296 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 10/19] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:24:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:24:43.937066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba964b-2a8e-4951-ab44-94d67268cb3a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:44.001684 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:44.027378 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:44.046848 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6bf68-9314-41c7-b2de-0e7ba89f4050 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:44.051292 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba964b-2a8e-4951-ab44-94d67268cb3a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:44.089592 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce8341-f271-4a95-98f4-2a55ea1c6449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:44.090209 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce8341-f271-4a95-98f4-2a55ea1c6449 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:44.090488 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce8341-f271-4a95-98f4-2a55ea1c6449 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:44.090758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce8341-f271-4a95-98f4-2a55ea1c6449 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:44.091556 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce8341-f271-4a95-98f4-2a55ea1c6449 None admin] RBAC: Adding query filter params (role.id=69369872661e4179bb51cd1ca76e28c3, scope.domain.id=default, user.id=3e753cc042b14c47bd5d1c6394848500) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:24:44.091793 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce8341-f271-4a95-98f4-2a55ea1c6449 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:44.093288 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce8341-f271-4a95-98f4-2a55ea1c6449 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:44.094415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503c6ff-3683-495f-afb4-f56e90a2a711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:44.097227 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503c6ff-3683-495f-afb4-f56e90a2a711 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:44.097673 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503c6ff-3683-495f-afb4-f56e90a2a711 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:44.098122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503c6ff-3683-495f-afb4-f56e90a2a711 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:44.099058 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503c6ff-3683-495f-afb4-f56e90a2a711 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:24:44.099420 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503c6ff-3683-495f-afb4-f56e90a2a711 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:44.101159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503c6ff-3683-495f-afb4-f56e90a2a711 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:44.101319 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 10/20] 10.222.0.69 () {56 vars in 1322 bytes} [Mon Aug 29 21:24:43 2022] GET /identity/v3/role_assignments?user.id=3e753cc042b14c47bd5d1c6394848500&scope.domain.id=default&role.id=69369872661e4179bb51cd1ca76e28c3 => generated 233 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:24:44.124084 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 11/21] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:24:46.550253 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13dc94-6783-43f3-879c-1eae6896df71 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:46.550753 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13dc94-6783-43f3-879c-1eae6896df71 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:46.550753 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13dc94-6783-43f3-879c-1eae6896df71 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:46.552355 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 11/22] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:24:46.558440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b84ace-4366-4234-9acd-555916cc5be0 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:46.559684 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b84ace-4366-4234-9acd-555916cc5be0 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:46.560507 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b84ace-4366-4234-9acd-555916cc5be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:46.589791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f6b84ace-4366-4234-9acd-555916cc5be0 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:46.592210 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f6b84ace-4366-4234-9acd-555916cc5be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:46.668634 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745bbab-a56a-460f-89a0-e71e3e8fffcf None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:46.669293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745bbab-a56a-460f-89a0-e71e3e8fffcf None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:46.669774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745bbab-a56a-460f-89a0-e71e3e8fffcf None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:46.671440 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 12/23] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:24:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:24:46.677532 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f294a-af61-462f-81a6-6adfcb81a9bd None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:46.678166 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f294a-af61-462f-81a6-6adfcb81a9bd None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:46.678650 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f294a-af61-462f-81a6-6adfcb81a9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:46.717474 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-cd6f294a-af61-462f-81a6-6adfcb81a9bd None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:46.719095 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-cd6f294a-af61-462f-81a6-6adfcb81a9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:46.725733 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 12/24] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:24:46.837400 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 13/25] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:24:47.176569 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b84ace-4366-4234-9acd-555916cc5be0 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:47.237480 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:47.269031 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300aebb-3f99-4616-b132-39f08b25f850 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:47.269372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300aebb-3f99-4616-b132-39f08b25f850 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:47.269588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300aebb-3f99-4616-b132-39f08b25f850 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:47.271241 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 14/26] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:24:47.287597 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c709c-15c5-4f44-ac3b-120e25ec8361 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:47.287946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c709c-15c5-4f44-ac3b-120e25ec8361 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:47.288147 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c709c-15c5-4f44-ac3b-120e25ec8361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:47.321734 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-022c709c-15c5-4f44-ac3b-120e25ec8361 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:47.323358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-022c709c-15c5-4f44-ac3b-120e25ec8361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:47.337483 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b84ace-4366-4234-9acd-555916cc5be0 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:47.389197 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78696455-101e-4d95-a415-1e13ab1e8fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:47.389921 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78696455-101e-4d95-a415-1e13ab1e8fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:47.390205 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78696455-101e-4d95-a415-1e13ab1e8fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:47.390474 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78696455-101e-4d95-a415-1e13ab1e8fc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:47.414345 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78696455-101e-4d95-a415-1e13ab1e8fc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:24:47.436359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-78696455-101e-4d95-a415-1e13ab1e8fc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:24:47.436359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:24:47.436359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:24:47.436359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:24:47.436359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:24:47.436359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:24:47.436359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:24:47.436359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:24:47.436359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:24:47.436359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:24:47.436359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:24:47.436359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:24:47.436359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:24:47.436359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:24:47.436359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:24:47.436359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:24:47.438310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:24:47.438310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:24:47.438310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:24:47.438310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:24:47.438310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:24:47.438310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:24:47.438310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:24:47.438310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:24:47.438310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:24:47.438310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:24:47.438310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:24:47.438310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:24:47.438310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:24:47.438310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:24:47.438310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:24:47.438310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:24:47.439844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:24:47.439844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:24:47.439844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:24:47.439844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:24:47.439844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:24:47.439844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:24:47.439844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:24:47.439844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:24:47.439844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:24:47.439844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:24:47.439844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:24:47.439844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:24:47.439844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 13/27] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:24:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:24:47.439844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78696455-101e-4d95-a415-1e13ab1e8fc3 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:47.540320 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 15/28] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:24:47.541704 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c709c-15c5-4f44-ac3b-120e25ec8361 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:47.560685 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:47.680961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78696455-101e-4d95-a415-1e13ab1e8fc3 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:47.691555 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:47.752403 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcfffe-d3a9-4d73-961b-87511c4a5c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:47.753082 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcfffe-d3a9-4d73-961b-87511c4a5c0e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:47.753368 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcfffe-d3a9-4d73-961b-87511c4a5c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:47.753643 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcfffe-d3a9-4d73-961b-87511c4a5c0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:47.777034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcfffe-d3a9-4d73-961b-87511c4a5c0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:47.778550 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcfffe-d3a9-4d73-961b-87511c4a5c0e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:47.820218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-dabcfffe-d3a9-4d73-961b-87511c4a5c0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:24:47.820218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:24:47.820218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:24:47.820218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:24:47.820218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:24:47.820218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:24:47.820218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:24:47.820218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:24:47.820218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:24:47.820218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:24:47.820218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:24:47.820218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:24:47.820218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:24:47.820218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:24:47.820218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:24:47.820218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:24:47.822178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:24:47.822178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:24:47.822178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:24:47.822178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:24:47.822178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:24:47.822178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:24:47.822178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:24:47.822178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:24:47.822178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:24:47.822178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:24:47.822178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:24:47.822178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:24:47.822178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:24:47.822178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:24:47.822178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:24:47.822178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:24:47.822178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:24:47.824144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:24:47.824144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:24:47.824144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:24:47.824144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 14/29] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:24:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:24:47.824144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988c695-65e3-4dd2-8bc6-ce0044ef6fa8 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:47.824144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988c695-65e3-4dd2-8bc6-ce0044ef6fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:47.824144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988c695-65e3-4dd2-8bc6-ce0044ef6fa8 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:47.824144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 15/30] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:24:47.828899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c709c-15c5-4f44-ac3b-120e25ec8361 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:47.830581 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72e27f-9bc9-41e6-9546-5adac5c766af None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:47.830944 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72e27f-9bc9-41e6-9546-5adac5c766af None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:47.831366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72e27f-9bc9-41e6-9546-5adac5c766af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:47.889526 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-7e72e27f-9bc9-41e6-9546-5adac5c766af None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:47.891654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-7e72e27f-9bc9-41e6-9546-5adac5c766af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:47.903520 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07827285-8218-4c36-8acb-65504c601e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:47.905026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07827285-8218-4c36-8acb-65504c601e0b None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:47.907273 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07827285-8218-4c36-8acb-65504c601e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:47.908128 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07827285-8218-4c36-8acb-65504c601e0b None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:47.909635 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07827285-8218-4c36-8acb-65504c601e0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:24:47.910401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07827285-8218-4c36-8acb-65504c601e0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:47.913224 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07827285-8218-4c36-8acb-65504c601e0b None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:47.937066 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 16/31] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:24:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:24:47.940953 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07827285-8218-4c36-8acb-65504c601e0b None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:48.052494 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 16/32] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:24:48.053408 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72e27f-9bc9-41e6-9546-5adac5c766af None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:48.104546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:48.190425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07827285-8218-4c36-8acb-65504c601e0b None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:48.306288 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d71d63-71f0-4b74-b54f-ad76cd66c15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:48.307267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d71d63-71f0-4b74-b54f-ad76cd66c15a None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:48.307773 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d71d63-71f0-4b74-b54f-ad76cd66c15a None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:48.308301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d71d63-71f0-4b74-b54f-ad76cd66c15a None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:48.312391 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d71d63-71f0-4b74-b54f-ad76cd66c15a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:24:48.312934 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d71d63-71f0-4b74-b54f-ad76cd66c15a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:48.315535 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d71d63-71f0-4b74-b54f-ad76cd66c15a None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:48.330271 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:48.355095 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72e27f-9bc9-41e6-9546-5adac5c766af None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:48.375968 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 17/33] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:24:48.379333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d71d63-71f0-4b74-b54f-ad76cd66c15a None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:48.451202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ed5ff-bd2c-45e5-8366-0f09cedc78e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:48.452732 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ed5ff-bd2c-45e5-8366-0f09cedc78e5 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:48.453494 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ed5ff-bd2c-45e5-8366-0f09cedc78e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:48.454234 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ed5ff-bd2c-45e5-8366-0f09cedc78e5 None admin] PATH_INFO: `/v3/users/3e753cc042b14c47bd5d1c6394848500` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:48.457243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ed5ff-bd2c-45e5-8366-0f09cedc78e5 None admin] RBAC: Authorizing `identity:get_user(user_id=3e753cc042b14c47bd5d1c6394848500)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:48.460315 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ed5ff-bd2c-45e5-8366-0f09cedc78e5 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:48.463550 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 17/34] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:24:48 2022] GET /identity/v3/users/3e753cc042b14c47bd5d1c6394848500 => generated 247 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:24:48.464962 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ed5ff-bd2c-45e5-8366-0f09cedc78e5 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:48.611098 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d71d63-71f0-4b74-b54f-ad76cd66c15a None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:48.651276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:48.656914 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ed5ff-bd2c-45e5-8366-0f09cedc78e5 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:48.669999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8a903-217d-4a00-bece-eecfc197847c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:48.670932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8a903-217d-4a00-bece-eecfc197847c None admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:48.671214 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8a903-217d-4a00-bece-eecfc197847c None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:48.671679 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8a903-217d-4a00-bece-eecfc197847c None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:48.672817 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8a903-217d-4a00-bece-eecfc197847c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:48.674332 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8a903-217d-4a00-bece-eecfc197847c None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:48.713782 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20690829-079e-4d45-ae4e-3052d3abef55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:48.715171 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20690829-079e-4d45-ae4e-3052d3abef55 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:48.715660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20690829-079e-4d45-ae4e-3052d3abef55 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:48.716134 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20690829-079e-4d45-ae4e-3052d3abef55 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:48.717038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20690829-079e-4d45-ae4e-3052d3abef55 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:48.718724 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20690829-079e-4d45-ae4e-3052d3abef55 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:48.826816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 18/35] 10.222.0.69 () {60 vars in 1131 bytes} [Mon Aug 29 21:24:48 2022] POST /identity/v3/roles => generated 219 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:24:48.828473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411a25c-9783-42b0-8f9a-493e6e790051 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:48.828766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411a25c-9783-42b0-8f9a-493e6e790051 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:48.829047 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411a25c-9783-42b0-8f9a-493e6e790051 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:48.831417 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 19/36] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:24:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:24:48.832587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411a25c-9783-42b0-8f9a-493e6e790051 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:48.881347 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 18/37] 10.222.0.69 () {60 vars in 1141 bytes} [Mon Aug 29 21:24:48 2022] POST /identity/v3/projects => generated 301 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:24:48.882808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20690829-079e-4d45-ae4e-3052d3abef55 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:48.906733 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:49.041159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411a25c-9783-42b0-8f9a-493e6e790051 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:49.079134 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20690829-079e-4d45-ae4e-3052d3abef55 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:49.124771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5e74b-7e87-408e-993a-8b29afe71afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:49.125984 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5e74b-7e87-408e-993a-8b29afe71afa None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:49.126989 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5e74b-7e87-408e-993a-8b29afe71afa None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:49.127462 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5e74b-7e87-408e-993a-8b29afe71afa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:49.130868 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5e74b-7e87-408e-993a-8b29afe71afa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:49.134228 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5e74b-7e87-408e-993a-8b29afe71afa None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:49.137747 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 20/38] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:24:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:24:49.139926 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acae33-a565-40b7-9016-9ed3764f33f3 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:49.140453 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acae33-a565-40b7-9016-9ed3764f33f3 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:49.140927 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acae33-a565-40b7-9016-9ed3764f33f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:49.154787 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd71ce-6c9f-4f35-b40b-a12b7496225e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:49.156086 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd71ce-6c9f-4f35-b40b-a12b7496225e None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:49.156833 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd71ce-6c9f-4f35-b40b-a12b7496225e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:49.157298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd71ce-6c9f-4f35-b40b-a12b7496225e None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:49.158460 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd71ce-6c9f-4f35-b40b-a12b7496225e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:49.161231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd71ce-6c9f-4f35-b40b-a12b7496225e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:49.186443 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 19/39] 10.222.0.69 () {60 vars in 1131 bytes} [Mon Aug 29 21:24:48 2022] POST /identity/v3/roles => generated 225 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:24:49.188548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc086ebc-e65a-4b01-bc9b-51be770ed966 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:49.188548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc086ebc-e65a-4b01-bc9b-51be770ed966 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:49.188548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc086ebc-e65a-4b01-bc9b-51be770ed966 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:49.195581 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 20/40] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:24:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:24:49.196684 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc086ebc-e65a-4b01-bc9b-51be770ed966 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:49.292748 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:49.306100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-c9acae33-a565-40b7-9016-9ed3764f33f3 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:49.313532 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-c9acae33-a565-40b7-9016-9ed3764f33f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:49.357267 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc086ebc-e65a-4b01-bc9b-51be770ed966 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:49.402786 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:49.422705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d7f62-d75c-43e1-8093-e70738908772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:49.423508 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d7f62-d75c-43e1-8093-e70738908772 None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:49.423796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d7f62-d75c-43e1-8093-e70738908772 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:49.424364 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d7f62-d75c-43e1-8093-e70738908772 None admin] PATH_INFO: `/v3/domains/default/users/3e753cc042b14c47bd5d1c6394848500/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:49.426845 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d7f62-d75c-43e1-8093-e70738908772 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3e753cc042b14c47bd5d1c6394848500, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:49.429007 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d7f62-d75c-43e1-8093-e70738908772 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:49.445093 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 21/41] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:24:49.446950 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6a5e9-a6fb-4987-84c0-ccd404d045f3 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:49.447357 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6a5e9-a6fb-4987-84c0-ccd404d045f3 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:49.447814 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6a5e9-a6fb-4987-84c0-ccd404d045f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:49.457305 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 21/42] 10.222.0.69 () {58 vars in 1361 bytes} [Mon Aug 29 21:24:49 2022] PUT /identity/v3/domains/default/users/3e753cc042b14c47bd5d1c6394848500/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:24:49.475438 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-9df6a5e9-a6fb-4987-84c0-ccd404d045f3 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:49.477315 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-9df6a5e9-a6fb-4987-84c0-ccd404d045f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:49.582071 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 22/43] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:24:49.753564 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d7f62-d75c-43e1-8093-e70738908772 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:49.867309 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6a5e9-a6fb-4987-84c0-ccd404d045f3 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:49.918315 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d7f62-d75c-43e1-8093-e70738908772 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:49.956886 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:49.980364 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5eb55-348c-4382-a233-c0670182bdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:49.981009 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5eb55-348c-4382-a233-c0670182bdb1 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:49.981305 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5eb55-348c-4382-a233-c0670182bdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:49.981585 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5eb55-348c-4382-a233-c0670182bdb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:49.982285 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5eb55-348c-4382-a233-c0670182bdb1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:49.983723 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5eb55-348c-4382-a233-c0670182bdb1 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:50.007889 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 22/44] 10.222.0.69 () {60 vars in 1131 bytes} [Mon Aug 29 21:24:49 2022] POST /identity/v3/roles => generated 223 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:24:50.039596 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6a5e9-a6fb-4987-84c0-ccd404d045f3 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:50.062829 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:50.103801 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78073f-b1b1-49a9-bace-ea20d69874f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:50.104951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78073f-b1b1-49a9-bace-ea20d69874f2 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:50.104951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78073f-b1b1-49a9-bace-ea20d69874f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:50.105443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78073f-b1b1-49a9-bace-ea20d69874f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:50.107121 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78073f-b1b1-49a9-bace-ea20d69874f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:50.108888 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78073f-b1b1-49a9-bace-ea20d69874f2 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:50.110832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 23/45] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:24:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:24:50.117420 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5eb55-348c-4382-a233-c0670182bdb1 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:50.274557 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5eb55-348c-4382-a233-c0670182bdb1 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:50.318438 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a75c5e-6523-47f2-b9fc-c2e0be8583f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:50.319141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a75c5e-6523-47f2-b9fc-c2e0be8583f0 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:50.319502 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a75c5e-6523-47f2-b9fc-c2e0be8583f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:50.320412 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a75c5e-6523-47f2-b9fc-c2e0be8583f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:50.321149 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a75c5e-6523-47f2-b9fc-c2e0be8583f0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:50.322779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a75c5e-6523-47f2-b9fc-c2e0be8583f0 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:50.364213 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 23/46] 10.222.0.69 () {60 vars in 1141 bytes} [Mon Aug 29 21:24:50 2022] POST /identity/v3/projects => generated 312 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:24:51.534706 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31638331-6a9d-4054-bed5-1c3a06a6da4d None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:51.535491 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31638331-6a9d-4054-bed5-1c3a06a6da4d None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:51.535491 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31638331-6a9d-4054-bed5-1c3a06a6da4d None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:51.537161 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 24/47] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:24:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:24:51.543479 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717cd8a-1a23-4ac9-b9f9-d336cb2ab344 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:51.543987 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717cd8a-1a23-4ac9-b9f9-d336cb2ab344 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:51.544668 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717cd8a-1a23-4ac9-b9f9-d336cb2ab344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:51.567172 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-9717cd8a-1a23-4ac9-b9f9-d336cb2ab344 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:51.568812 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9717cd8a-1a23-4ac9-b9f9-d336cb2ab344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:51.613118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:51.650173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 24/48] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:24:51.935418 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31638331-6a9d-4054-bed5-1c3a06a6da4d None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:52.052210 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31638331-6a9d-4054-bed5-1c3a06a6da4d None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:52.094266 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518a4fb-94a0-478f-80de-8ed14f2eeec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:52.094949 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518a4fb-94a0-478f-80de-8ed14f2eeec2 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:52.095743 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518a4fb-94a0-478f-80de-8ed14f2eeec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:52.095743 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518a4fb-94a0-478f-80de-8ed14f2eeec2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:52.109371 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5518a4fb-94a0-478f-80de-8ed14f2eeec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:24:52.114473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-5518a4fb-94a0-478f-80de-8ed14f2eeec2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:24:52.114473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:24:52.114473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:24:52.114473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:24:52.114473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:24:52.114473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:24:52.114473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:24:52.114473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:24:52.114473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:24:52.114473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:24:52.114473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:24:52.114473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:24:52.114473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:24:52.114473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:24:52.114473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:24:52.114473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:24:52.115573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:24:52.115573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:24:52.115573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:24:52.115573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:24:52.115573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:24:52.115573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:24:52.115573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:24:52.115573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:24:52.115573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:24:52.115573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:24:52.115573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:24:52.115573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:24:52.115573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:24:52.115573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:24:52.115573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:24:52.115573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:24:52.116428 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:24:52.116428 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:24:52.116428 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:24:52.116428 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:24:52.116428 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:24:52.116428 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:24:52.116428 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:24:52.116428 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:24:52.116428 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:24:52.116428 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:24:52.116428 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:24:52.116428 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:24:52.116428 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 25/49] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:24:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:24:52.122194 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717cd8a-1a23-4ac9-b9f9-d336cb2ab344 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:52.251164 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717cd8a-1a23-4ac9-b9f9-d336cb2ab344 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:52.291456 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7f17f-6846-4393-b885-03c3ecbe764a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:52.292085 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7f17f-6846-4393-b885-03c3ecbe764a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:52.294574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7f17f-6846-4393-b885-03c3ecbe764a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:52.294574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7f17f-6846-4393-b885-03c3ecbe764a None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:52.294574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7f17f-6846-4393-b885-03c3ecbe764a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:24:52.294574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7f17f-6846-4393-b885-03c3ecbe764a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:52.295054 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7f17f-6846-4393-b885-03c3ecbe764a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:52.308900 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 25/50] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:24:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:24:52.315883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518a4fb-94a0-478f-80de-8ed14f2eeec2 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:52.358189 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ce9b8-620b-40f0-8f8b-32ea38f51292 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:52.358612 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ce9b8-620b-40f0-8f8b-32ea38f51292 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:52.358974 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ce9b8-620b-40f0-8f8b-32ea38f51292 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:52.360564 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 26/51] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:24:52.365174 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:52.366361 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bc289-d0b4-4d09-a60b-d4aaf6acf6e1 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:52.367384 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bc289-d0b4-4d09-a60b-d4aaf6acf6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:52.367670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bc289-d0b4-4d09-a60b-d4aaf6acf6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:52.387277 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-943bc289-d0b4-4d09-a60b-d4aaf6acf6e1 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:52.388552 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-943bc289-d0b4-4d09-a60b-d4aaf6acf6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:52.420836 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:52.440146 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518a4fb-94a0-478f-80de-8ed14f2eeec2 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:52.489868 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d4d29-0ae6-47bc-9986-1791b5f1da78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:52.490444 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d4d29-0ae6-47bc-9986-1791b5f1da78 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:52.490724 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d4d29-0ae6-47bc-9986-1791b5f1da78 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:52.491005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d4d29-0ae6-47bc-9986-1791b5f1da78 None admin] PATH_INFO: `/v3/users/3e753cc042b14c47bd5d1c6394848500` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:52.492857 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d4d29-0ae6-47bc-9986-1791b5f1da78 None admin] RBAC: Authorizing `identity:get_user(user_id=3e753cc042b14c47bd5d1c6394848500)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:52.494388 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d4d29-0ae6-47bc-9986-1791b5f1da78 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:52.496137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 26/52] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:24:52 2022] GET /identity/v3/users/3e753cc042b14c47bd5d1c6394848500 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:24:52.502335 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d4d29-0ae6-47bc-9986-1791b5f1da78 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:52.584032 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 27/53] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:24:52.622443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d4d29-0ae6-47bc-9986-1791b5f1da78 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:52.635772 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:52.666579 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523d6e9-5754-4f2f-8ee9-b9bbeb748319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:52.667589 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523d6e9-5754-4f2f-8ee9-b9bbeb748319 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:52.668097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523d6e9-5754-4f2f-8ee9-b9bbeb748319 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:52.668525 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523d6e9-5754-4f2f-8ee9-b9bbeb748319 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:52.669696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523d6e9-5754-4f2f-8ee9-b9bbeb748319 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:52.671154 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523d6e9-5754-4f2f-8ee9-b9bbeb748319 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:52.672762 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 27/54] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:24:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:24:52.678997 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bc289-d0b4-4d09-a60b-d4aaf6acf6e1 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:52.794219 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bc289-d0b4-4d09-a60b-d4aaf6acf6e1 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:52.831613 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe23a65-5d1f-4c20-938d-2d16cc3d90b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:52.832265 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe23a65-5d1f-4c20-938d-2d16cc3d90b5 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:52.832549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe23a65-5d1f-4c20-938d-2d16cc3d90b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:52.832818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe23a65-5d1f-4c20-938d-2d16cc3d90b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:52.833547 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe23a65-5d1f-4c20-938d-2d16cc3d90b5 None admin] RBAC: Adding query filter params (role.id=69369872661e4179bb51cd1ca76e28c3, scope.domain.id=default, user.id=3e753cc042b14c47bd5d1c6394848500) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:24:52.833852 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe23a65-5d1f-4c20-938d-2d16cc3d90b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:52.835309 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe23a65-5d1f-4c20-938d-2d16cc3d90b5 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:52.845047 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 28/55] 10.222.0.69 () {56 vars in 1322 bytes} [Mon Aug 29 21:24:52 2022] GET /identity/v3/role_assignments?user.id=3e753cc042b14c47bd5d1c6394848500&scope.domain.id=default&role.id=69369872661e4179bb51cd1ca76e28c3 => generated 530 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:24:52.863563 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523d6e9-5754-4f2f-8ee9-b9bbeb748319 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:52.990908 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523d6e9-5754-4f2f-8ee9-b9bbeb748319 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:53.028300 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307d198-446c-4312-94a9-169f83b422f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:53.029042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307d198-446c-4312-94a9-169f83b422f1 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:53.029393 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307d198-446c-4312-94a9-169f83b422f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:53.029812 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307d198-446c-4312-94a9-169f83b422f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:53.031058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5307d198-446c-4312-94a9-169f83b422f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:53.032608 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5307d198-446c-4312-94a9-169f83b422f1 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:53.034501 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 28/56] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:24:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:24:53.040006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe23a65-5d1f-4c20-938d-2d16cc3d90b5 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:53.073944 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:53.163393 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe23a65-5d1f-4c20-938d-2d16cc3d90b5 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:53.200393 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9bbcb-3538-462e-bb35-db09b12ea1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:53.201046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9bbcb-3538-462e-bb35-db09b12ea1a1 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:53.201336 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9bbcb-3538-462e-bb35-db09b12ea1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:53.201615 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9bbcb-3538-462e-bb35-db09b12ea1a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:53.202280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9bbcb-3538-462e-bb35-db09b12ea1a1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:53.203751 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9bbcb-3538-462e-bb35-db09b12ea1a1 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:53.236036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 29/57] 10.222.0.69 () {60 vars in 1140 bytes} [Mon Aug 29 21:24:53 2022] POST /identity/v3/projects => generated 298 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:24:55.328361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573782c2-fda0-4c22-b702-b7a02d9167b5 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:55.328915 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573782c2-fda0-4c22-b702-b7a02d9167b5 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:55.328915 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573782c2-fda0-4c22-b702-b7a02d9167b5 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:55.330294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 29/58] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:24:55.336960 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39ca02-58ce-44c0-a60c-95b34234db2d None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:55.337466 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39ca02-58ce-44c0-a60c-95b34234db2d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:55.337552 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39ca02-58ce-44c0-a60c-95b34234db2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:55.357880 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-7f39ca02-58ce-44c0-a60c-95b34234db2d None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:55.359259 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-7f39ca02-58ce-44c0-a60c-95b34234db2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:55.431734 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 30/59] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:24:55.707067 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573782c2-fda0-4c22-b702-b7a02d9167b5 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:55.759741 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:55.814872 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573782c2-fda0-4c22-b702-b7a02d9167b5 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:55.849669 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90d324-11a5-4dd4-9f0b-8869699994dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:55.850354 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90d324-11a5-4dd4-9f0b-8869699994dc None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:55.850634 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90d324-11a5-4dd4-9f0b-8869699994dc None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:55.850916 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90d324-11a5-4dd4-9f0b-8869699994dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:55.852394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90d324-11a5-4dd4-9f0b-8869699994dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:55.853843 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90d324-11a5-4dd4-9f0b-8869699994dc None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:55.855434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 30/60] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:24:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:24:55.861073 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39ca02-58ce-44c0-a60c-95b34234db2d None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:55.871643 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:55.962224 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39ca02-58ce-44c0-a60c-95b34234db2d None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:24:55.995908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16717490-eb27-4d25-9348-40e643150499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:24:55.996548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16717490-eb27-4d25-9348-40e643150499 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:55.996829 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16717490-eb27-4d25-9348-40e643150499 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:55.997101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16717490-eb27-4d25-9348-40e643150499 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:55.997755 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16717490-eb27-4d25-9348-40e643150499 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:24:55.999203 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16717490-eb27-4d25-9348-40e643150499 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:24:56.026168 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 31/61] 10.222.0.69 () {60 vars in 1132 bytes} [Mon Aug 29 21:24:55 2022] POST /identity/v3/users => generated 275 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:24:59.197980 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d03885-2dfe-4821-8006-a915c68d8301 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:59.199127 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d03885-2dfe-4821-8006-a915c68d8301 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:59.199622 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d03885-2dfe-4821-8006-a915c68d8301 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:59.201257 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 31/62] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:24:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:24:59.208624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764cbb5-5a9f-4c56-b85c-9712cb1979ee None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:59.209805 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764cbb5-5a9f-4c56-b85c-9712cb1979ee None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:59.210281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764cbb5-5a9f-4c56-b85c-9712cb1979ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:59.245598 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f764cbb5-5a9f-4c56-b85c-9712cb1979ee None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:59.247446 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f764cbb5-5a9f-4c56-b85c-9712cb1979ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:59.329916 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7af8a-c248-4644-94a7-3cd0aa041521 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:59.330603 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7af8a-c248-4644-94a7-3cd0aa041521 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:59.331106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7af8a-c248-4644-94a7-3cd0aa041521 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:59.333131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 32/63] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:24:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:24:59.338992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9f6c0-0506-41ed-918a-f05d7692607d None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:24:59.339550 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9f6c0-0506-41ed-918a-f05d7692607d None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:24:59.340043 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9f6c0-0506-41ed-918a-f05d7692607d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:24:59.348408 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:59.364341 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 32/64] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:24:59.370649 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-75f9f6c0-0506-41ed-918a-f05d7692607d None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:24:59.371895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-75f9f6c0-0506-41ed-918a-f05d7692607d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:24:59.505582 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 33/65] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:24:59.812315 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764cbb5-5a9f-4c56-b85c-9712cb1979ee None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:59.864629 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9f6c0-0506-41ed-918a-f05d7692607d None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:24:59.947088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:24:59.955962 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764cbb5-5a9f-4c56-b85c-9712cb1979ee None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:00.003466 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed35fb-6219-45ff-b491-2af5f46ed4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:00.004423 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed35fb-6219-45ff-b491-2af5f46ed4e7 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:00.004853 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed35fb-6219-45ff-b491-2af5f46ed4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:00.005280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed35fb-6219-45ff-b491-2af5f46ed4e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:00.020569 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed35fb-6219-45ff-b491-2af5f46ed4e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:00.026604 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9f6c0-0506-41ed-918a-f05d7692607d None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:00.027014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-aeed35fb-6219-45ff-b491-2af5f46ed4e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:00.027014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:00.027014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:00.027014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:00.027014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:00.027014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:00.027014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:00.027014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:00.027014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:00.027014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:00.027014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:00.027014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:00.027014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:00.027014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:00.027014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:00.027014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:00.028205 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:00.028205 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:00.028205 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:00.028205 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:00.028205 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:00.028205 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:00.028205 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:00.028205 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:00.028205 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:00.028205 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:00.028205 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:00.028205 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:00.028205 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:00.028205 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:00.028205 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:00.028205 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:00.029337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:00.029337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:00.029337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:00.029337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:00.029337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:00.029337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:00.029337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:00.029337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:00.029337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:00.029337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:00.029337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:00.029337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:25:00.031759 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 33/66] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:24:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:00.034134 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127486f8-6de8-4c8a-ba98-96a71cd8001d None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:00.034702 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127486f8-6de8-4c8a-ba98-96a71cd8001d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:00.035175 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127486f8-6de8-4c8a-ba98-96a71cd8001d None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:00.036817 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 34/67] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:00.037828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127486f8-6de8-4c8a-ba98-96a71cd8001d None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:00.076674 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072a3a1-8b59-40e2-a84f-509743a8a1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:00.077265 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072a3a1-8b59-40e2-a84f-509743a8a1fa None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:00.077679 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072a3a1-8b59-40e2-a84f-509743a8a1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:00.077831 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072a3a1-8b59-40e2-a84f-509743a8a1fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:00.094484 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072a3a1-8b59-40e2-a84f-509743a8a1fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:00.100216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-f072a3a1-8b59-40e2-a84f-509743a8a1fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:25:00.100216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:00.100216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:00.100216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:00.100216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:00.100216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:00.100216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:00.100216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:00.100216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:00.100216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:00.100216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:00.100216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:00.100216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:00.100216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:00.100216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:00.100216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:00.104483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:00.104483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:00.104483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:00.104483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:00.104483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:00.104483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:00.104483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:00.104483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:00.104483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:00.104483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:00.104483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:00.104483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:00.104483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:00.104483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:00.104483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:00.104483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:00.105363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:00.105363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:00.105363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:00.105363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:00.105363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:00.105363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:00.105363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:00.105363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:00.105363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:00.105363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:00.105363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:25:00.105363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:00.105363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 34/68] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:24:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:00.105363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a897431-274e-4d90-adb9-1294cafc60d1 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:00.106082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a897431-274e-4d90-adb9-1294cafc60d1 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:00.106082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a897431-274e-4d90-adb9-1294cafc60d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:00.117085 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:00.125429 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-2a897431-274e-4d90-adb9-1294cafc60d1 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:00.127053 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-2a897431-274e-4d90-adb9-1294cafc60d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:00.188954 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127486f8-6de8-4c8a-ba98-96a71cd8001d None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:00.220598 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 35/69] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:00.221853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114d572-d369-43fd-9050-bcfd3511ccf6 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:00.222202 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114d572-d369-43fd-9050-bcfd3511ccf6 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:00.222484 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114d572-d369-43fd-9050-bcfd3511ccf6 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:00.223768 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 36/70] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:00.224686 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114d572-d369-43fd-9050-bcfd3511ccf6 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:00.250556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449a841-3686-4ee8-b244-664e8f76bcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:00.251767 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449a841-3686-4ee8-b244-664e8f76bcca None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:00.252251 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449a841-3686-4ee8-b244-664e8f76bcca None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:00.252672 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449a841-3686-4ee8-b244-664e8f76bcca None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:00.253504 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449a841-3686-4ee8-b244-664e8f76bcca None admin] RBAC: Adding query filter params (name=member) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:00.253960 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449a841-3686-4ee8-b244-664e8f76bcca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:00.255542 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449a841-3686-4ee8-b244-664e8f76bcca None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:00.265468 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 35/71] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:00.267122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389aa29-b7fb-4a3d-95e6-7132dbf33cf1 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:00.267600 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389aa29-b7fb-4a3d-95e6-7132dbf33cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:00.268057 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389aa29-b7fb-4a3d-95e6-7132dbf33cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:00.280633 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:00.290706 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-4389aa29-b7fb-4a3d-95e6-7132dbf33cf1 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:00.291769 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4389aa29-b7fb-4a3d-95e6-7132dbf33cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:00.367115 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114d572-d369-43fd-9050-bcfd3511ccf6 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:00.373135 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 36/72] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:00.376743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389aa29-b7fb-4a3d-95e6-7132dbf33cf1 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:00.416610 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa36ed-879a-4a50-88ac-38760cea8b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:00.417520 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa36ed-879a-4a50-88ac-38760cea8b59 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:00.417961 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa36ed-879a-4a50-88ac-38760cea8b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:00.418391 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa36ed-879a-4a50-88ac-38760cea8b59 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:00.419317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa36ed-879a-4a50-88ac-38760cea8b59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:00.419929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa36ed-879a-4a50-88ac-38760cea8b59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:00.421588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa36ed-879a-4a50-88ac-38760cea8b59 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:00.432499 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 37/73] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:00.434123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6d1a6-d7fd-4c32-977f-b3e0d35290cd None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:00.434686 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6d1a6-d7fd-4c32-977f-b3e0d35290cd None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:00.435165 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6d1a6-d7fd-4c32-977f-b3e0d35290cd None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:00.436935 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 38/74] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:00.442629 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:00.443470 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6d1a6-d7fd-4c32-977f-b3e0d35290cd None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:00.526678 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389aa29-b7fb-4a3d-95e6-7132dbf33cf1 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:00.560891 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:00.568751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6d1a6-d7fd-4c32-977f-b3e0d35290cd None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:00.570984 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48288104-34fb-4b1e-8d0f-c6f976a83063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:00.572223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48288104-34fb-4b1e-8d0f-c6f976a83063 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:00.572223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48288104-34fb-4b1e-8d0f-c6f976a83063 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:00.572223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48288104-34fb-4b1e-8d0f-c6f976a83063 None admin] PATH_INFO: `/v3/users/11f0143c2b4e42a4ab57c2570a1d80e8` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:00.589010 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48288104-34fb-4b1e-8d0f-c6f976a83063 None admin] RBAC: Authorizing `identity:get_user(user_id=11f0143c2b4e42a4ab57c2570a1d80e8)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:00.590514 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48288104-34fb-4b1e-8d0f-c6f976a83063 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:00.593974 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 37/75] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:00 2022] GET /identity/v3/users/11f0143c2b4e42a4ab57c2570a1d80e8 => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:00.595541 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd0501-4d86-4dae-bb7e-96e421ef06b1 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:00.595832 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd0501-4d86-4dae-bb7e-96e421ef06b1 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:00.596117 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd0501-4d86-4dae-bb7e-96e421ef06b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:00.616360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-b0dd0501-4d86-4dae-bb7e-96e421ef06b1 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:00.617690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b0dd0501-4d86-4dae-bb7e-96e421ef06b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:00.620508 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295a228-da44-46ab-b741-d6e59c2ea9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:00.621233 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295a228-da44-46ab-b741-d6e59c2ea9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:00.621443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295a228-da44-46ab-b741-d6e59c2ea9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:00.621726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295a228-da44-46ab-b741-d6e59c2ea9c3 None admin] PATH_INFO: `/v3/users/3e753cc042b14c47bd5d1c6394848500` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:00.622882 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295a228-da44-46ab-b741-d6e59c2ea9c3 None admin] RBAC: Authorizing `identity:get_user(user_id=3e753cc042b14c47bd5d1c6394848500)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:00.624370 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295a228-da44-46ab-b741-d6e59c2ea9c3 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:00.625982 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 39/76] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:00 2022] GET /identity/v3/users/3e753cc042b14c47bd5d1c6394848500 => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:00.626752 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295a228-da44-46ab-b741-d6e59c2ea9c3 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:00.703341 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 38/77] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:00.704231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd0501-4d86-4dae-bb7e-96e421ef06b1 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:00.738025 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295a228-da44-46ab-b741-d6e59c2ea9c3 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:00.742030 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:00.778164 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee6351-7386-416f-9d58-ad99bdb7b3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:00.779033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee6351-7386-416f-9d58-ad99bdb7b3e0 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:00.779147 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee6351-7386-416f-9d58-ad99bdb7b3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:00.779362 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee6351-7386-416f-9d58-ad99bdb7b3e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:00.792801 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee6351-7386-416f-9d58-ad99bdb7b3e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:00.798695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-7cee6351-7386-416f-9d58-ad99bdb7b3e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:25:00.798695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:00.798695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:00.798695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:00.798695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:00.798695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:00.798695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:00.798695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:00.798695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:00.798695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:00.798695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:00.798695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:00.798695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:00.798695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:00.798695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:00.798695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:00.804576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:00.804576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:00.804576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:00.804576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:00.804576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:00.804576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:00.804576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:00.804576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:00.804576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:00.804576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:00.804576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:00.804576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:00.804576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:00.804576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:00.804576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:00.804576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:00.805765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:00.805765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:00.805765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:00.805765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:00.805765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:00.805765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:00.805765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:00.805765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:00.805765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:00.805765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:00.805765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:25:00.805765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:00.805765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 40/78] 10.222.0.69 () {56 vars in 1114 bytes} [Mon Aug 29 21:25:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:00.805765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee6351-7386-416f-9d58-ad99bdb7b3e0 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:00.828017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd0501-4d86-4dae-bb7e-96e421ef06b1 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:00.838591 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:00.877518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b9f66-9f21-46cf-8c6d-13bf09865d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:00.878061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b9f66-9f21-46cf-8c6d-13bf09865d10 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:00.878351 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b9f66-9f21-46cf-8c6d-13bf09865d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:00.878631 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b9f66-9f21-46cf-8c6d-13bf09865d10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:00.932106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee6351-7386-416f-9d58-ad99bdb7b3e0 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:00.968236 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b9f66-9f21-46cf-8c6d-13bf09865d10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:00.969872 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b9f66-9f21-46cf-8c6d-13bf09865d10 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:00.981028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35805466-ffd2-4b10-bcd6-02b2284a27dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:00.981751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35805466-ffd2-4b10-bcd6-02b2284a27dc None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:00.982035 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35805466-ffd2-4b10-bcd6-02b2284a27dc None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:00.982771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35805466-ffd2-4b10-bcd6-02b2284a27dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:01.010847 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:01.065480 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35805466-ffd2-4b10-bcd6-02b2284a27dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:01.066941 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35805466-ffd2-4b10-bcd6-02b2284a27dc None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:01.088862 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 39/79] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:25:01.089731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b9f66-9f21-46cf-8c6d-13bf09865d10 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:01.094257 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:01.197303 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 41/80] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:25:01.198176 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35805466-ffd2-4b10-bcd6-02b2284a27dc None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:01.218807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b9f66-9f21-46cf-8c6d-13bf09865d10 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:01.264958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d77dcb-0d11-4b78-8c02-1ecc367ad5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:01.265602 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d77dcb-0d11-4b78-8c02-1ecc367ad5c8 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:01.265874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d77dcb-0d11-4b78-8c02-1ecc367ad5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:01.266147 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d77dcb-0d11-4b78-8c02-1ecc367ad5c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:01.268208 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:01.279617 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d77dcb-0d11-4b78-8c02-1ecc367ad5c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:01.284760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-c6d77dcb-0d11-4b78-8c02-1ecc367ad5c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:01.284760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:01.284760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:01.284760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:01.284760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:01.284760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:01.284760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:01.284760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:01.284760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:01.284760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:01.284760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:01.284760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:01.284760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:01.284760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:01.284760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:01.284760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:01.285688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:01.285688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:01.285688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:01.285688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:01.285688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:01.285688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:01.285688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:01.285688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:01.285688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:01.285688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:01.285688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:01.285688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:01.285688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:01.285688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:01.285688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:01.285688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:01.286496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:01.286496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:01.286496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:01.286496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:01.286496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:01.286496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:01.286496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:01.286496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:01.286496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:01.286496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:01.286496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:01.286496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:25:01.286496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 40/81] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:01.290766 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d77dcb-0d11-4b78-8c02-1ecc367ad5c8 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:01.323636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35805466-ffd2-4b10-bcd6-02b2284a27dc None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:01.349305 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:01.370046 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea24817-6c1a-4c10-971e-0878ed6a094a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:01.370729 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea24817-6c1a-4c10-971e-0878ed6a094a None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:01.371014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea24817-6c1a-4c10-971e-0878ed6a094a None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:01.371351 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea24817-6c1a-4c10-971e-0878ed6a094a None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:01.371955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea24817-6c1a-4c10-971e-0878ed6a094a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:01.372294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea24817-6c1a-4c10-971e-0878ed6a094a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:01.373698 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea24817-6c1a-4c10-971e-0878ed6a094a None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:01.382983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 42/82] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:25:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:01.385104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea24817-6c1a-4c10-971e-0878ed6a094a None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:01.417500 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d77dcb-0d11-4b78-8c02-1ecc367ad5c8 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:01.455644 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e9a6a-a4a8-4975-89de-2b676ae00455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:01.456331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e9a6a-a4a8-4975-89de-2b676ae00455 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:01.456788 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e9a6a-a4a8-4975-89de-2b676ae00455 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:01.457608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e9a6a-a4a8-4975-89de-2b676ae00455 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:01.458438 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e9a6a-a4a8-4975-89de-2b676ae00455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:01.459940 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e9a6a-a4a8-4975-89de-2b676ae00455 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:01.461600 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 41/83] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:25:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:01.462589 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e9a6a-a4a8-4975-89de-2b676ae00455 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:01.517744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea24817-6c1a-4c10-971e-0878ed6a094a None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:01.537985 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:01.553610 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d431d3a-dcf0-4adb-a80c-da6eba8e9600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:01.554189 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d431d3a-dcf0-4adb-a80c-da6eba8e9600 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:01.555070 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d431d3a-dcf0-4adb-a80c-da6eba8e9600 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:01.555588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d431d3a-dcf0-4adb-a80c-da6eba8e9600 None admin] PATH_INFO: `/v3/projects/9e54ec3d9806409e8a45d9a82823741d` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:01.557579 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d431d3a-dcf0-4adb-a80c-da6eba8e9600 None admin] RBAC: Authorizing `identity:get_project(project_id=9e54ec3d9806409e8a45d9a82823741d)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:01.560317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d431d3a-dcf0-4adb-a80c-da6eba8e9600 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:01.562519 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 43/84] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:01 2022] GET /identity/v3/projects/9e54ec3d9806409e8a45d9a82823741d => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:01.562903 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d431d3a-dcf0-4adb-a80c-da6eba8e9600 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:01.583110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e9a6a-a4a8-4975-89de-2b676ae00455 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:01.623425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:01.626814 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff66d6-1d1b-460e-be12-7cd61e1346d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:01.627474 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff66d6-1d1b-460e-be12-7cd61e1346d1 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:01.627762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff66d6-1d1b-460e-be12-7cd61e1346d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:01.628039 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff66d6-1d1b-460e-be12-7cd61e1346d1 None admin] PATH_INFO: `/v3/projects/9e54ec3d9806409e8a45d9a82823741d` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:01.629243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff66d6-1d1b-460e-be12-7cd61e1346d1 None admin] RBAC: Authorizing `identity:get_project(project_id=9e54ec3d9806409e8a45d9a82823741d)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:01.630705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff66d6-1d1b-460e-be12-7cd61e1346d1 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:01.632567 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 42/85] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:01 2022] GET /identity/v3/projects/9e54ec3d9806409e8a45d9a82823741d => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:01.633169 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff66d6-1d1b-460e-be12-7cd61e1346d1 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:01.677889 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d431d3a-dcf0-4adb-a80c-da6eba8e9600 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:01.716713 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efe966-be87-4e8f-aa78-211344f751e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:01.717262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efe966-be87-4e8f-aa78-211344f751e3 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:01.717541 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efe966-be87-4e8f-aa78-211344f751e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:01.717830 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efe966-be87-4e8f-aa78-211344f751e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:01.718508 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06efe966-be87-4e8f-aa78-211344f751e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:01.718907 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06efe966-be87-4e8f-aa78-211344f751e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:01.720256 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06efe966-be87-4e8f-aa78-211344f751e3 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:01.734863 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 44/86] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:01.734863 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efe966-be87-4e8f-aa78-211344f751e3 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:01.759223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff66d6-1d1b-460e-be12-7cd61e1346d1 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:01.789696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:01.797915 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade1a43-faac-4fb8-bb74-805191f73584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:01.798777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade1a43-faac-4fb8-bb74-805191f73584 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:01.799241 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade1a43-faac-4fb8-bb74-805191f73584 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:01.799638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade1a43-faac-4fb8-bb74-805191f73584 None admin] PATH_INFO: `/v3/users/11f0143c2b4e42a4ab57c2570a1d80e8` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:01.802896 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade1a43-faac-4fb8-bb74-805191f73584 None admin] RBAC: Authorizing `identity:get_user(user_id=11f0143c2b4e42a4ab57c2570a1d80e8)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:01.804732 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade1a43-faac-4fb8-bb74-805191f73584 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:01.806380 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 43/87] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:01 2022] GET /identity/v3/users/11f0143c2b4e42a4ab57c2570a1d80e8 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:01.807161 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade1a43-faac-4fb8-bb74-805191f73584 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:01.847442 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efe966-be87-4e8f-aa78-211344f751e3 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:01.865893 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:01.893755 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e0ac6-5aed-40ea-afaf-c1a2d2320b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:01.895062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e0ac6-5aed-40ea-afaf-c1a2d2320b35 None admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:01.895062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e0ac6-5aed-40ea-afaf-c1a2d2320b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:01.895062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e0ac6-5aed-40ea-afaf-c1a2d2320b35 None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:01.895567 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e0ac6-5aed-40ea-afaf-c1a2d2320b35 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:01.897075 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e0ac6-5aed-40ea-afaf-c1a2d2320b35 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:01.926374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 45/88] 10.222.0.69 () {60 vars in 1132 bytes} [Mon Aug 29 21:25:01 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:25:01.927547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e0ac6-5aed-40ea-afaf-c1a2d2320b35 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:01.955308 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade1a43-faac-4fb8-bb74-805191f73584 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:01.999153 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd1b48-18df-4b3a-a698-33db82ac2c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:01.999704 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd1b48-18df-4b3a-a698-33db82ac2c4f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:01.999994 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd1b48-18df-4b3a-a698-33db82ac2c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:02.000309 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd1b48-18df-4b3a-a698-33db82ac2c4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:02.001060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd1b48-18df-4b3a-a698-33db82ac2c4f None admin] RBAC: Adding query filter params (role.id=29d2c7708bea4287a21112bb7ffa72df, scope.project.id=9e54ec3d9806409e8a45d9a82823741d, user.id=11f0143c2b4e42a4ab57c2570a1d80e8) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:02.001401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd1b48-18df-4b3a-a698-33db82ac2c4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:02.002865 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd1b48-18df-4b3a-a698-33db82ac2c4f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:02.020213 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 44/89] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:25:01 2022] GET /identity/v3/role_assignments?user.id=11f0143c2b4e42a4ab57c2570a1d80e8&scope.project.id=9e54ec3d9806409e8a45d9a82823741d&role.id=29d2c7708bea4287a21112bb7ffa72df => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:02.020213 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd1b48-18df-4b3a-a698-33db82ac2c4f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:02.078232 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e0ac6-5aed-40ea-afaf-c1a2d2320b35 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:02.122081 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:02.143829 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088829d-4dea-4b5a-8aed-d6ebe174057c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:02.144552 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088829d-4dea-4b5a-8aed-d6ebe174057c None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:02.144928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088829d-4dea-4b5a-8aed-d6ebe174057c None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:02.145304 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088829d-4dea-4b5a-8aed-d6ebe174057c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:02.146205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088829d-4dea-4b5a-8aed-d6ebe174057c None admin] RBAC: Adding query filter params (role.id=69369872661e4179bb51cd1ca76e28c3, scope.project.id=9e54ec3d9806409e8a45d9a82823741d, user.id=3e753cc042b14c47bd5d1c6394848500) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:02.146514 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088829d-4dea-4b5a-8aed-d6ebe174057c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:02.148163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088829d-4dea-4b5a-8aed-d6ebe174057c None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:02.159232 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 46/90] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:25:01 2022] GET /identity/v3/role_assignments?user.id=3e753cc042b14c47bd5d1c6394848500&scope.project.id=9e54ec3d9806409e8a45d9a82823741d&role.id=69369872661e4179bb51cd1ca76e28c3 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:02.160121 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088829d-4dea-4b5a-8aed-d6ebe174057c None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:02.195997 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd1b48-18df-4b3a-a698-33db82ac2c4f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:02.231840 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:02.258339 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd39548-3c73-4a58-9444-ced275aa7e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:02.258941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd39548-3c73-4a58-9444-ced275aa7e2c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:02.259234 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd39548-3c73-4a58-9444-ced275aa7e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:02.259519 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd39548-3c73-4a58-9444-ced275aa7e2c None admin] PATH_INFO: `/v3/users/11f0143c2b4e42a4ab57c2570a1d80e8` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:02.261659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd39548-3c73-4a58-9444-ced275aa7e2c None admin] RBAC: Authorizing `identity:get_user(user_id=11f0143c2b4e42a4ab57c2570a1d80e8)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:02.263175 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd39548-3c73-4a58-9444-ced275aa7e2c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:02.265131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 45/91] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:02 2022] GET /identity/v3/users/11f0143c2b4e42a4ab57c2570a1d80e8 => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:02.273165 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd39548-3c73-4a58-9444-ced275aa7e2c None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:02.358736 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088829d-4dea-4b5a-8aed-d6ebe174057c None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:02.424598 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa352c4-e1af-4572-8c68-0d6d446de369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:02.425741 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa352c4-e1af-4572-8c68-0d6d446de369 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:02.426032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa352c4-e1af-4572-8c68-0d6d446de369 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:02.426436 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa352c4-e1af-4572-8c68-0d6d446de369 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:02.480079 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd39548-3c73-4a58-9444-ced275aa7e2c None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:02.526006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa352c4-e1af-4572-8c68-0d6d446de369 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:02.527583 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa352c4-e1af-4572-8c68-0d6d446de369 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:02.561182 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33d781-3a86-4a4e-9385-53c4fdc318f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:02.562812 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33d781-3a86-4a4e-9385-53c4fdc318f0 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:02.563481 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33d781-3a86-4a4e-9385-53c4fdc318f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:02.564485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33d781-3a86-4a4e-9385-53c4fdc318f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:02.571006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:02.578343 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:02.731554 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 47/92] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:25:02.739466 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa352c4-e1af-4572-8c68-0d6d446de369 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:02.752952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33d781-3a86-4a4e-9385-53c4fdc318f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:02.754549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33d781-3a86-4a4e-9385-53c4fdc318f0 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:02.930536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa352c4-e1af-4572-8c68-0d6d446de369 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:02.973977 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 46/93] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:25:02.980364 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33d781-3a86-4a4e-9385-53c4fdc318f0 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:03.005053 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b99505-74a0-451b-b25a-9b5307e81ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:03.005703 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b99505-74a0-451b-b25a-9b5307e81ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:03.005983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b99505-74a0-451b-b25a-9b5307e81ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:03.006253 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b99505-74a0-451b-b25a-9b5307e81ae5 None admin] PATH_INFO: `/v3/projects/9e54ec3d9806409e8a45d9a82823741d` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:03.007648 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b99505-74a0-451b-b25a-9b5307e81ae5 None admin] RBAC: Authorizing `identity:get_project(project_id=9e54ec3d9806409e8a45d9a82823741d)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:03.009426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b99505-74a0-451b-b25a-9b5307e81ae5 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:03.013829 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 48/94] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:02 2022] GET /identity/v3/projects/9e54ec3d9806409e8a45d9a82823741d => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:03.019221 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b99505-74a0-451b-b25a-9b5307e81ae5 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:03.030201 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:03.041545 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:03.217345 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33d781-3a86-4a4e-9385-53c4fdc318f0 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:03.248979 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b99505-74a0-451b-b25a-9b5307e81ae5 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:03.297822 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7931f42-d2b4-44d9-847f-0ed38f8ff44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:03.298906 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7931f42-d2b4-44d9-847f-0ed38f8ff44d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:03.299241 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7931f42-d2b4-44d9-847f-0ed38f8ff44d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:03.299518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7931f42-d2b4-44d9-847f-0ed38f8ff44d None admin] PATH_INFO: `/v3/projects/f72b9aa6a8e94b449ed37c3ac44bcb6e` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:03.302809 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7931f42-d2b4-44d9-847f-0ed38f8ff44d None admin] RBAC: Authorizing `identity:get_project(project_id=f72b9aa6a8e94b449ed37c3ac44bcb6e)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:03.305355 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7931f42-d2b4-44d9-847f-0ed38f8ff44d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:03.307099 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 47/95] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:02 2022] GET /identity/v3/projects/f72b9aa6a8e94b449ed37c3ac44bcb6e => generated 312 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:03.317608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7931f42-d2b4-44d9-847f-0ed38f8ff44d None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:03.336662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c338b-8e4b-4262-a9a5-b521d208507c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:03.337500 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c338b-8e4b-4262-a9a5-b521d208507c None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:03.337801 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c338b-8e4b-4262-a9a5-b521d208507c None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:03.338079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c338b-8e4b-4262-a9a5-b521d208507c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:03.338897 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c338b-8e4b-4262-a9a5-b521d208507c None admin] RBAC: Adding query filter params (role.id=ecbc0b9f55214a93a2016b3625d94764, scope.project.id=9e54ec3d9806409e8a45d9a82823741d, user.id=11f0143c2b4e42a4ab57c2570a1d80e8) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:03.339205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c338b-8e4b-4262-a9a5-b521d208507c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:03.343206 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c338b-8e4b-4262-a9a5-b521d208507c None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:03.352701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 49/96] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:25:03 2022] GET /identity/v3/role_assignments?user.id=11f0143c2b4e42a4ab57c2570a1d80e8&scope.project.id=9e54ec3d9806409e8a45d9a82823741d&role.id=ecbc0b9f55214a93a2016b3625d94764 => generated 259 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:03.496636 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:03.502881 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7931f42-d2b4-44d9-847f-0ed38f8ff44d None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:03.549566 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860bc08-0796-4383-931d-7ac53f918ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:03.550817 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860bc08-0796-4383-931d-7ac53f918ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:03.551309 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860bc08-0796-4383-931d-7ac53f918ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:03.551801 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860bc08-0796-4383-931d-7ac53f918ec7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:03.552888 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860bc08-0796-4383-931d-7ac53f918ec7 None admin] RBAC: Adding query filter params (role.id=29d2c7708bea4287a21112bb7ffa72df, scope.project.id=f72b9aa6a8e94b449ed37c3ac44bcb6e, user.id=11f0143c2b4e42a4ab57c2570a1d80e8) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:03.553416 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860bc08-0796-4383-931d-7ac53f918ec7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:03.555264 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860bc08-0796-4383-931d-7ac53f918ec7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:03.562681 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 48/97] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:25:03 2022] GET /identity/v3/role_assignments?user.id=11f0143c2b4e42a4ab57c2570a1d80e8&scope.project.id=f72b9aa6a8e94b449ed37c3ac44bcb6e&role.id=29d2c7708bea4287a21112bb7ffa72df => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:05.049294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70047256-94ef-477d-8706-ad5ab9ecd8eb None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:05.049929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70047256-94ef-477d-8706-ad5ab9ecd8eb None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:05.049929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70047256-94ef-477d-8706-ad5ab9ecd8eb None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:05.051233 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 50/98] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:05.077341 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb12b3-0f55-4b8e-9f44-6194005ca23b None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:05.077341 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb12b3-0f55-4b8e-9f44-6194005ca23b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:05.077341 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb12b3-0f55-4b8e-9f44-6194005ca23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:05.120648 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-4fcb12b3-0f55-4b8e-9f44-6194005ca23b None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:05.122194 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4fcb12b3-0f55-4b8e-9f44-6194005ca23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:05.372324 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 49/99] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:05.414516 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962baff-f1c2-498a-96c4-12647508c417 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:05.414516 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962baff-f1c2-498a-96c4-12647508c417 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:05.414516 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962baff-f1c2-498a-96c4-12647508c417 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:05.415127 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 51/100] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:25:05.427074 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457c6c0-22b9-43f5-baa5-ad3d44b0ae65 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:05.427551 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457c6c0-22b9-43f5-baa5-ad3d44b0ae65 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:05.428019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457c6c0-22b9-43f5-baa5-ad3d44b0ae65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:05.490313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-c457c6c0-22b9-43f5-baa5-ad3d44b0ae65 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:05.492955 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c457c6c0-22b9-43f5-baa5-ad3d44b0ae65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:05.547018 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead89e1-ebfe-469e-8ec9-657a3f4f0496 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:05.547631 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead89e1-ebfe-469e-8ec9-657a3f4f0496 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:05.548147 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead89e1-ebfe-469e-8ec9-657a3f4f0496 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:05.550344 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 52/101] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:25:05.557902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0d372-3b41-45ff-8e81-a311aa545110 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:05.558459 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0d372-3b41-45ff-8e81-a311aa545110 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:05.558931 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0d372-3b41-45ff-8e81-a311aa545110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:05.590238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-a5a0d372-3b41-45ff-8e81-a311aa545110 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:05.592143 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a5a0d372-3b41-45ff-8e81-a311aa545110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:05.623542 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 50/102] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:25:05.703715 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:05.716490 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 53/103] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:25:05.893459 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c19edb-e555-404e-adc3-bf44806580d3 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:05.893829 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c19edb-e555-404e-adc3-bf44806580d3 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:05.894022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c19edb-e555-404e-adc3-bf44806580d3 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:05.895393 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 51/104] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:25:05.901354 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94d841-7e01-4114-98b1-96f65146a024 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:05.901907 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94d841-7e01-4114-98b1-96f65146a024 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:05.902389 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94d841-7e01-4114-98b1-96f65146a024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:05.925545 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-7d94d841-7e01-4114-98b1-96f65146a024 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:05.927746 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-7d94d841-7e01-4114-98b1-96f65146a024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:05.933585 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c19edb-e555-404e-adc3-bf44806580d3 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:05.978285 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:06.132566 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 54/105] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:06.134335 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94d841-7e01-4114-98b1-96f65146a024 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:06.170629 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c19edb-e555-404e-adc3-bf44806580d3 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:06.268399 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc469ec-fc4a-47fc-993e-ea872d1c418f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:06.269665 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc469ec-fc4a-47fc-993e-ea872d1c418f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:06.272713 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc469ec-fc4a-47fc-993e-ea872d1c418f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:06.273842 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc469ec-fc4a-47fc-993e-ea872d1c418f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:06.302467 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc469ec-fc4a-47fc-993e-ea872d1c418f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:06.312808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-6fc469ec-fc4a-47fc-993e-ea872d1c418f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:06.312808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:06.312808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:06.312808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:06.312808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:06.312808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:06.312808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:06.312808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:06.312808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:06.312808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:06.312808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:06.312808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:06.312808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:06.312808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:06.312808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:06.312808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:06.314527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:06.314527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:06.314527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:06.314527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:06.314527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:06.314527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:06.314527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:06.314527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:06.314527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:06.314527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:06.314527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:06.314527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:06.314527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:06.314527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:06.314527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:06.314527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:06.315999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:06.315999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:06.315999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:06.315999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:06.315999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:06.315999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:06.315999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:06.315999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:06.315999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:06.315999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:06.315999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:06.315999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:25:06.320948 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 52/106] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:06.321864 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc469ec-fc4a-47fc-993e-ea872d1c418f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:06.369774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94d841-7e01-4114-98b1-96f65146a024 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:06.407586 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:06.413032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e583ed-3256-4468-877e-b058a0212ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:06.413704 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e583ed-3256-4468-877e-b058a0212ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:06.414963 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e583ed-3256-4468-877e-b058a0212ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:06.415308 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e583ed-3256-4468-877e-b058a0212ba4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:06.427003 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e583ed-3256-4468-877e-b058a0212ba4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:06.432310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-c5e583ed-3256-4468-877e-b058a0212ba4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:25:06.432310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:06.432310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:06.432310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:06.432310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:06.432310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:06.432310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:06.432310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:06.432310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:06.432310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:06.432310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:06.432310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:06.432310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:06.432310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:06.432310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:06.432310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:06.433995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:06.433995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:06.433995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:06.433995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:06.433995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:06.433995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:06.433995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:06.433995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:06.433995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:06.433995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:06.433995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:06.433995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:06.433995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:06.433995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:06.433995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:06.433995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:06.435551 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:06.435551 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:06.435551 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:06.435551 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:06.435551 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:06.435551 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:06.435551 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:06.435551 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:06.435551 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:06.435551 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:06.435551 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:25:06.435551 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:06.435551 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 55/107] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:06.435551 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e583ed-3256-4468-877e-b058a0212ba4 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:06.557398 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:06.587030 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc469ec-fc4a-47fc-993e-ea872d1c418f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:06.608306 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e583ed-3256-4468-877e-b058a0212ba4 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:06.643682 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc216706-aa5e-41e3-b03d-7f505f6a55f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:06.644369 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc216706-aa5e-41e3-b03d-7f505f6a55f9 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:06.644768 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc216706-aa5e-41e3-b03d-7f505f6a55f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:06.645116 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc216706-aa5e-41e3-b03d-7f505f6a55f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:06.646273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc216706-aa5e-41e3-b03d-7f505f6a55f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:06.649447 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc216706-aa5e-41e3-b03d-7f505f6a55f9 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:06.651578 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 53/108] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:25:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:06.652548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc216706-aa5e-41e3-b03d-7f505f6a55f9 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:06.681765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a054a-bc8b-44a4-aed3-ff90f43cc1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:06.683256 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a054a-bc8b-44a4-aed3-ff90f43cc1d4 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:06.684005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a054a-bc8b-44a4-aed3-ff90f43cc1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:06.684948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a054a-bc8b-44a4-aed3-ff90f43cc1d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:06.686882 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a054a-bc8b-44a4-aed3-ff90f43cc1d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:06.687591 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a054a-bc8b-44a4-aed3-ff90f43cc1d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:06.690848 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a054a-bc8b-44a4-aed3-ff90f43cc1d4 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:06.704402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 56/109] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:06.705447 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a054a-bc8b-44a4-aed3-ff90f43cc1d4 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:06.772522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:06.815998 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc216706-aa5e-41e3-b03d-7f505f6a55f9 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:06.841057 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a054a-bc8b-44a4-aed3-ff90f43cc1d4 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:06.860547 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a415f5-4a81-4b1e-ac40-15d8e07d28e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:06.862025 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a415f5-4a81-4b1e-ac40-15d8e07d28e7 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:06.862800 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a415f5-4a81-4b1e-ac40-15d8e07d28e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:06.863628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a415f5-4a81-4b1e-ac40-15d8e07d28e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:06.865266 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a415f5-4a81-4b1e-ac40-15d8e07d28e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:06.866080 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a415f5-4a81-4b1e-ac40-15d8e07d28e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:06.868491 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a415f5-4a81-4b1e-ac40-15d8e07d28e7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:06.880032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea43698-45a2-4682-b9c7-dab9233b20f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:06.880744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea43698-45a2-4682-b9c7-dab9233b20f1 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:06.881066 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea43698-45a2-4682-b9c7-dab9233b20f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:06.881331 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea43698-45a2-4682-b9c7-dab9233b20f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:06.887143 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 54/110] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:06.887143 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd93056-c221-496c-a4a6-40d01685e28e None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:06.887143 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd93056-c221-496c-a4a6-40d01685e28e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:06.887143 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd93056-c221-496c-a4a6-40d01685e28e None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:06.888611 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 55/111] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:06.889513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd93056-c221-496c-a4a6-40d01685e28e None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:06.904061 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea43698-45a2-4682-b9c7-dab9233b20f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:06.910426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-3ea43698-45a2-4682-b9c7-dab9233b20f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:25:06.910426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:06.910426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:06.910426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:06.910426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:06.910426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:06.910426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:06.910426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:06.910426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:06.910426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:06.910426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:06.910426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:06.910426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:06.910426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:06.910426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:06.910426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:06.911348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:06.911348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:06.911348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:06.911348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:06.911348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:06.911348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:06.911348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:06.911348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:06.911348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:06.911348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:06.911348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:06.911348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:06.911348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:06.911348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:06.911348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:06.911348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:06.912106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:06.912106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:06.912106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:06.912106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:06.912106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:06.912106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:06.912106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:06.912106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:06.912106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:06.912106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:06.912106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:25:06.912106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:06.912106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 57/112] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:25:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:06.913394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea43698-45a2-4682-b9c7-dab9233b20f1 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:06.918914 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:07.053854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd93056-c221-496c-a4a6-40d01685e28e None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:07.055898 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea43698-45a2-4682-b9c7-dab9233b20f1 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:07.070777 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:07.105289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e1fcf-0367-48d7-a170-e3c14d458a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:07.106462 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e1fcf-0367-48d7-a170-e3c14d458a9d None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:07.106982 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e1fcf-0367-48d7-a170-e3c14d458a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:07.107542 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e1fcf-0367-48d7-a170-e3c14d458a9d None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:07.108428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e1fcf-0367-48d7-a170-e3c14d458a9d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:07.108927 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73037061-95a8-4179-8a9e-934978477cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:07.109525 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73037061-95a8-4179-8a9e-934978477cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:07.109810 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73037061-95a8-4179-8a9e-934978477cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:07.109918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e1fcf-0367-48d7-a170-e3c14d458a9d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:07.110086 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73037061-95a8-4179-8a9e-934978477cf7 None admin] PATH_INFO: `/v3/users/11f0143c2b4e42a4ab57c2570a1d80e8` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:07.111279 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73037061-95a8-4179-8a9e-934978477cf7 None admin] RBAC: Authorizing `identity:get_user(user_id=11f0143c2b4e42a4ab57c2570a1d80e8)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:07.112943 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73037061-95a8-4179-8a9e-934978477cf7 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:07.120010 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 58/113] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:06 2022] GET /identity/v3/users/11f0143c2b4e42a4ab57c2570a1d80e8 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:07.120620 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73037061-95a8-4179-8a9e-934978477cf7 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:07.143971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 56/114] 10.222.0.69 () {60 vars in 1141 bytes} [Mon Aug 29 21:25:06 2022] POST /identity/v3/projects => generated 302 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:25:07.145919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087319b-3ebc-409c-bf1e-d91dc5e5a782 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:07.146363 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087319b-3ebc-409c-bf1e-d91dc5e5a782 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:07.146536 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087319b-3ebc-409c-bf1e-d91dc5e5a782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:07.184984 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-a087319b-3ebc-409c-bf1e-d91dc5e5a782 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:07.188290 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a087319b-3ebc-409c-bf1e-d91dc5e5a782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:07.282594 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:07.282844 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73037061-95a8-4179-8a9e-934978477cf7 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:07.299568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 57/115] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:07.302188 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087319b-3ebc-409c-bf1e-d91dc5e5a782 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:07.336478 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba86c32-17f4-43f5-a27d-2646090aaf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:07.337684 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba86c32-17f4-43f5-a27d-2646090aaf55 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:07.338147 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba86c32-17f4-43f5-a27d-2646090aaf55 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:07.338781 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba86c32-17f4-43f5-a27d-2646090aaf55 None admin] PATH_INFO: `/v3/users/3d943c88108f44ac8f3c3038063855ab` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:07.358641 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba86c32-17f4-43f5-a27d-2646090aaf55 None admin] RBAC: Authorizing `identity:get_user(user_id=3d943c88108f44ac8f3c3038063855ab)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:07.360316 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba86c32-17f4-43f5-a27d-2646090aaf55 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:07.362086 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 59/116] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:07 2022] GET /identity/v3/users/3d943c88108f44ac8f3c3038063855ab => generated 289 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:07.368403 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba86c32-17f4-43f5-a27d-2646090aaf55 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:07.412360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:07.462711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087319b-3ebc-409c-bf1e-d91dc5e5a782 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:07.513531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba86c32-17f4-43f5-a27d-2646090aaf55 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:07.522107 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e628c-96d0-44f0-820c-7ba812a6de80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:07.522974 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e628c-96d0-44f0-820c-7ba812a6de80 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:07.523433 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e628c-96d0-44f0-820c-7ba812a6de80 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:07.523898 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e628c-96d0-44f0-820c-7ba812a6de80 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:07.524933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e628c-96d0-44f0-820c-7ba812a6de80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:07.525301 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e628c-96d0-44f0-820c-7ba812a6de80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:07.526960 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e628c-96d0-44f0-820c-7ba812a6de80 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:07.537669 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 58/117] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:07.538234 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e628c-96d0-44f0-820c-7ba812a6de80 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:07.563001 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65424c-8de4-46a0-a5b4-11ade8ea236f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:07.563664 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65424c-8de4-46a0-a5b4-11ade8ea236f None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:07.563951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65424c-8de4-46a0-a5b4-11ade8ea236f None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:07.564401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65424c-8de4-46a0-a5b4-11ade8ea236f None admin] PATH_INFO: `/v3/projects/9e54ec3d9806409e8a45d9a82823741d` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:07.566284 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65424c-8de4-46a0-a5b4-11ade8ea236f None admin] RBAC: Authorizing `identity:get_project(project_id=9e54ec3d9806409e8a45d9a82823741d)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:07.567795 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65424c-8de4-46a0-a5b4-11ade8ea236f None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:07.570110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 60/118] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:07 2022] GET /identity/v3/projects/9e54ec3d9806409e8a45d9a82823741d => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:07.571410 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c83804-e18d-42a8-b7da-0057e164ea4b None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:07.571675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c83804-e18d-42a8-b7da-0057e164ea4b None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:07.571955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c83804-e18d-42a8-b7da-0057e164ea4b None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:07.573500 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 61/119] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:07.574057 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c83804-e18d-42a8-b7da-0057e164ea4b None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:07.615019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:07.677656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e628c-96d0-44f0-820c-7ba812a6de80 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:07.715425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c83804-e18d-42a8-b7da-0057e164ea4b None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:07.719780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:07.735823 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6c507-132c-4158-b16d-26e0f6d64a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:07.736832 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6c507-132c-4158-b16d-26e0f6d64a1c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:07.737360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6c507-132c-4158-b16d-26e0f6d64a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:07.737878 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6c507-132c-4158-b16d-26e0f6d64a1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:07.767888 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e8a17-6d55-4af2-9f43-e2ad6b0dc4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:07.769396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e8a17-6d55-4af2-9f43-e2ad6b0dc4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:07.769893 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e8a17-6d55-4af2-9f43-e2ad6b0dc4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:07.770404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e8a17-6d55-4af2-9f43-e2ad6b0dc4a9 None admin] PATH_INFO: `/v3/users/3e753cc042b14c47bd5d1c6394848500` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:07.771922 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e8a17-6d55-4af2-9f43-e2ad6b0dc4a9 None admin] RBAC: Authorizing `identity:get_user(user_id=3e753cc042b14c47bd5d1c6394848500)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:07.774669 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e8a17-6d55-4af2-9f43-e2ad6b0dc4a9 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:07.776918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 62/120] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:07 2022] GET /identity/v3/users/3e753cc042b14c47bd5d1c6394848500 => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:07.777961 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e8a17-6d55-4af2-9f43-e2ad6b0dc4a9 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:07.860098 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6c507-132c-4158-b16d-26e0f6d64a1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:07.861752 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6c507-132c-4158-b16d-26e0f6d64a1c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:07.923291 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e8a17-6d55-4af2-9f43-e2ad6b0dc4a9 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:07.939616 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:07.967524 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73e3e1-5aff-476b-9f27-e853b222a061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:07.968233 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73e3e1-5aff-476b-9f27-e853b222a061 None admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:07.968527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73e3e1-5aff-476b-9f27-e853b222a061 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:07.968812 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73e3e1-5aff-476b-9f27-e853b222a061 None admin] PATH_INFO: `/v3/projects/9e54ec3d9806409e8a45d9a82823741d/users/11f0143c2b4e42a4ab57c2570a1d80e8/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:07.970983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73e3e1-5aff-476b-9f27-e853b222a061 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e54ec3d9806409e8a45d9a82823741d, user_id=11f0143c2b4e42a4ab57c2570a1d80e8, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:07.972614 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73e3e1-5aff-476b-9f27-e853b222a061 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:07.999342 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 63/121] 10.222.0.69 () {58 vars in 1439 bytes} [Mon Aug 29 21:25:07 2022] PUT /identity/v3/projects/9e54ec3d9806409e8a45d9a82823741d/users/11f0143c2b4e42a4ab57c2570a1d80e8/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:25:07.999342 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba1a8a-28bf-4dc7-b7b4-c40d91f92428 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:07.999342 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba1a8a-28bf-4dc7-b7b4-c40d91f92428 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:07.999342 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba1a8a-28bf-4dc7-b7b4-c40d91f92428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:08.007281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 59/122] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:25:08.013381 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6c507-132c-4158-b16d-26e0f6d64a1c None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:08.019380 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-92ba1a8a-28bf-4dc7-b7b4-c40d91f92428 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:08.020861 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-92ba1a8a-28bf-4dc7-b7b4-c40d91f92428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:08.056683 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:08.128560 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 64/123] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:08.129695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba1a8a-28bf-4dc7-b7b4-c40d91f92428 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:08.159734 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6c507-132c-4158-b16d-26e0f6d64a1c None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:08.227439 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f42a58-0e52-421a-8e3d-297f7f91a3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:08.229204 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f42a58-0e52-421a-8e3d-297f7f91a3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:08.230865 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f42a58-0e52-421a-8e3d-297f7f91a3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:08.231363 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f42a58-0e52-421a-8e3d-297f7f91a3a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:08.252373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f42a58-0e52-421a-8e3d-297f7f91a3a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:08.258854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-13f42a58-0e52-421a-8e3d-297f7f91a3a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:25:08.258854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:08.258854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:08.258854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:08.258854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:08.258854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:08.258854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:08.258854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:08.258854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:08.258854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:08.258854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:08.258854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:08.258854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:08.258854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:08.258854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:08.258854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:08.259760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:08.259760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:08.259760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:08.259760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:08.259760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:08.259760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:08.259760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:08.259760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:08.259760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:08.259760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:08.259760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:08.259760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:08.259760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:08.259760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:08.259760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:08.259760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:08.260546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:08.260546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:08.260546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:08.260546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:08.260546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:08.260546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:08.260546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:08.260546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:08.260546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:08.260546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:08.260546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:25:08.260546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:25:08.260546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 60/124] 10.222.0.69 () {56 vars in 1114 bytes} [Mon Aug 29 21:25:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:08.262844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f42a58-0e52-421a-8e3d-297f7f91a3a0 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:08.316783 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:08.388058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba1a8a-28bf-4dc7-b7b4-c40d91f92428 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:08.462749 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f42a58-0e52-421a-8e3d-297f7f91a3a0 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:08.480155 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4da65-4af4-49e1-8ee3-f21a2eacdbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:08.480994 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4da65-4af4-49e1-8ee3-f21a2eacdbfe None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:08.481276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4da65-4af4-49e1-8ee3-f21a2eacdbfe None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:08.481552 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4da65-4af4-49e1-8ee3-f21a2eacdbfe None admin] PATH_INFO: `/v3/projects/9e54ec3d9806409e8a45d9a82823741d` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:08.482855 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4da65-4af4-49e1-8ee3-f21a2eacdbfe None admin] RBAC: Authorizing `identity:get_project(project_id=9e54ec3d9806409e8a45d9a82823741d)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:08.484681 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4da65-4af4-49e1-8ee3-f21a2eacdbfe None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:08.486685 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 65/125] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:08 2022] GET /identity/v3/projects/9e54ec3d9806409e8a45d9a82823741d => generated 298 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:08.487462 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4da65-4af4-49e1-8ee3-f21a2eacdbfe None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:08.524633 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:08.532235 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7a2c5-caba-4b43-bc56-cc937905f318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:08.533089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7a2c5-caba-4b43-bc56-cc937905f318 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:08.533469 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7a2c5-caba-4b43-bc56-cc937905f318 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:08.533821 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7a2c5-caba-4b43-bc56-cc937905f318 None admin] PATH_INFO: `/v3/projects/9e54ec3d9806409e8a45d9a82823741d` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:08.535615 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7a2c5-caba-4b43-bc56-cc937905f318 None admin] RBAC: Authorizing `identity:get_project(project_id=9e54ec3d9806409e8a45d9a82823741d)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:08.537216 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7a2c5-caba-4b43-bc56-cc937905f318 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:08.539129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 61/126] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:08 2022] GET /identity/v3/projects/9e54ec3d9806409e8a45d9a82823741d => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:08.539922 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7a2c5-caba-4b43-bc56-cc937905f318 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:08.612627 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4da65-4af4-49e1-8ee3-f21a2eacdbfe None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:08.651435 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01fc24-c267-42ac-a069-507baeaed97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:08.652197 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01fc24-c267-42ac-a069-507baeaed97d None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:08.652566 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01fc24-c267-42ac-a069-507baeaed97d None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:08.652929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01fc24-c267-42ac-a069-507baeaed97d None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:08.653309 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:08.653660 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01fc24-c267-42ac-a069-507baeaed97d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:08.653967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01fc24-c267-42ac-a069-507baeaed97d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:08.655599 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01fc24-c267-42ac-a069-507baeaed97d None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:08.667131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 66/127] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:25:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:08.668289 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01fc24-c267-42ac-a069-507baeaed97d None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:08.673194 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7a2c5-caba-4b43-bc56-cc937905f318 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:08.717453 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd019df-e2a3-4fe3-8e3b-d40249577020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:08.718317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd019df-e2a3-4fe3-8e3b-d40249577020 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:08.718775 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd019df-e2a3-4fe3-8e3b-d40249577020 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:08.719370 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd019df-e2a3-4fe3-8e3b-d40249577020 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:08.733888 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd019df-e2a3-4fe3-8e3b-d40249577020 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:08.739952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-ccd019df-e2a3-4fe3-8e3b-d40249577020 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:08.739952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:08.739952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:08.739952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:08.739952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:08.739952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:08.739952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:08.739952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:08.739952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:08.739952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:08.739952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:08.739952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:08.739952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:08.739952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:08.739952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:08.739952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:08.740918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:08.740918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:08.740918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:08.740918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:08.740918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:08.740918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:08.740918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:08.740918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:08.740918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:08.740918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:08.740918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:08.740918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:08.740918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:08.740918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:08.740918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:08.740918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:08.741872 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:08.741872 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:08.741872 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:08.741872 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:08.741872 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:08.741872 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:08.741872 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:08.741872 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:08.741872 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:08.741872 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:08.741872 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:08.741872 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:25:08.741872 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 62/128] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:08.743133 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd019df-e2a3-4fe3-8e3b-d40249577020 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:08.777256 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:08.787662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01fc24-c267-42ac-a069-507baeaed97d None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:08.827750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8a724-66c2-43f4-a6a7-46a6adec5793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:08.828462 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8a724-66c2-43f4-a6a7-46a6adec5793 None admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:08.829108 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8a724-66c2-43f4-a6a7-46a6adec5793 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:08.829108 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8a724-66c2-43f4-a6a7-46a6adec5793 None admin] PATH_INFO: `/v3/projects/9e54ec3d9806409e8a45d9a82823741d/users/3e753cc042b14c47bd5d1c6394848500/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:08.831525 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8a724-66c2-43f4-a6a7-46a6adec5793 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e54ec3d9806409e8a45d9a82823741d, user_id=3e753cc042b14c47bd5d1c6394848500, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:08.833416 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8a724-66c2-43f4-a6a7-46a6adec5793 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:08.859715 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 67/129] 10.222.0.69 () {58 vars in 1439 bytes} [Mon Aug 29 21:25:08 2022] PUT /identity/v3/projects/9e54ec3d9806409e8a45d9a82823741d/users/3e753cc042b14c47bd5d1c6394848500/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:25:08.864392 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8a724-66c2-43f4-a6a7-46a6adec5793 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:08.966773 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd019df-e2a3-4fe3-8e3b-d40249577020 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:09.019238 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e613f-9ffb-415b-a73f-60f44c2f7b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:09.019768 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e613f-9ffb-415b-a73f-60f44c2f7b4f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:09.020054 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e613f-9ffb-415b-a73f-60f44c2f7b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:09.020364 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e613f-9ffb-415b-a73f-60f44c2f7b4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:09.021121 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e613f-9ffb-415b-a73f-60f44c2f7b4f None admin] RBAC: Adding query filter params (role.id=1047d24970f744c38f38ecc563f0f61d, scope.project.id=9e54ec3d9806409e8a45d9a82823741d, user.id=3d943c88108f44ac8f3c3038063855ab) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:09.021438 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e613f-9ffb-415b-a73f-60f44c2f7b4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:09.022961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e613f-9ffb-415b-a73f-60f44c2f7b4f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:09.029591 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 63/130] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:25:08 2022] GET /identity/v3/role_assignments?user.id=3d943c88108f44ac8f3c3038063855ab&scope.project.id=9e54ec3d9806409e8a45d9a82823741d&role.id=1047d24970f744c38f38ecc563f0f61d => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:09.030281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e613f-9ffb-415b-a73f-60f44c2f7b4f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:09.043347 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:09.059596 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8a724-66c2-43f4-a6a7-46a6adec5793 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:09.147425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629ebd7-7490-4bed-a389-e97d231d12ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:09.148729 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629ebd7-7490-4bed-a389-e97d231d12ac None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:09.149191 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629ebd7-7490-4bed-a389-e97d231d12ac None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:09.149488 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629ebd7-7490-4bed-a389-e97d231d12ac None admin] PATH_INFO: `/v3/users/11f0143c2b4e42a4ab57c2570a1d80e8` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:09.150858 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629ebd7-7490-4bed-a389-e97d231d12ac None admin] RBAC: Authorizing `identity:get_user(user_id=11f0143c2b4e42a4ab57c2570a1d80e8)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:09.152514 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629ebd7-7490-4bed-a389-e97d231d12ac None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:09.154502 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 68/131] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:08 2022] GET /identity/v3/users/11f0143c2b4e42a4ab57c2570a1d80e8 => generated 275 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:09.156769 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e613f-9ffb-415b-a73f-60f44c2f7b4f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:09.161124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629ebd7-7490-4bed-a389-e97d231d12ac None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:09.214721 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce7962-b385-4716-84e2-13e0761de1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:09.215977 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce7962-b385-4716-84e2-13e0761de1db None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:09.216617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:09.216893 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce7962-b385-4716-84e2-13e0761de1db None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:09.217711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce7962-b385-4716-84e2-13e0761de1db None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:09.219272 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce7962-b385-4716-84e2-13e0761de1db None admin] RBAC: Adding query filter params (name=member) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:09.220098 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce7962-b385-4716-84e2-13e0761de1db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:09.227896 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce7962-b385-4716-84e2-13e0761de1db None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:09.243218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 64/132] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:09.250712 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce7962-b385-4716-84e2-13e0761de1db None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:09.344710 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:09.412173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce7962-b385-4716-84e2-13e0761de1db None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:09.456899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428551a-eae3-46ea-a938-3b3109810e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:09.457703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428551a-eae3-46ea-a938-3b3109810e85 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:09.458007 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428551a-eae3-46ea-a938-3b3109810e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:09.458388 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428551a-eae3-46ea-a938-3b3109810e85 None admin] PATH_INFO: `/v3/users/11f0143c2b4e42a4ab57c2570a1d80e8` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:09.459615 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428551a-eae3-46ea-a938-3b3109810e85 None admin] RBAC: Authorizing `identity:get_user(user_id=11f0143c2b4e42a4ab57c2570a1d80e8)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:09.461983 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428551a-eae3-46ea-a938-3b3109810e85 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:09.463979 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 65/133] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:09 2022] GET /identity/v3/users/11f0143c2b4e42a4ab57c2570a1d80e8 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:09.469488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428551a-eae3-46ea-a938-3b3109810e85 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:09.471696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629ebd7-7490-4bed-a389-e97d231d12ac None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:09.581992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e851a-8044-4ce8-bec6-4f4700a38e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:09.582658 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e851a-8044-4ce8-bec6-4f4700a38e57 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:09.582942 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e851a-8044-4ce8-bec6-4f4700a38e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:09.583219 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e851a-8044-4ce8-bec6-4f4700a38e57 None admin] PATH_INFO: `/v3/projects/9e54ec3d9806409e8a45d9a82823741d` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:09.588986 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e851a-8044-4ce8-bec6-4f4700a38e57 None admin] RBAC: Authorizing `identity:get_project(project_id=9e54ec3d9806409e8a45d9a82823741d)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:09.589320 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428551a-eae3-46ea-a938-3b3109810e85 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:09.590468 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e851a-8044-4ce8-bec6-4f4700a38e57 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:09.592482 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 69/134] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:09 2022] GET /identity/v3/projects/9e54ec3d9806409e8a45d9a82823741d => generated 298 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:09.598638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e851a-8044-4ce8-bec6-4f4700a38e57 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:09.638977 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73514d2-c782-4cc1-92a8-b926435c8fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:09.639845 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73514d2-c782-4cc1-92a8-b926435c8fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:09.640307 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73514d2-c782-4cc1-92a8-b926435c8fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:09.640776 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73514d2-c782-4cc1-92a8-b926435c8fe0 None admin] PATH_INFO: `/v3/projects/f72b9aa6a8e94b449ed37c3ac44bcb6e` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:09.642607 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73514d2-c782-4cc1-92a8-b926435c8fe0 None admin] RBAC: Authorizing `identity:get_project(project_id=f72b9aa6a8e94b449ed37c3ac44bcb6e)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:09.644719 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73514d2-c782-4cc1-92a8-b926435c8fe0 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:09.647453 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 66/135] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:09 2022] GET /identity/v3/projects/f72b9aa6a8e94b449ed37c3ac44bcb6e => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:09.656651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73514d2-c782-4cc1-92a8-b926435c8fe0 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:09.671864 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:09.821014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73514d2-c782-4cc1-92a8-b926435c8fe0 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:09.870070 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83528779-61f9-4fa2-b20a-8c2b08008eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:09.870685 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83528779-61f9-4fa2-b20a-8c2b08008eca None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:09.870978 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83528779-61f9-4fa2-b20a-8c2b08008eca None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:09.871262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83528779-61f9-4fa2-b20a-8c2b08008eca None admin] PATH_INFO: `/v3/projects/f72b9aa6a8e94b449ed37c3ac44bcb6e/users/11f0143c2b4e42a4ab57c2570a1d80e8/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:09.873458 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83528779-61f9-4fa2-b20a-8c2b08008eca None admin] RBAC: Authorizing `identity:create_grant(project_id=f72b9aa6a8e94b449ed37c3ac44bcb6e, user_id=11f0143c2b4e42a4ab57c2570a1d80e8, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:09.874966 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83528779-61f9-4fa2-b20a-8c2b08008eca None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:09.902613 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 67/136] 10.222.0.69 () {58 vars in 1439 bytes} [Mon Aug 29 21:25:09 2022] PUT /identity/v3/projects/f72b9aa6a8e94b449ed37c3ac44bcb6e/users/11f0143c2b4e42a4ab57c2570a1d80e8/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:25:09.904715 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:09.927293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e851a-8044-4ce8-bec6-4f4700a38e57 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:09.985417 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8adc58-754d-41fb-a944-408ea9c4c06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:09.986122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8adc58-754d-41fb-a944-408ea9c4c06c None admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:09.986410 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8adc58-754d-41fb-a944-408ea9c4c06c None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:09.986693 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8adc58-754d-41fb-a944-408ea9c4c06c None admin] PATH_INFO: `/v3/projects/9e54ec3d9806409e8a45d9a82823741d/users/11f0143c2b4e42a4ab57c2570a1d80e8/roles/ecbc0b9f55214a93a2016b3625d94764` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:09.989957 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8adc58-754d-41fb-a944-408ea9c4c06c None admin] RBAC: Authorizing `identity:create_grant(project_id=9e54ec3d9806409e8a45d9a82823741d, user_id=11f0143c2b4e42a4ab57c2570a1d80e8, role_id=ecbc0b9f55214a93a2016b3625d94764)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:09.991619 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8adc58-754d-41fb-a944-408ea9c4c06c None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:10.018377 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 70/137] 10.222.0.69 () {58 vars in 1439 bytes} [Mon Aug 29 21:25:09 2022] PUT /identity/v3/projects/9e54ec3d9806409e8a45d9a82823741d/users/11f0143c2b4e42a4ab57c2570a1d80e8/roles/ecbc0b9f55214a93a2016b3625d94764 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:25:10.319041 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d7228-3789-4866-9af7-f00f0f10fe49 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:10.319838 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d7228-3789-4866-9af7-f00f0f10fe49 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:10.319838 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d7228-3789-4866-9af7-f00f0f10fe49 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:10.321093 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 68/138] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:10.327540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed12f96-8b71-49c2-921b-a18a6fe73ce5 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:10.327935 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed12f96-8b71-49c2-921b-a18a6fe73ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:10.328208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed12f96-8b71-49c2-921b-a18a6fe73ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:10.356606 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-1ed12f96-8b71-49c2-921b-a18a6fe73ce5 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:10.357850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-1ed12f96-8b71-49c2-921b-a18a6fe73ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:10.455681 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 71/139] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:10.827762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fb365-ee33-4f92-81c6-bc783eeccdf1 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:10.828221 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fb365-ee33-4f92-81c6-bc783eeccdf1 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:10.828681 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fb365-ee33-4f92-81c6-bc783eeccdf1 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:10.831686 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 69/140] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:10.835684 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed12f96-8b71-49c2-921b-a18a6fe73ce5 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:10.838596 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f5f6f-abd0-4a6d-ab26-0d5c42bfb405 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:10.839057 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f5f6f-abd0-4a6d-ab26-0d5c42bfb405 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:10.839520 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f5f6f-abd0-4a6d-ab26-0d5c42bfb405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:10.901014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-9c8f5f6f-abd0-4a6d-ab26-0d5c42bfb405 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:10.903083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9c8f5f6f-abd0-4a6d-ab26-0d5c42bfb405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:11.064571 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:11.081900 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 70/141] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:25:11.096590 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:11.133709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed12f96-8b71-49c2-921b-a18a6fe73ce5 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:11.184667 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd9d70-e5a7-4ad0-a556-6c1ab060848c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:11.185476 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd9d70-e5a7-4ad0-a556-6c1ab060848c None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:11.185760 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd9d70-e5a7-4ad0-a556-6c1ab060848c None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:11.186037 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd9d70-e5a7-4ad0-a556-6c1ab060848c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:11.187214 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd9d70-e5a7-4ad0-a556-6c1ab060848c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:11.188767 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd9d70-e5a7-4ad0-a556-6c1ab060848c None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:11.190767 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 72/142] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:25:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:11.197310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f5f6f-abd0-4a6d-ab26-0d5c42bfb405 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:11.321442 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f5f6f-abd0-4a6d-ab26-0d5c42bfb405 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:11.363473 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf74d88-13a4-466d-9f50-50f309fea2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:11.364078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf74d88-13a4-466d-9f50-50f309fea2f5 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:11.364500 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf74d88-13a4-466d-9f50-50f309fea2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:11.364787 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf74d88-13a4-466d-9f50-50f309fea2f5 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:11.365473 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf74d88-13a4-466d-9f50-50f309fea2f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:11.367061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf74d88-13a4-466d-9f50-50f309fea2f5 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:11.396944 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 71/143] 10.222.0.69 () {60 vars in 1132 bytes} [Mon Aug 29 21:25:11 2022] POST /identity/v3/users => generated 283 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:25:11.898570 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd9d70-e5a7-4ad0-a556-6c1ab060848c None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:11.973719 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f82f3-5dfc-4299-994f-1cb9a8738ce1 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:11.974202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f82f3-5dfc-4299-994f-1cb9a8738ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:11.974631 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f82f3-5dfc-4299-994f-1cb9a8738ce1 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:11.977229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 72/144] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:11.984343 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b694d21-c64e-49d1-bac8-252fe7dbe970 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:11.984824 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b694d21-c64e-49d1-bac8-252fe7dbe970 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:11.985328 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b694d21-c64e-49d1-bac8-252fe7dbe970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:12.033299 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-8b694d21-c64e-49d1-bac8-252fe7dbe970 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:12.034618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-8b694d21-c64e-49d1-bac8-252fe7dbe970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:12.114175 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd9d70-e5a7-4ad0-a556-6c1ab060848c None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:12.144581 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:12.154747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 73/145] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:12.156018 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb5f6d-0d25-4413-92d6-11faca7012b4 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:12.157190 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb5f6d-0d25-4413-92d6-11faca7012b4 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:12.157543 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb5f6d-0d25-4413-92d6-11faca7012b4 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:12.159225 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 74/146] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:12.166378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff93f3-a3d1-429e-8637-ba41d960efb9 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:12.166700 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff93f3-a3d1-429e-8637-ba41d960efb9 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:12.166930 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff93f3-a3d1-429e-8637-ba41d960efb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:12.184610 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac69a60-2366-44ae-9d99-654734132d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:12.185393 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac69a60-2366-44ae-9d99-654734132d80 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:12.185730 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac69a60-2366-44ae-9d99-654734132d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:12.186054 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac69a60-2366-44ae-9d99-654734132d80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:12.191881 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d5ff93f3-a3d1-429e-8637-ba41d960efb9 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:12.193186 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d5ff93f3-a3d1-429e-8637-ba41d960efb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:12.200840 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac69a60-2366-44ae-9d99-654734132d80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:12.214791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-0ac69a60-2366-44ae-9d99-654734132d80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:12.214791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:12.214791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:12.214791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:12.214791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:12.214791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:12.214791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:12.214791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:12.214791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:12.214791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:12.214791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:12.214791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:12.214791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:12.214791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:12.214791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:12.214791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:12.216079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:12.216079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:12.216079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:12.216079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:12.216079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:12.216079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:12.216079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:12.216079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:12.216079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:12.216079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:12.216079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:12.216079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:12.216079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:12.216079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:12.216079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:12.216079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:12.217250 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:12.217250 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:12.217250 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:12.217250 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:12.217250 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:12.217250 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:12.217250 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:12.217250 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:12.217250 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:12.217250 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:12.217250 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:12.217250 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:12.220716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 73/147] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:25:12.234173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac69a60-2366-44ae-9d99-654734132d80 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:12.253001 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:12.292422 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 75/148] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:12.425720 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac69a60-2366-44ae-9d99-654734132d80 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:12.476501 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87eb96d-b81a-4cf6-a707-b7acdb8b90ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:12.478035 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87eb96d-b81a-4cf6-a707-b7acdb8b90ca None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:12.478322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87eb96d-b81a-4cf6-a707-b7acdb8b90ca None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:12.478599 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87eb96d-b81a-4cf6-a707-b7acdb8b90ca None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:12.479290 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87eb96d-b81a-4cf6-a707-b7acdb8b90ca None admin] RBAC: Adding query filter params (name=member) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:12.479600 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87eb96d-b81a-4cf6-a707-b7acdb8b90ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:12.481148 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87eb96d-b81a-4cf6-a707-b7acdb8b90ca None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:12.492869 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 74/149] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:12.498925 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff93f3-a3d1-429e-8637-ba41d960efb9 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:12.571386 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87eb96d-b81a-4cf6-a707-b7acdb8b90ca None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:12.642831 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff93f3-a3d1-429e-8637-ba41d960efb9 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:12.684809 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:12.695758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9f408-ec12-4508-8646-1fa7b96e9725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:12.696459 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9f408-ec12-4508-8646-1fa7b96e9725 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:12.696749 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9f408-ec12-4508-8646-1fa7b96e9725 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:12.697060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9f408-ec12-4508-8646-1fa7b96e9725 None admin] PATH_INFO: `/v3/users/11f0143c2b4e42a4ab57c2570a1d80e8` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:12.698291 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9f408-ec12-4508-8646-1fa7b96e9725 None admin] RBAC: Authorizing `identity:get_user(user_id=11f0143c2b4e42a4ab57c2570a1d80e8)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:12.699940 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9f408-ec12-4508-8646-1fa7b96e9725 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:12.701665 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 76/150] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:12 2022] GET /identity/v3/users/11f0143c2b4e42a4ab57c2570a1d80e8 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:12.709951 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9f408-ec12-4508-8646-1fa7b96e9725 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:12.716664 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:12.789193 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87eb96d-b81a-4cf6-a707-b7acdb8b90ca None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:12.841002 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81316f-76f1-4a59-984a-a1cf78b4dee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:12.841661 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81316f-76f1-4a59-984a-a1cf78b4dee2 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:12.841951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81316f-76f1-4a59-984a-a1cf78b4dee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:12.842223 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81316f-76f1-4a59-984a-a1cf78b4dee2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:12.871294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81316f-76f1-4a59-984a-a1cf78b4dee2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:12.889032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-ed81316f-76f1-4a59-984a-a1cf78b4dee2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:25:12.889032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:12.889032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:12.889032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:12.889032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:12.889032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:12.889032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:12.889032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:12.889032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:12.889032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:12.889032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:12.889032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:12.889032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:12.889032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:12.889032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:12.889032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:12.890185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:12.890185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:12.890185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:12.890185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:12.890185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:12.890185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:12.890185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:12.890185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:12.890185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:12.890185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:12.890185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:12.890185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:12.890185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:12.890185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:12.890185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:12.890185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:12.890971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:12.890971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:12.890971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:12.890971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:12.890971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:12.890971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:12.890971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:12.890971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:12.890971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:12.890971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:12.890971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:25:12.890971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:12.910169 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 75/151] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:25:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:12.912103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81316f-76f1-4a59-984a-a1cf78b4dee2 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:13.004568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9f408-ec12-4508-8646-1fa7b96e9725 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:13.127358 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295ce27-6baa-4fb8-a7f9-2799befb8d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:13.128496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295ce27-6baa-4fb8-a7f9-2799befb8d58 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:13.128787 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295ce27-6baa-4fb8-a7f9-2799befb8d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:13.129067 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295ce27-6baa-4fb8-a7f9-2799befb8d58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:13.239999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81316f-76f1-4a59-984a-a1cf78b4dee2 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:13.263467 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:13.302855 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295ce27-6baa-4fb8-a7f9-2799befb8d58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:13.304409 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295ce27-6baa-4fb8-a7f9-2799befb8d58 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:13.322053 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:13.333369 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690454cc-f93a-4b6f-8a7b-33cd6c069327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:13.334026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690454cc-f93a-4b6f-8a7b-33cd6c069327 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:13.334309 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690454cc-f93a-4b6f-8a7b-33cd6c069327 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:13.334582 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690454cc-f93a-4b6f-8a7b-33cd6c069327 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:13.358201 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690454cc-f93a-4b6f-8a7b-33cd6c069327 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:13.363815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-690454cc-f93a-4b6f-8a7b-33cd6c069327 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:25:13.363815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:13.363815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:13.363815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:13.363815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:13.363815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:13.363815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:13.363815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:13.363815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:13.363815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:13.363815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:13.363815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:13.363815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:13.363815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:13.363815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:13.363815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:13.365106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:13.365106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:13.365106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:13.365106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:13.365106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:13.365106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:13.365106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:13.365106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:13.365106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:13.365106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:13.365106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:13.365106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:13.365106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:13.365106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:13.365106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:13.365106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:13.366083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:13.366083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:13.366083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:13.366083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:13.366083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:13.366083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:13.366083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:13.366083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:13.366083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:13.366083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:13.366083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:25:13.366083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:13.366083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 76/152] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 455 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:13.367253 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690454cc-f93a-4b6f-8a7b-33cd6c069327 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:13.506027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 77/153] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 797 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:25:13.506934 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295ce27-6baa-4fb8-a7f9-2799befb8d58 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:13.614817 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690454cc-f93a-4b6f-8a7b-33cd6c069327 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:13.653108 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c13dd8-9830-460e-a7c6-9c80df7f67c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:13.653730 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c13dd8-9830-460e-a7c6-9c80df7f67c4 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:13.654012 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c13dd8-9830-460e-a7c6-9c80df7f67c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:13.654290 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c13dd8-9830-460e-a7c6-9c80df7f67c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:13.654965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c13dd8-9830-460e-a7c6-9c80df7f67c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:13.655269 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c13dd8-9830-460e-a7c6-9c80df7f67c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:13.656960 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c13dd8-9830-460e-a7c6-9c80df7f67c4 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:13.666590 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 77/154] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:13.667830 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f0c08-48a1-409d-9d6f-056af82ba8f5 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:13.668130 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f0c08-48a1-409d-9d6f-056af82ba8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:13.668439 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f0c08-48a1-409d-9d6f-056af82ba8f5 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:13.669804 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 78/155] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:13.670435 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f0c08-48a1-409d-9d6f-056af82ba8f5 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:13.712562 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:13.746729 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295ce27-6baa-4fb8-a7f9-2799befb8d58 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:13.757451 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:13.812712 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebb5ad-387f-494e-b038-c92e8db4ed68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:13.813337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebb5ad-387f-494e-b038-c92e8db4ed68 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:13.813619 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebb5ad-387f-494e-b038-c92e8db4ed68 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:13.813892 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebb5ad-387f-494e-b038-c92e8db4ed68 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:13.814580 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebb5ad-387f-494e-b038-c92e8db4ed68 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:13.814885 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebb5ad-387f-494e-b038-c92e8db4ed68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:13.816318 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebb5ad-387f-494e-b038-c92e8db4ed68 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:13.828536 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 78/156] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:13.829821 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd04fd0-b61a-4911-b46f-a45e92384606 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:13.830111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd04fd0-b61a-4911-b46f-a45e92384606 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:13.830395 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd04fd0-b61a-4911-b46f-a45e92384606 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:13.831663 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 79/157] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:13.841218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd04fd0-b61a-4911-b46f-a45e92384606 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:13.856377 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f0c08-48a1-409d-9d6f-056af82ba8f5 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:13.935465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cdf28-12c1-4e60-a911-30f592ce9de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:13.936397 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cdf28-12c1-4e60-a911-30f592ce9de0 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:13.936541 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cdf28-12c1-4e60-a911-30f592ce9de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:13.936894 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cdf28-12c1-4e60-a911-30f592ce9de0 None admin] PATH_INFO: `/v3/projects/9e54ec3d9806409e8a45d9a82823741d` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:13.938281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cdf28-12c1-4e60-a911-30f592ce9de0 None admin] RBAC: Authorizing `identity:get_project(project_id=9e54ec3d9806409e8a45d9a82823741d)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:13.939488 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cdf28-12c1-4e60-a911-30f592ce9de0 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:13.941735 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 79/158] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:13 2022] GET /identity/v3/projects/9e54ec3d9806409e8a45d9a82823741d => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:13.949045 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf3681-6bf6-49c1-9eb0-e3215a66c7c9 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:13.949419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf3681-6bf6-49c1-9eb0-e3215a66c7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:13.949672 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf3681-6bf6-49c1-9eb0-e3215a66c7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:13.977339 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-fdcf3681-6bf6-49c1-9eb0-e3215a66c7c9 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:13.979780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-fdcf3681-6bf6-49c1-9eb0-e3215a66c7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:14.032244 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd04fd0-b61a-4911-b46f-a45e92384606 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:14.096577 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bc2c4-7b32-4836-a66d-3d89360392c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:14.098016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bc2c4-7b32-4836-a66d-3d89360392c6 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:14.099118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bc2c4-7b32-4836-a66d-3d89360392c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:14.100715 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bc2c4-7b32-4836-a66d-3d89360392c6 None admin] PATH_INFO: `/v3/users/3e753cc042b14c47bd5d1c6394848500` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:14.106745 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5bc2c4-7b32-4836-a66d-3d89360392c6 None admin] RBAC: Authorizing `identity:get_user(user_id=3e753cc042b14c47bd5d1c6394848500)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:14.109777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5bc2c4-7b32-4836-a66d-3d89360392c6 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:14.114200 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 80/159] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:13 2022] GET /identity/v3/users/3e753cc042b14c47bd5d1c6394848500 => generated 247 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:14.126027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bc2c4-7b32-4836-a66d-3d89360392c6 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:14.158416 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 80/160] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:14.159751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019177c-2f16-425f-8ffe-c3ea94369362 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:14.160037 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019177c-2f16-425f-8ffe-c3ea94369362 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:14.164637 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019177c-2f16-425f-8ffe-c3ea94369362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:14.184646 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:14.199718 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-1019177c-2f16-425f-8ffe-c3ea94369362 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:14.212400 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-1019177c-2f16-425f-8ffe-c3ea94369362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:14.308335 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:14.318580 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bc2c4-7b32-4836-a66d-3d89360392c6 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:14.354979 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 81/161] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:14.355995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1019177c-2f16-425f-8ffe-c3ea94369362 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:14.400994 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ce0c3-9928-46ef-9ae6-5cc569d32b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:14.402420 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ce0c3-9928-46ef-9ae6-5cc569d32b36 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:14.402918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ce0c3-9928-46ef-9ae6-5cc569d32b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:14.403383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ce0c3-9928-46ef-9ae6-5cc569d32b36 None admin] PATH_INFO: `/v3/users/3d943c88108f44ac8f3c3038063855ab` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:14.409079 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ce0c3-9928-46ef-9ae6-5cc569d32b36 None admin] RBAC: Authorizing `identity:get_user(user_id=3d943c88108f44ac8f3c3038063855ab)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:14.411137 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ce0c3-9928-46ef-9ae6-5cc569d32b36 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:14.413080 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 81/162] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:14 2022] GET /identity/v3/users/3d943c88108f44ac8f3c3038063855ab => generated 289 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:14.414724 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ce0c3-9928-46ef-9ae6-5cc569d32b36 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:14.552510 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1019177c-2f16-425f-8ffe-c3ea94369362 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:14.564228 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:14.586368 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ce0c3-9928-46ef-9ae6-5cc569d32b36 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:14.649664 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02943b01-0276-4b58-b48e-2a59954280b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:14.650734 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02943b01-0276-4b58-b48e-2a59954280b6 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:14.651218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02943b01-0276-4b58-b48e-2a59954280b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:14.651698 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02943b01-0276-4b58-b48e-2a59954280b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:14.653110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb851219-521b-4a75-9f75-22b5c3f09ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:14.653799 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb851219-521b-4a75-9f75-22b5c3f09ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:14.654084 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb851219-521b-4a75-9f75-22b5c3f09ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:14.654363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb851219-521b-4a75-9f75-22b5c3f09ee6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:14.655129 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb851219-521b-4a75-9f75-22b5c3f09ee6 None admin] RBAC: Adding query filter params (role.id=29d2c7708bea4287a21112bb7ffa72df, scope.project.id=9e54ec3d9806409e8a45d9a82823741d, user.id=11f0143c2b4e42a4ab57c2570a1d80e8) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:14.655443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb851219-521b-4a75-9f75-22b5c3f09ee6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:14.657117 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb851219-521b-4a75-9f75-22b5c3f09ee6 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:14.665003 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 82/163] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:25:14 2022] GET /identity/v3/role_assignments?user.id=11f0143c2b4e42a4ab57c2570a1d80e8&scope.project.id=9e54ec3d9806409e8a45d9a82823741d&role.id=29d2c7708bea4287a21112bb7ffa72df => generated 608 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:14.672240 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb851219-521b-4a75-9f75-22b5c3f09ee6 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:14.769152 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:14.771681 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02943b01-0276-4b58-b48e-2a59954280b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:14.774105 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02943b01-0276-4b58-b48e-2a59954280b6 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:14.890443 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:14.916758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 82/164] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:25:14.919416 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb851219-521b-4a75-9f75-22b5c3f09ee6 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:14.924751 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02943b01-0276-4b58-b48e-2a59954280b6 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:15.032787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468b479-c884-47f2-b8b2-0cfc9548a8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:15.033443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468b479-c884-47f2-b8b2-0cfc9548a8cc None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:15.033969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468b479-c884-47f2-b8b2-0cfc9548a8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:15.034432 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468b479-c884-47f2-b8b2-0cfc9548a8cc None admin] PATH_INFO: `/v3/projects/9e54ec3d9806409e8a45d9a82823741d` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:15.035849 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468b479-c884-47f2-b8b2-0cfc9548a8cc None admin] RBAC: Authorizing `identity:get_project(project_id=9e54ec3d9806409e8a45d9a82823741d)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:15.037590 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468b479-c884-47f2-b8b2-0cfc9548a8cc None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:15.042485 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 83/165] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:14 2022] GET /identity/v3/projects/9e54ec3d9806409e8a45d9a82823741d => generated 298 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:15.043670 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468b479-c884-47f2-b8b2-0cfc9548a8cc None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:15.056613 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02943b01-0276-4b58-b48e-2a59954280b6 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:15.101950 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab92205-b3c9-449a-80a4-f697662d1f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:15.103097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab92205-b3c9-449a-80a4-f697662d1f9d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:15.103514 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab92205-b3c9-449a-80a4-f697662d1f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:15.103950 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab92205-b3c9-449a-80a4-f697662d1f9d None admin] PATH_INFO: `/v3/projects/9e54ec3d9806409e8a45d9a82823741d` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:15.105490 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab92205-b3c9-449a-80a4-f697662d1f9d None admin] RBAC: Authorizing `identity:get_project(project_id=9e54ec3d9806409e8a45d9a82823741d)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:15.107602 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab92205-b3c9-449a-80a4-f697662d1f9d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:15.110047 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 83/166] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:14 2022] GET /identity/v3/projects/9e54ec3d9806409e8a45d9a82823741d => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:15.110979 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab92205-b3c9-449a-80a4-f697662d1f9d None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:15.172770 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:15.233492 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab92205-b3c9-449a-80a4-f697662d1f9d None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:15.276995 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ed739-6691-471f-bf98-ed5c99355443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:15.278623 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ed739-6691-471f-bf98-ed5c99355443 None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:15.279832 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ed739-6691-471f-bf98-ed5c99355443 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:15.280539 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ed739-6691-471f-bf98-ed5c99355443 None admin] PATH_INFO: `/v3/projects/9e54ec3d9806409e8a45d9a82823741d/users/3d943c88108f44ac8f3c3038063855ab/roles/1047d24970f744c38f38ecc563f0f61d` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:15.284621 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ed739-6691-471f-bf98-ed5c99355443 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e54ec3d9806409e8a45d9a82823741d, user_id=3d943c88108f44ac8f3c3038063855ab, role_id=1047d24970f744c38f38ecc563f0f61d)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:15.285738 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468b479-c884-47f2-b8b2-0cfc9548a8cc None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:15.287229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ed739-6691-471f-bf98-ed5c99355443 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:15.307583 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 84/167] 10.222.0.69 () {58 vars in 1439 bytes} [Mon Aug 29 21:25:15 2022] PUT /identity/v3/projects/9e54ec3d9806409e8a45d9a82823741d/users/3d943c88108f44ac8f3c3038063855ab/roles/1047d24970f744c38f38ecc563f0f61d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:25:15.308813 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ed739-6691-471f-bf98-ed5c99355443 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:15.312331 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:15.373042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a424bd3-52ec-4f3b-be3f-11d5f9c2146a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:15.374352 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a424bd3-52ec-4f3b-be3f-11d5f9c2146a None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:15.375083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a424bd3-52ec-4f3b-be3f-11d5f9c2146a None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:15.375681 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a424bd3-52ec-4f3b-be3f-11d5f9c2146a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:15.400004 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a424bd3-52ec-4f3b-be3f-11d5f9c2146a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:15.410932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-5a424bd3-52ec-4f3b-be3f-11d5f9c2146a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:25:15.410932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:15.410932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:15.410932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:15.410932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:15.410932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:15.410932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:15.410932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:15.410932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:15.410932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:15.410932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:15.410932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:15.410932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:15.410932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:15.410932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:15.410932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:15.412103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:15.412103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:15.412103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:15.412103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:15.412103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:15.412103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:15.412103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:15.412103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:15.412103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:15.412103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:15.412103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:15.412103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:15.412103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:15.412103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:15.412103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:15.412103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:15.412936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:15.412936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:15.412936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:15.412936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:15.412936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:15.412936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:15.412936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:15.412936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:15.412936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:15.412936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:15.412936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:25:15.412936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:15.412936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 84/168] 10.222.0.69 () {56 vars in 1114 bytes} [Mon Aug 29 21:25:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:15.415095 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a424bd3-52ec-4f3b-be3f-11d5f9c2146a None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:15.449760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ed739-6691-471f-bf98-ed5c99355443 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:15.460661 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:15.490457 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926dac3f-c30e-46ed-939c-1ea7916be4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:15.491251 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dac3f-c30e-46ed-939c-1ea7916be4bd None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:15.491644 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dac3f-c30e-46ed-939c-1ea7916be4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:15.492656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dac3f-c30e-46ed-939c-1ea7916be4bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:15.509444 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926dac3f-c30e-46ed-939c-1ea7916be4bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:15.518525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-926dac3f-c30e-46ed-939c-1ea7916be4bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:15.518525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:15.518525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:15.518525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:15.518525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:15.518525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:15.518525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:15.518525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:15.518525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:15.518525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:15.518525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:15.518525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:15.518525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:15.518525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:15.518525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:15.518525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:15.519491 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:15.519491 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:15.519491 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:15.519491 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:15.519491 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:15.519491 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:15.519491 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:15.519491 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:15.519491 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:15.519491 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:15.519491 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:15.519491 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:15.519491 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:15.519491 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:15.519491 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:15.519491 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:15.520316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:15.520316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:15.520316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:15.520316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:15.520316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:15.520316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:15.520316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:15.520316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:15.520316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:15.520316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:15.520316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:15.520316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:25:15.520316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 85/169] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:15.521868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926dac3f-c30e-46ed-939c-1ea7916be4bd None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:15.561232 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a424bd3-52ec-4f3b-be3f-11d5f9c2146a None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:15.603728 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7605f0-b0b5-4605-905d-8ed958261594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:15.604807 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7605f0-b0b5-4605-905d-8ed958261594 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:15.605331 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7605f0-b0b5-4605-905d-8ed958261594 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:15.605774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7605f0-b0b5-4605-905d-8ed958261594 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:15.606989 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7605f0-b0b5-4605-905d-8ed958261594 None admin] RBAC: Adding query filter params (role.id=69369872661e4179bb51cd1ca76e28c3, scope.project.id=9e54ec3d9806409e8a45d9a82823741d, user.id=3e753cc042b14c47bd5d1c6394848500) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:15.607574 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7605f0-b0b5-4605-905d-8ed958261594 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:15.609494 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7605f0-b0b5-4605-905d-8ed958261594 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:15.618098 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 85/170] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:25:15 2022] GET /identity/v3/role_assignments?user.id=3e753cc042b14c47bd5d1c6394848500&scope.project.id=9e54ec3d9806409e8a45d9a82823741d&role.id=69369872661e4179bb51cd1ca76e28c3 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:15.619397 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7605f0-b0b5-4605-905d-8ed958261594 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:15.667021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926dac3f-c30e-46ed-939c-1ea7916be4bd None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:15.690334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:15.719497 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0fadd-17c3-41ad-b249-521396c5bc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:15.720101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0fadd-17c3-41ad-b249-521396c5bc9d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:15.720416 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0fadd-17c3-41ad-b249-521396c5bc9d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:15.720887 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0fadd-17c3-41ad-b249-521396c5bc9d None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:15.721677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0fadd-17c3-41ad-b249-521396c5bc9d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:15.722652 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0fadd-17c3-41ad-b249-521396c5bc9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:15.724424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0fadd-17c3-41ad-b249-521396c5bc9d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:15.738605 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 86/171] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:25:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:15.740002 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1514c-33de-4b15-bf38-38ea919bd3b5 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:15.740315 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1514c-33de-4b15-bf38-38ea919bd3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:15.740587 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1514c-33de-4b15-bf38-38ea919bd3b5 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:15.741987 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 87/172] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:15.749863 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cc2c1-5d6c-4428-8a2e-895371a725fe None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:15.750403 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cc2c1-5d6c-4428-8a2e-895371a725fe None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:15.750690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cc2c1-5d6c-4428-8a2e-895371a725fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:15.775343 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f94cc2c1-5d6c-4428-8a2e-895371a725fe None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:15.777104 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f94cc2c1-5d6c-4428-8a2e-895371a725fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:15.794275 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7605f0-b0b5-4605-905d-8ed958261594 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:15.811016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:15.848272 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb44d07-3a69-4249-9a9c-03950675f540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:15.849194 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb44d07-3a69-4249-9a9c-03950675f540 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:15.849482 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb44d07-3a69-4249-9a9c-03950675f540 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:15.849759 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb44d07-3a69-4249-9a9c-03950675f540 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:15.850446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb44d07-3a69-4249-9a9c-03950675f540 None admin] RBAC: Adding query filter params (name=member) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:15.851034 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb44d07-3a69-4249-9a9c-03950675f540 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:15.853892 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb44d07-3a69-4249-9a9c-03950675f540 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:15.866822 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 86/173] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:15.868359 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb44d07-3a69-4249-9a9c-03950675f540 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:15.875858 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 88/174] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:15.881947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94cc2c1-5d6c-4428-8a2e-895371a725fe None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:16.027331 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:16.046770 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb44d07-3a69-4249-9a9c-03950675f540 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:16.086553 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94cc2c1-5d6c-4428-8a2e-895371a725fe None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:16.129992 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b6ba9-4a0d-4574-8164-6a696c2656c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:16.130655 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b6ba9-4a0d-4574-8164-6a696c2656c7 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:16.130920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b6ba9-4a0d-4574-8164-6a696c2656c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:16.131187 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b6ba9-4a0d-4574-8164-6a696c2656c7 None admin] PATH_INFO: `/v3/users/11f0143c2b4e42a4ab57c2570a1d80e8` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:16.132430 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b6ba9-4a0d-4574-8164-6a696c2656c7 None admin] RBAC: Authorizing `identity:get_user(user_id=11f0143c2b4e42a4ab57c2570a1d80e8)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:16.134148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b6ba9-4a0d-4574-8164-6a696c2656c7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:16.136161 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 89/175] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:15 2022] GET /identity/v3/users/11f0143c2b4e42a4ab57c2570a1d80e8 => generated 275 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:16.137576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fd7fb-7bbf-4906-90af-133668c2b4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:16.138294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fd7fb-7bbf-4906-90af-133668c2b4d0 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:16.138685 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fd7fb-7bbf-4906-90af-133668c2b4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:16.138966 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fd7fb-7bbf-4906-90af-133668c2b4d0 None admin] PATH_INFO: `/v3/users/11f0143c2b4e42a4ab57c2570a1d80e8` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:16.140342 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fd7fb-7bbf-4906-90af-133668c2b4d0 None admin] RBAC: Authorizing `identity:get_user(user_id=11f0143c2b4e42a4ab57c2570a1d80e8)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:16.141920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b6ba9-4a0d-4574-8164-6a696c2656c7 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:16.143624 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fd7fb-7bbf-4906-90af-133668c2b4d0 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:16.155069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 87/176] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:15 2022] GET /identity/v3/users/11f0143c2b4e42a4ab57c2570a1d80e8 => generated 275 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:16.182146 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fd7fb-7bbf-4906-90af-133668c2b4d0 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:16.194306 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:16.348277 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b6ba9-4a0d-4574-8164-6a696c2656c7 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:16.412324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fd7fb-7bbf-4906-90af-133668c2b4d0 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:16.424450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cbc2a-51c8-4178-a9c3-35b036a43da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:16.425087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cbc2a-51c8-4178-a9c3-35b036a43da4 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:16.425369 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cbc2a-51c8-4178-a9c3-35b036a43da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:16.425638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cbc2a-51c8-4178-a9c3-35b036a43da4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:16.458596 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bd491-5404-4cd4-bd38-3b2c1b493211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:16.459670 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bd491-5404-4cd4-bd38-3b2c1b493211 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:16.460128 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bd491-5404-4cd4-bd38-3b2c1b493211 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:16.460627 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bd491-5404-4cd4-bd38-3b2c1b493211 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:16.496477 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:16.514303 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69cbc2a-51c8-4178-a9c3-35b036a43da4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:16.515798 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69cbc2a-51c8-4178-a9c3-35b036a43da4 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:16.544329 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16bd491-5404-4cd4-bd38-3b2c1b493211 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:16.546051 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:16.546242 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16bd491-5404-4cd4-bd38-3b2c1b493211 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:16.644110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 90/177] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 21:25:16.645320 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cbc2a-51c8-4178-a9c3-35b036a43da4 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:16.672361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 88/178] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 21:25:16.678846 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445079a1-1ec7-499e-a4d2-8c07055683ad None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:16.679239 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445079a1-1ec7-499e-a4d2-8c07055683ad None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:16.679515 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445079a1-1ec7-499e-a4d2-8c07055683ad None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:16.685938 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 89/179] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:16.685938 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ef082-33bd-4815-9264-238a337ec64f None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:16.685938 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ef082-33bd-4815-9264-238a337ec64f None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:16.685938 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ef082-33bd-4815-9264-238a337ec64f None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:16.685938 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 90/180] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:16.685938 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ef082-33bd-4815-9264-238a337ec64f None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:16.761541 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:16.767217 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cbc2a-51c8-4178-a9c3-35b036a43da4 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:16.795562 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:16.805778 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cfce0-66ff-479f-8fb7-2e0c8eaf7e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:16.806422 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cfce0-66ff-479f-8fb7-2e0c8eaf7e71 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:16.806703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cfce0-66ff-479f-8fb7-2e0c8eaf7e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:16.806985 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cfce0-66ff-479f-8fb7-2e0c8eaf7e71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:16.810265 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ef082-33bd-4815-9264-238a337ec64f None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:16.818310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cfce0-66ff-479f-8fb7-2e0c8eaf7e71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:16.823816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-a60cfce0-66ff-479f-8fb7-2e0c8eaf7e71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:25:16.823816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:16.823816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:16.823816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:16.823816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:16.823816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:16.823816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:16.823816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:16.823816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:16.823816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:16.823816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:16.823816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:16.823816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:16.823816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:16.823816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:16.823816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:16.824739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:16.824739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:16.824739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:16.824739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:16.824739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:16.824739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:16.824739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:16.824739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:16.824739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:16.824739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:16.824739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:16.824739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:16.824739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:16.824739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:16.824739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:16.824739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:16.825532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:16.825532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:16.825532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:16.825532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:16.825532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:16.825532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:16.825532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:16.825532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:16.825532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:16.825532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:16.825532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:25:16.825532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:25:16.825532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 91/181] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:25:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:16.826201 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cfce0-66ff-479f-8fb7-2e0c8eaf7e71 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:16.859239 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df51ca-06a5-405f-9150-9d132be5ead5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:16.859886 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df51ca-06a5-405f-9150-9d132be5ead5 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:16.860163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df51ca-06a5-405f-9150-9d132be5ead5 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:16.860465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df51ca-06a5-405f-9150-9d132be5ead5 None admin] PATH_INFO: `/v3/projects/f72b9aa6a8e94b449ed37c3ac44bcb6e` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:16.861601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df51ca-06a5-405f-9150-9d132be5ead5 None admin] RBAC: Authorizing `identity:get_project(project_id=f72b9aa6a8e94b449ed37c3ac44bcb6e)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:16.863047 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df51ca-06a5-405f-9150-9d132be5ead5 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:16.865598 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 91/182] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:16 2022] GET /identity/v3/projects/f72b9aa6a8e94b449ed37c3ac44bcb6e => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:16.866168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba54578-d13b-4139-9a73-0bf9140141b6 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:16.866502 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba54578-d13b-4139-9a73-0bf9140141b6 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:16.866780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba54578-d13b-4139-9a73-0bf9140141b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:16.887405 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-1ba54578-d13b-4139-9a73-0bf9140141b6 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:16.888953 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-1ba54578-d13b-4139-9a73-0bf9140141b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:16.949413 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cfce0-66ff-479f-8fb7-2e0c8eaf7e71 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:16.969921 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 92/183] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:16.971264 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558970f-6115-4503-ba86-d142b3c6b88f None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:16.971549 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558970f-6115-4503-ba86-d142b3c6b88f None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:16.971820 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558970f-6115-4503-ba86-d142b3c6b88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:16.997542 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fdd9c-e295-43fd-9465-ed5a404245ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:16.998227 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fdd9c-e295-43fd-9465-ed5a404245ab None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:16.998505 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fdd9c-e295-43fd-9465-ed5a404245ab None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:16.998840 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fdd9c-e295-43fd-9465-ed5a404245ab None admin] PATH_INFO: `/v3/projects/9e54ec3d9806409e8a45d9a82823741d` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:17.000230 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706fdd9c-e295-43fd-9465-ed5a404245ab None admin] RBAC: Authorizing `identity:get_project(project_id=9e54ec3d9806409e8a45d9a82823741d)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:17.001040 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-f558970f-6115-4503-ba86-d142b3c6b88f None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:17.001733 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706fdd9c-e295-43fd-9465-ed5a404245ab None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:17.002846 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f558970f-6115-4503-ba86-d142b3c6b88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:17.003880 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 92/184] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:16 2022] GET /identity/v3/projects/9e54ec3d9806409e8a45d9a82823741d => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:17.004852 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fdd9c-e295-43fd-9465-ed5a404245ab None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:17.078992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:17.084487 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:17.100165 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 93/185] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:17.107925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558970f-6115-4503-ba86-d142b3c6b88f None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:17.196259 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fdd9c-e295-43fd-9465-ed5a404245ab None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:17.241670 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558970f-6115-4503-ba86-d142b3c6b88f None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:17.288980 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ca6d3-0644-49b3-85fd-dc074fa959fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:17.290788 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ca6d3-0644-49b3-85fd-dc074fa959fa None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:17.291240 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ca6d3-0644-49b3-85fd-dc074fa959fa None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:17.292125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ca6d3-0644-49b3-85fd-dc074fa959fa None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:17.293258 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ca6d3-0644-49b3-85fd-dc074fa959fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:17.293756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ca6d3-0644-49b3-85fd-dc074fa959fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:17.296140 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ca6d3-0644-49b3-85fd-dc074fa959fa None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:17.315791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 93/186] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:17.322062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ca6d3-0644-49b3-85fd-dc074fa959fa None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:17.324312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d908c5a-00a2-4e2d-bc9d-c638e6870688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:17.324946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d908c5a-00a2-4e2d-bc9d-c638e6870688 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:17.325221 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d908c5a-00a2-4e2d-bc9d-c638e6870688 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:17.325491 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d908c5a-00a2-4e2d-bc9d-c638e6870688 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:17.326230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d908c5a-00a2-4e2d-bc9d-c638e6870688 None admin] RBAC: Adding query filter params (role.id=29d2c7708bea4287a21112bb7ffa72df, scope.project.id=f72b9aa6a8e94b449ed37c3ac44bcb6e, user.id=11f0143c2b4e42a4ab57c2570a1d80e8) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:17.326540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d908c5a-00a2-4e2d-bc9d-c638e6870688 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:17.327989 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d908c5a-00a2-4e2d-bc9d-c638e6870688 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:17.334585 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 94/187] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:25:17 2022] GET /identity/v3/role_assignments?user.id=11f0143c2b4e42a4ab57c2570a1d80e8&scope.project.id=f72b9aa6a8e94b449ed37c3ac44bcb6e&role.id=29d2c7708bea4287a21112bb7ffa72df => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:17.335391 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d908c5a-00a2-4e2d-bc9d-c638e6870688 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:17.424354 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:17.499535 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ca6d3-0644-49b3-85fd-dc074fa959fa None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:17.511566 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d908c5a-00a2-4e2d-bc9d-c638e6870688 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:17.540787 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:17.574938 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a08fb-e386-4cb5-95e2-00dacaec5257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:17.575589 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a08fb-e386-4cb5-95e2-00dacaec5257 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:17.575999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a08fb-e386-4cb5-95e2-00dacaec5257 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:17.576352 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a08fb-e386-4cb5-95e2-00dacaec5257 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:17.578020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a08fb-e386-4cb5-95e2-00dacaec5257 None admin] RBAC: Adding query filter params (role.id=ecbc0b9f55214a93a2016b3625d94764, scope.project.id=9e54ec3d9806409e8a45d9a82823741d, user.id=11f0143c2b4e42a4ab57c2570a1d80e8) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:17.578449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a08fb-e386-4cb5-95e2-00dacaec5257 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:17.580018 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a08fb-e386-4cb5-95e2-00dacaec5257 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:17.584746 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792fb0b-991b-4e5e-9d26-3b6e1e8ce5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:17.585400 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792fb0b-991b-4e5e-9d26-3b6e1e8ce5b3 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:17.585683 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792fb0b-991b-4e5e-9d26-3b6e1e8ce5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:17.586567 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792fb0b-991b-4e5e-9d26-3b6e1e8ce5b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:17.592494 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 94/188] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:25:17 2022] GET /identity/v3/role_assignments?user.id=11f0143c2b4e42a4ab57c2570a1d80e8&scope.project.id=9e54ec3d9806409e8a45d9a82823741d&role.id=ecbc0b9f55214a93a2016b3625d94764 => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:17.593956 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a08fb-e386-4cb5-95e2-00dacaec5257 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:17.599800 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792fb0b-991b-4e5e-9d26-3b6e1e8ce5b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:17.605437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-1792fb0b-991b-4e5e-9d26-3b6e1e8ce5b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:25:17.605437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:17.605437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:17.605437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:17.605437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:17.605437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:17.605437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:17.605437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:17.605437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:17.605437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:17.605437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:17.605437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:17.605437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:17.605437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:17.605437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:17.605437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:17.606443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:17.606443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:17.606443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:17.606443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:17.606443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:17.606443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:17.606443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:17.606443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:17.606443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:17.606443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:17.606443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:17.606443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:17.606443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:17.606443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:17.606443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:17.606443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:17.607331 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:17.607331 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:17.607331 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:17.607331 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:17.607331 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:17.607331 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:17.607331 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:17.607331 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:17.607331 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:17.607331 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:17.607331 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:25:17.607331 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:17.607331 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 95/189] 10.222.0.69 () {56 vars in 1114 bytes} [Mon Aug 29 21:25:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:17.607989 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792fb0b-991b-4e5e-9d26-3b6e1e8ce5b3 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:17.746811 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a08fb-e386-4cb5-95e2-00dacaec5257 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:17.758861 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792fb0b-991b-4e5e-9d26-3b6e1e8ce5b3 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:17.783298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:17.797274 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f5309-c4b7-4a96-8b4e-8f96b49cf47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:17.798019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f5309-c4b7-4a96-8b4e-8f96b49cf47e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:17.798372 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f5309-c4b7-4a96-8b4e-8f96b49cf47e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:17.798714 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f5309-c4b7-4a96-8b4e-8f96b49cf47e None admin] PATH_INFO: `/v3/users/cab681a16fd04297a56bbd549176c66d` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:17.811169 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103cdf7-25a1-410c-a465-8504d4e0ce18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:17.812795 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103cdf7-25a1-410c-a465-8504d4e0ce18 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:17.813268 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103cdf7-25a1-410c-a465-8504d4e0ce18 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:17.814010 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103cdf7-25a1-410c-a465-8504d4e0ce18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:17.816056 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103cdf7-25a1-410c-a465-8504d4e0ce18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:17.818878 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103cdf7-25a1-410c-a465-8504d4e0ce18 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:17.820104 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f5309-c4b7-4a96-8b4e-8f96b49cf47e None admin] RBAC: Authorizing `identity:get_user(user_id=cab681a16fd04297a56bbd549176c66d)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:17.821401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 96/190] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:25:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:17.821850 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f5309-c4b7-4a96-8b4e-8f96b49cf47e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:17.822618 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103cdf7-25a1-410c-a465-8504d4e0ce18 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:17.828422 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 95/191] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:17 2022] GET /identity/v3/users/cab681a16fd04297a56bbd549176c66d => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:17.829086 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f5309-c4b7-4a96-8b4e-8f96b49cf47e None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:17.900865 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:17.967015 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103cdf7-25a1-410c-a465-8504d4e0ce18 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:17.995340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f5309-c4b7-4a96-8b4e-8f96b49cf47e None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:18.012084 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a14b6-1468-4b0a-8644-a53a19dbd329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:18.012994 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a14b6-1468-4b0a-8644-a53a19dbd329 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:18.013290 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a14b6-1468-4b0a-8644-a53a19dbd329 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:18.013798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a14b6-1468-4b0a-8644-a53a19dbd329 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:18.014472 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a14b6-1468-4b0a-8644-a53a19dbd329 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:18.014702 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a14b6-1468-4b0a-8644-a53a19dbd329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:18.016109 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a14b6-1468-4b0a-8644-a53a19dbd329 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:18.026191 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 97/192] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:25:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:18.026931 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a14b6-1468-4b0a-8644-a53a19dbd329 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:18.041208 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622b241-ec25-453c-8a1e-d202fa7c2de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:18.041679 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622b241-ec25-453c-8a1e-d202fa7c2de3 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:18.042022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622b241-ec25-453c-8a1e-d202fa7c2de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:18.042427 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622b241-ec25-453c-8a1e-d202fa7c2de3 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:18.042944 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622b241-ec25-453c-8a1e-d202fa7c2de3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:18.044398 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622b241-ec25-453c-8a1e-d202fa7c2de3 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:18.067420 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 96/193] 10.222.0.69 () {60 vars in 1132 bytes} [Mon Aug 29 21:25:17 2022] POST /identity/v3/users => generated 297 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:25:18.068293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622b241-ec25-453c-8a1e-d202fa7c2de3 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:18.091230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:18.170053 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a14b6-1468-4b0a-8644-a53a19dbd329 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:18.214710 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c5615-fd8e-4088-b647-235d99d7a427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:18.215337 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c5615-fd8e-4088-b647-235d99d7a427 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:18.215690 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c5615-fd8e-4088-b647-235d99d7a427 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:18.215963 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c5615-fd8e-4088-b647-235d99d7a427 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:18.220512 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:18.231767 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622b241-ec25-453c-8a1e-d202fa7c2de3 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:18.278993 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c3fc7-def6-490b-a467-7549c5925f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:18.279562 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c3fc7-def6-490b-a467-7549c5925f73 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:18.279843 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c3fc7-def6-490b-a467-7549c5925f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:18.280114 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c3fc7-def6-490b-a467-7549c5925f73 None admin] PATH_INFO: `/v3/users/cab681a16fd04297a56bbd549176c66d` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:18.282198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c3fc7-def6-490b-a467-7549c5925f73 None admin] RBAC: Authorizing `identity:get_user(user_id=cab681a16fd04297a56bbd549176c66d)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:18.283167 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c3fc7-def6-490b-a467-7549c5925f73 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:18.286188 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 97/194] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:18 2022] GET /identity/v3/users/cab681a16fd04297a56bbd549176c66d => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:18.287473 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19eb7c-fcba-4d70-a170-0f9603719e0d None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:18.287726 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19eb7c-fcba-4d70-a170-0f9603719e0d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:18.288034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19eb7c-fcba-4d70-a170-0f9603719e0d None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:18.289964 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 98/195] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:18.291088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19eb7c-fcba-4d70-a170-0f9603719e0d None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:18.310221 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c5615-fd8e-4088-b647-235d99d7a427 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:18.311703 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c5615-fd8e-4088-b647-235d99d7a427 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:18.375339 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:18.432919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19eb7c-fcba-4d70-a170-0f9603719e0d None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:18.455797 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 98/196] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:25:18.457611 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baf1b5-cff0-44bd-bedb-a68c9f6dbb16 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:18.458118 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baf1b5-cff0-44bd-bedb-a68c9f6dbb16 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:18.458587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baf1b5-cff0-44bd-bedb-a68c9f6dbb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:18.480059 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-80baf1b5-cff0-44bd-bedb-a68c9f6dbb16 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:18.481336 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-80baf1b5-cff0-44bd-bedb-a68c9f6dbb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:18.481610 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5da2c6-fd46-4c70-a3dc-1752b7bc4aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:18.482230 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5da2c6-fd46-4c70-a3dc-1752b7bc4aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:18.482506 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5da2c6-fd46-4c70-a3dc-1752b7bc4aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:18.482775 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5da2c6-fd46-4c70-a3dc-1752b7bc4aa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:18.520750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:18.579151 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5da2c6-fd46-4c70-a3dc-1752b7bc4aa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:18.581064 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 99/197] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:18.581193 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5da2c6-fd46-4c70-a3dc-1752b7bc4aa3 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:18.581669 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80baf1b5-cff0-44bd-bedb-a68c9f6dbb16 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:18.672336 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:18.699924 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80baf1b5-cff0-44bd-bedb-a68c9f6dbb16 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:18.745019 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7604e51-25b4-4d63-a710-7ae234892124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:18.745811 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7604e51-25b4-4d63-a710-7ae234892124 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:18.746099 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7604e51-25b4-4d63-a710-7ae234892124 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:18.746387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7604e51-25b4-4d63-a710-7ae234892124 None admin] PATH_INFO: `/v3/projects/5e57c96553df40ff975ec73f2b01cda6` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:18.749136 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7604e51-25b4-4d63-a710-7ae234892124 None admin] RBAC: Authorizing `identity:get_project(project_id=5e57c96553df40ff975ec73f2b01cda6)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:18.750699 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7604e51-25b4-4d63-a710-7ae234892124 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:18.756860 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 100/198] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:18 2022] GET /identity/v3/projects/5e57c96553df40ff975ec73f2b01cda6 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:18.766000 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7604e51-25b4-4d63-a710-7ae234892124 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:18.791020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 99/199] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 21:25:18.799916 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5da2c6-fd46-4c70-a3dc-1752b7bc4aa3 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:18.886569 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7604e51-25b4-4d63-a710-7ae234892124 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:18.914765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:18.964697 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8dc0b7-4085-4dbc-b0a2-02bdd1dcaf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:18.965317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8dc0b7-4085-4dbc-b0a2-02bdd1dcaf69 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:18.965600 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8dc0b7-4085-4dbc-b0a2-02bdd1dcaf69 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:18.965879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8dc0b7-4085-4dbc-b0a2-02bdd1dcaf69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:18.966616 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8dc0b7-4085-4dbc-b0a2-02bdd1dcaf69 None admin] RBAC: Adding query filter params (role.id=69369872661e4179bb51cd1ca76e28c3, scope.project.id=5e57c96553df40ff975ec73f2b01cda6, user.id=cab681a16fd04297a56bbd549176c66d) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:18.966925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8dc0b7-4085-4dbc-b0a2-02bdd1dcaf69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:18.968408 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8dc0b7-4085-4dbc-b0a2-02bdd1dcaf69 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:18.975841 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5da2c6-fd46-4c70-a3dc-1752b7bc4aa3 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:18.983654 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 101/200] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:25:18 2022] GET /identity/v3/role_assignments?user.id=cab681a16fd04297a56bbd549176c66d&scope.project.id=5e57c96553df40ff975ec73f2b01cda6&role.id=69369872661e4179bb51cd1ca76e28c3 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:18.984446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8dc0b7-4085-4dbc-b0a2-02bdd1dcaf69 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:18.997330 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:19.041959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502509e6-ddbe-4d08-b0d9-26b879e7c923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:19.042619 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502509e6-ddbe-4d08-b0d9-26b879e7c923 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:19.042892 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502509e6-ddbe-4d08-b0d9-26b879e7c923 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:19.043128 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502509e6-ddbe-4d08-b0d9-26b879e7c923 None admin] PATH_INFO: `/v3/projects/5e57c96553df40ff975ec73f2b01cda6` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:19.047095 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502509e6-ddbe-4d08-b0d9-26b879e7c923 None admin] RBAC: Authorizing `identity:get_project(project_id=5e57c96553df40ff975ec73f2b01cda6)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:19.048586 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502509e6-ddbe-4d08-b0d9-26b879e7c923 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:19.050759 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 100/201] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:18 2022] GET /identity/v3/projects/5e57c96553df40ff975ec73f2b01cda6 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:19.060127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502509e6-ddbe-4d08-b0d9-26b879e7c923 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:19.105707 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8dc0b7-4085-4dbc-b0a2-02bdd1dcaf69 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:19.174810 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f2fa4-dd5b-4974-b32c-ab04243c8530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:19.175481 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f2fa4-dd5b-4974-b32c-ab04243c8530 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:19.175798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f2fa4-dd5b-4974-b32c-ab04243c8530 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:19.176077 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f2fa4-dd5b-4974-b32c-ab04243c8530 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:19.198801 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f2fa4-dd5b-4974-b32c-ab04243c8530 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:19.211497 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502509e6-ddbe-4d08-b0d9-26b879e7c923 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:19.212917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-519f2fa4-dd5b-4974-b32c-ab04243c8530 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:25:19.212917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:19.212917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:19.212917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:19.212917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:19.212917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:19.212917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:19.212917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:19.212917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:19.212917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:19.212917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:19.212917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:19.212917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:19.212917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:19.212917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:19.212917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:19.219124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:19.219124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:19.219124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:19.219124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:19.219124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:19.219124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:19.219124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:19.219124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:19.219124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:19.219124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:19.219124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:19.219124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:19.219124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:19.219124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:19.219124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:19.219124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:19.223464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:19.223464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:19.223464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:19.223464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:19.223464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:19.223464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:19.223464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:19.223464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:19.223464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:19.223464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:19.223464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:25:19.223464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:19.223464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 102/202] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:25:19.223464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f2fa4-dd5b-4974-b32c-ab04243c8530 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:19.259129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:19.285015 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd28ae-1896-4893-b1d8-2bac2168311b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:19.286581 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd28ae-1896-4893-b1d8-2bac2168311b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:19.287362 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd28ae-1896-4893-b1d8-2bac2168311b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:19.288126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd28ae-1896-4893-b1d8-2bac2168311b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:19.289874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd28ae-1896-4893-b1d8-2bac2168311b None admin] RBAC: Adding query filter params (role.id=ecbc0b9f55214a93a2016b3625d94764, scope.project.id=5e57c96553df40ff975ec73f2b01cda6, user.id=cab681a16fd04297a56bbd549176c66d) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:19.290748 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd28ae-1896-4893-b1d8-2bac2168311b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:19.295823 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd28ae-1896-4893-b1d8-2bac2168311b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:19.319196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 101/203] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:25:19 2022] GET /identity/v3/role_assignments?user.id=cab681a16fd04297a56bbd549176c66d&scope.project.id=5e57c96553df40ff975ec73f2b01cda6&role.id=ecbc0b9f55214a93a2016b3625d94764 => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:19.408587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:19.474551 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f2fa4-dd5b-4974-b32c-ab04243c8530 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:19.545672 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfbca6-5c20-4522-ba94-a5156878d90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:19.547294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfbca6-5c20-4522-ba94-a5156878d90f None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:19.548028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfbca6-5c20-4522-ba94-a5156878d90f None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:19.548763 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfbca6-5c20-4522-ba94-a5156878d90f None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:19.550160 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfbca6-5c20-4522-ba94-a5156878d90f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:19.550936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfbca6-5c20-4522-ba94-a5156878d90f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:19.553594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfbca6-5c20-4522-ba94-a5156878d90f None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:19.565056 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 103/204] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:19.572652 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd28ae-1896-4893-b1d8-2bac2168311b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:19.749994 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd28ae-1896-4893-b1d8-2bac2168311b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:19.799332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424a409-11db-4c09-9c99-be6edaf406ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:19.800368 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424a409-11db-4c09-9c99-be6edaf406ae None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:19.801405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424a409-11db-4c09-9c99-be6edaf406ae None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:19.801882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424a409-11db-4c09-9c99-be6edaf406ae None admin] PATH_INFO: `/v3/users/3d943c88108f44ac8f3c3038063855ab` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:19.803301 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424a409-11db-4c09-9c99-be6edaf406ae None admin] RBAC: Authorizing `identity:get_user(user_id=3d943c88108f44ac8f3c3038063855ab)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:19.805538 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424a409-11db-4c09-9c99-be6edaf406ae None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:19.807364 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 102/205] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:19 2022] GET /identity/v3/users/3d943c88108f44ac8f3c3038063855ab => generated 289 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:19.813286 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfbca6-5c20-4522-ba94-a5156878d90f None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:19.938086 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfbca6-5c20-4522-ba94-a5156878d90f None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:19.968295 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:19.977092 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2cb7ca-9422-4907-8e42-9cce945ca635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:19.977721 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cb7ca-9422-4907-8e42-9cce945ca635 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:19.978257 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cb7ca-9422-4907-8e42-9cce945ca635 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:19.978532 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cb7ca-9422-4907-8e42-9cce945ca635 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:20.050364 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2cb7ca-9422-4907-8e42-9cce945ca635 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:20.051767 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2cb7ca-9422-4907-8e42-9cce945ca635 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:20.157435 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 104/206] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:25:20.165675 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424a409-11db-4c09-9c99-be6edaf406ae None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:20.288553 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:20.332551 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424a409-11db-4c09-9c99-be6edaf406ae None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:20.370612 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f21f07-11f1-47fe-907f-bc7e6a15bf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:20.371263 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f21f07-11f1-47fe-907f-bc7e6a15bf3f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:20.371546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f21f07-11f1-47fe-907f-bc7e6a15bf3f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:20.371822 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f21f07-11f1-47fe-907f-bc7e6a15bf3f None admin] PATH_INFO: `/v3/projects/9e54ec3d9806409e8a45d9a82823741d` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:20.372992 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f21f07-11f1-47fe-907f-bc7e6a15bf3f None admin] RBAC: Authorizing `identity:get_project(project_id=9e54ec3d9806409e8a45d9a82823741d)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:20.374518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f21f07-11f1-47fe-907f-bc7e6a15bf3f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:20.376370 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 103/207] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:20 2022] GET /identity/v3/projects/9e54ec3d9806409e8a45d9a82823741d => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:20.382486 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2cb7ca-9422-4907-8e42-9cce945ca635 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:20.401433 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d7c6b-c5c0-4fa8-98dc-ecbf80c6a2e6 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:20.401745 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d7c6b-c5c0-4fa8-98dc-ecbf80c6a2e6 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:20.402029 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d7c6b-c5c0-4fa8-98dc-ecbf80c6a2e6 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:20.403913 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 104/208] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:20.412497 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8b559-4f23-4227-80a5-a6ad094ee515 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:20.412893 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8b559-4f23-4227-80a5-a6ad094ee515 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:20.413046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8b559-4f23-4227-80a5-a6ad094ee515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:20.446432 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f0d8b559-4f23-4227-80a5-a6ad094ee515 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:20.450040 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f0d8b559-4f23-4227-80a5-a6ad094ee515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:20.473610 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:20.591515 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2cb7ca-9422-4907-8e42-9cce945ca635 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:20.593766 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 105/209] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:25:20.648286 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ceaed2-189c-43ad-a569-c6a01c518db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:20.649794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ceaed2-189c-43ad-a569-c6a01c518db5 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:20.650318 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ceaed2-189c-43ad-a569-c6a01c518db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:20.650798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ceaed2-189c-43ad-a569-c6a01c518db5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:20.651668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ceaed2-189c-43ad-a569-c6a01c518db5 None admin] RBAC: Adding query filter params (role.id=1047d24970f744c38f38ecc563f0f61d, scope.project.id=9e54ec3d9806409e8a45d9a82823741d, user.id=3d943c88108f44ac8f3c3038063855ab) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:20.652116 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ceaed2-189c-43ad-a569-c6a01c518db5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:20.657923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ceaed2-189c-43ad-a569-c6a01c518db5 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:20.669782 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 105/210] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:25:20 2022] GET /identity/v3/role_assignments?user.id=3d943c88108f44ac8f3c3038063855ab&scope.project.id=9e54ec3d9806409e8a45d9a82823741d&role.id=1047d24970f744c38f38ecc563f0f61d => generated 608 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:20.873425 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73066e-9207-4ec0-be8c-d3c6648e9d17 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:20.873936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73066e-9207-4ec0-be8c-d3c6648e9d17 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:20.874117 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73066e-9207-4ec0-be8c-d3c6648e9d17 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:20.875628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 106/211] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:20.890061 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10c710-4c94-4211-98cf-43db24d46d08 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:20.890684 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10c710-4c94-4211-98cf-43db24d46d08 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:20.891195 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10c710-4c94-4211-98cf-43db24d46d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:20.914465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-ef10c710-4c94-4211-98cf-43db24d46d08 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:20.916049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-ef10c710-4c94-4211-98cf-43db24d46d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:20.957949 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73066e-9207-4ec0-be8c-d3c6648e9d17 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:20.997542 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 106/212] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:21.049366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:21.103225 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73066e-9207-4ec0-be8c-d3c6648e9d17 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:21.142264 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7156fc-59d4-4a0e-b427-a1d7e941a1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:21.143428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7156fc-59d4-4a0e-b427-a1d7e941a1ee None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:21.143907 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7156fc-59d4-4a0e-b427-a1d7e941a1ee None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:21.144414 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7156fc-59d4-4a0e-b427-a1d7e941a1ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:21.156274 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7156fc-59d4-4a0e-b427-a1d7e941a1ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:21.161518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-6c7156fc-59d4-4a0e-b427-a1d7e941a1ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:21.161518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:21.161518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:21.161518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:21.161518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:21.161518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:21.161518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:21.161518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:21.161518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:21.161518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:21.161518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:21.161518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:21.161518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:21.161518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:21.161518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:21.161518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:21.162404 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:21.162404 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:21.162404 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:21.162404 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:21.162404 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:21.162404 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:21.162404 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:21.162404 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:21.162404 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:21.162404 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:21.162404 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:21.162404 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:21.162404 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:21.162404 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:21.162404 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:21.162404 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:21.163216 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:21.163216 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:21.163216 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:21.163216 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:21.163216 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:21.163216 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:21.163216 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:21.163216 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:21.163216 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:21.163216 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:21.163216 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:21.163216 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:25:21.165544 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 107/213] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:25:21.171385 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10c710-4c94-4211-98cf-43db24d46d08 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:21.212741 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:21.302830 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10c710-4c94-4211-98cf-43db24d46d08 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:21.318566 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7156fc-59d4-4a0e-b427-a1d7e941a1ee None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:21.348696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a2c01-3108-47a7-8941-571b03d9f110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:21.349714 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a2c01-3108-47a7-8941-571b03d9f110 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:21.350517 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a2c01-3108-47a7-8941-571b03d9f110 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:21.350898 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a2c01-3108-47a7-8941-571b03d9f110 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:21.352307 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a2c01-3108-47a7-8941-571b03d9f110 None admin] RBAC: Adding query filter params (name=member) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:21.352647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a2c01-3108-47a7-8941-571b03d9f110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:21.354325 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a2c01-3108-47a7-8941-571b03d9f110 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:21.368004 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 107/214] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:21.373197 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a2c01-3108-47a7-8941-571b03d9f110 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:21.458662 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7156fc-59d4-4a0e-b427-a1d7e941a1ee None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:21.493056 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:21.495675 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:21.517991 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a2c01-3108-47a7-8941-571b03d9f110 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:21.523672 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b673111-9745-46f1-9194-eb5cb9ded07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:21.524389 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b673111-9745-46f1-9194-eb5cb9ded07b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:21.524669 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b673111-9745-46f1-9194-eb5cb9ded07b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:21.524949 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b673111-9745-46f1-9194-eb5cb9ded07b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:21.526170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b673111-9745-46f1-9194-eb5cb9ded07b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:21.527627 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b673111-9745-46f1-9194-eb5cb9ded07b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:21.534124 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 108/215] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:25:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:21.535132 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b673111-9745-46f1-9194-eb5cb9ded07b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:21.562674 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a25be-864f-4258-9eb8-339c43b6ca16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:21.563473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a25be-864f-4258-9eb8-339c43b6ca16 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:21.563751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a25be-864f-4258-9eb8-339c43b6ca16 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:21.564023 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a25be-864f-4258-9eb8-339c43b6ca16 None admin] PATH_INFO: `/v3/users/9b261e4283de462a8aabc86d59c511f2` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:21.579277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a25be-864f-4258-9eb8-339c43b6ca16 None admin] RBAC: Authorizing `identity:get_user(user_id=9b261e4283de462a8aabc86d59c511f2)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:21.580857 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a25be-864f-4258-9eb8-339c43b6ca16 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:21.587643 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 108/216] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:21 2022] GET /identity/v3/users/9b261e4283de462a8aabc86d59c511f2 => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:21.587643 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781cdc4-d4cd-47bd-8482-05fceaa8bb7e None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:21.587643 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781cdc4-d4cd-47bd-8482-05fceaa8bb7e None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:21.587643 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781cdc4-d4cd-47bd-8482-05fceaa8bb7e None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:21.587643 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 109/217] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:21.588436 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781cdc4-d4cd-47bd-8482-05fceaa8bb7e None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:21.671739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b673111-9745-46f1-9194-eb5cb9ded07b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:21.714911 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22adf96-af5f-4a7a-a8e9-c8f7197bf55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:21.715813 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22adf96-af5f-4a7a-a8e9-c8f7197bf55a None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:21.716310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22adf96-af5f-4a7a-a8e9-c8f7197bf55a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:21.716782 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22adf96-af5f-4a7a-a8e9-c8f7197bf55a None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:21.717440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22adf96-af5f-4a7a-a8e9-c8f7197bf55a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:21.718915 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22adf96-af5f-4a7a-a8e9-c8f7197bf55a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:21.740522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781cdc4-d4cd-47bd-8482-05fceaa8bb7e None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:21.750893 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 109/218] 10.222.0.69 () {60 vars in 1132 bytes} [Mon Aug 29 21:25:21 2022] POST /identity/v3/users => generated 297 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:25:21.753623 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188afc7-b28d-42ad-a95f-b86d36ea9598 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:21.754381 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188afc7-b28d-42ad-a95f-b86d36ea9598 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:21.754875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188afc7-b28d-42ad-a95f-b86d36ea9598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:21.787457 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-c188afc7-b28d-42ad-a95f-b86d36ea9598 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:21.790307 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c188afc7-b28d-42ad-a95f-b86d36ea9598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:21.797907 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc87eec-c565-439c-b616-86dc6b777da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:21.799020 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc87eec-c565-439c-b616-86dc6b777da2 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:21.799523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc87eec-c565-439c-b616-86dc6b777da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:21.800039 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc87eec-c565-439c-b616-86dc6b777da2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:21.822588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:21.873253 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:21.897780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc87eec-c565-439c-b616-86dc6b777da2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:21.900507 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc87eec-c565-439c-b616-86dc6b777da2 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:21.928362 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 110/219] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:21.940832 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd16241-ae13-471d-b306-6cad1a4c5a33 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:21.941391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd16241-ae13-471d-b306-6cad1a4c5a33 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:21.941971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd16241-ae13-471d-b306-6cad1a4c5a33 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:21.945321 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 111/220] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:25:21.951342 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539efda-7486-4c0a-a059-2e4bfabad019 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:21.951825 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539efda-7486-4c0a-a059-2e4bfabad019 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:21.952862 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539efda-7486-4c0a-a059-2e4bfabad019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:21.977780 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-a539efda-7486-4c0a-a059-2e4bfabad019 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:21.979093 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a539efda-7486-4c0a-a059-2e4bfabad019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:22.043605 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 110/221] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 21:25:22.049146 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc87eec-c565-439c-b616-86dc6b777da2 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:22.069501 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 112/222] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:25:22.104349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:22.169754 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc87eec-c565-439c-b616-86dc6b777da2 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:22.210303 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2862e4-d9f4-4b85-80d7-e46e6e0db561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:22.210753 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2862e4-d9f4-4b85-80d7-e46e6e0db561 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:22.210753 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2862e4-d9f4-4b85-80d7-e46e6e0db561 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:22.211611 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2862e4-d9f4-4b85-80d7-e46e6e0db561 None admin] PATH_INFO: `/v3/projects/5e57c96553df40ff975ec73f2b01cda6` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:22.215519 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2862e4-d9f4-4b85-80d7-e46e6e0db561 None admin] RBAC: Authorizing `identity:get_project(project_id=5e57c96553df40ff975ec73f2b01cda6)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:22.215519 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2862e4-d9f4-4b85-80d7-e46e6e0db561 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:22.216473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 111/223] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:22 2022] GET /identity/v3/projects/5e57c96553df40ff975ec73f2b01cda6 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:22.222544 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539efda-7486-4c0a-a059-2e4bfabad019 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:22.254150 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2862e4-d9f4-4b85-80d7-e46e6e0db561 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:22.359101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539efda-7486-4c0a-a059-2e4bfabad019 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:22.361692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:22.401141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e889cbb-c12e-46b2-b99e-824ee95c5e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:22.401764 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e889cbb-c12e-46b2-b99e-824ee95c5e2d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:22.402040 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e889cbb-c12e-46b2-b99e-824ee95c5e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:22.402307 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e889cbb-c12e-46b2-b99e-824ee95c5e2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:22.403045 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e889cbb-c12e-46b2-b99e-824ee95c5e2d None admin] RBAC: Adding query filter params (role.id=29d2c7708bea4287a21112bb7ffa72df, scope.project.id=5e57c96553df40ff975ec73f2b01cda6, user.id=9b261e4283de462a8aabc86d59c511f2) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:22.403347 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e889cbb-c12e-46b2-b99e-824ee95c5e2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:22.405082 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e889cbb-c12e-46b2-b99e-824ee95c5e2d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:22.411804 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 113/224] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:25:22 2022] GET /identity/v3/role_assignments?user.id=9b261e4283de462a8aabc86d59c511f2&scope.project.id=5e57c96553df40ff975ec73f2b01cda6&role.id=29d2c7708bea4287a21112bb7ffa72df => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:22.416862 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e889cbb-c12e-46b2-b99e-824ee95c5e2d None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:22.429678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2862e4-d9f4-4b85-80d7-e46e6e0db561 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:22.445691 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:22.491818 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36021b8-5fa5-4de8-bf22-b3161f7f09ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:22.493086 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36021b8-5fa5-4de8-bf22-b3161f7f09ea None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:22.493369 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36021b8-5fa5-4de8-bf22-b3161f7f09ea None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:22.493646 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36021b8-5fa5-4de8-bf22-b3161f7f09ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:22.515137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36021b8-5fa5-4de8-bf22-b3161f7f09ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:22.524976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-a36021b8-5fa5-4de8-bf22-b3161f7f09ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:25:22.524976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:22.524976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:22.524976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:22.524976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:22.524976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:22.524976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:22.524976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:22.524976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:22.524976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:22.524976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:22.524976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:22.524976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:22.524976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:22.524976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:22.524976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:22.525959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:22.525959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:22.525959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:22.525959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:22.525959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:22.525959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:22.525959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:22.525959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:22.525959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:22.525959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:22.525959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:22.525959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:22.525959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:22.525959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:22.525959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:22.525959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:22.526766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:22.526766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:22.526766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:22.526766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:22.526766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:22.526766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:22.526766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:22.526766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:22.526766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:22.526766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:22.526766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:25:22.526766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:22.526766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 112/225] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:25:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:25:22.535952 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36021b8-5fa5-4de8-bf22-b3161f7f09ea None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:22.554433 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e889cbb-c12e-46b2-b99e-824ee95c5e2d None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:22.595546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1124ddb-4852-4c4d-b9fb-6c89db74784c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:22.596312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1124ddb-4852-4c4d-b9fb-6c89db74784c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:22.596685 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1124ddb-4852-4c4d-b9fb-6c89db74784c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:22.597000 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1124ddb-4852-4c4d-b9fb-6c89db74784c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:22.610196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1124ddb-4852-4c4d-b9fb-6c89db74784c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:22.616529 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-e1124ddb-4852-4c4d-b9fb-6c89db74784c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:25:22.616529 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:22.616529 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:22.616529 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:22.616529 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:22.616529 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:22.616529 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:22.616529 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:22.616529 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:22.616529 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:22.616529 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:22.616529 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:22.616529 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:22.616529 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:22.616529 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:22.616529 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:22.618179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:22.618179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:22.618179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:22.618179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:22.618179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:22.618179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:22.618179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:22.618179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:22.618179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:22.618179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:22.618179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:22.618179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:22.618179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:22.618179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:22.618179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:22.618179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:22.619019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:22.619019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:22.619019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:22.619019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:22.619019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:22.619019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:22.619019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:22.619019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:22.619019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:22.619019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:22.619019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:25:22.619019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:25:22.619019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 114/226] 10.222.0.69 () {56 vars in 1114 bytes} [Mon Aug 29 21:25:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:22.627509 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1124ddb-4852-4c4d-b9fb-6c89db74784c None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:22.688617 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:22.715117 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36021b8-5fa5-4de8-bf22-b3161f7f09ea None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:22.764687 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b3102-ff6d-4d21-abdb-c8383f263214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:22.765694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b3102-ff6d-4d21-abdb-c8383f263214 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:22.765920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b3102-ff6d-4d21-abdb-c8383f263214 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:22.767128 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b3102-ff6d-4d21-abdb-c8383f263214 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:22.767872 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b3102-ff6d-4d21-abdb-c8383f263214 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:22.768204 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b3102-ff6d-4d21-abdb-c8383f263214 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:22.770356 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b3102-ff6d-4d21-abdb-c8383f263214 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:22.790259 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 113/227] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:22.796297 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b3102-ff6d-4d21-abdb-c8383f263214 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:22.857513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:22.896557 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1124ddb-4852-4c4d-b9fb-6c89db74784c None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:22.967122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3343f3a-8039-4084-b9b3-6e5f94d158d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:22.968559 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3343f3a-8039-4084-b9b3-6e5f94d158d9 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:22.969069 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3343f3a-8039-4084-b9b3-6e5f94d158d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:22.969534 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3343f3a-8039-4084-b9b3-6e5f94d158d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:22.969636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b3102-ff6d-4d21-abdb-c8383f263214 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:22.970498 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3343f3a-8039-4084-b9b3-6e5f94d158d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:22.971114 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3343f3a-8039-4084-b9b3-6e5f94d158d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:22.972925 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3343f3a-8039-4084-b9b3-6e5f94d158d9 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:22.995842 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 115/228] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:25:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:23.006052 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3343f3a-8039-4084-b9b3-6e5f94d158d9 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:23.043151 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7711901-6214-41e8-9925-d00f2de953ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:23.044207 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7711901-6214-41e8-9925-d00f2de953ae None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:23.044709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7711901-6214-41e8-9925-d00f2de953ae None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:23.045223 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7711901-6214-41e8-9925-d00f2de953ae None admin] PATH_INFO: `/v3/users/cab681a16fd04297a56bbd549176c66d` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:23.047211 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7711901-6214-41e8-9925-d00f2de953ae None admin] RBAC: Authorizing `identity:get_user(user_id=cab681a16fd04297a56bbd549176c66d)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:23.049060 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7711901-6214-41e8-9925-d00f2de953ae None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:23.055731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 114/229] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:22 2022] GET /identity/v3/users/cab681a16fd04297a56bbd549176c66d => generated 283 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:23.065413 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7711901-6214-41e8-9925-d00f2de953ae None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:23.141510 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:23.156703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3343f3a-8039-4084-b9b3-6e5f94d158d9 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:23.229745 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7711901-6214-41e8-9925-d00f2de953ae None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:23.230254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdc751-220a-4b81-beed-46f47c85a3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:23.230512 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdc751-220a-4b81-beed-46f47c85a3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:23.230780 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdc751-220a-4b81-beed-46f47c85a3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:23.231114 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdc751-220a-4b81-beed-46f47c85a3f3 None admin] PATH_INFO: `/v3/users/cab681a16fd04297a56bbd549176c66d` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:23.231300 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:23.232606 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cdc751-220a-4b81-beed-46f47c85a3f3 None admin] RBAC: Authorizing `identity:get_user(user_id=cab681a16fd04297a56bbd549176c66d)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:23.234584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cdc751-220a-4b81-beed-46f47c85a3f3 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:23.236725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 116/230] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:23 2022] GET /identity/v3/users/cab681a16fd04297a56bbd549176c66d => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:23.247869 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdc751-220a-4b81-beed-46f47c85a3f3 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:23.332992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75761cb-5c43-4584-808a-c1774e6e71ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:23.333876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75761cb-5c43-4584-808a-c1774e6e71ea None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:23.334318 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75761cb-5c43-4584-808a-c1774e6e71ea None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:23.334737 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75761cb-5c43-4584-808a-c1774e6e71ea None admin] PATH_INFO: `/v3/projects/5e57c96553df40ff975ec73f2b01cda6` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:23.337920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75761cb-5c43-4584-808a-c1774e6e71ea None admin] RBAC: Authorizing `identity:get_project(project_id=5e57c96553df40ff975ec73f2b01cda6)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:23.339617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75761cb-5c43-4584-808a-c1774e6e71ea None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:23.341538 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 115/231] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:23 2022] GET /identity/v3/projects/5e57c96553df40ff975ec73f2b01cda6 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:23.353346 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75761cb-5c43-4584-808a-c1774e6e71ea None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:23.396944 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdc751-220a-4b81-beed-46f47c85a3f3 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:23.440937 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc30957-937c-4eb0-bad3-3bc826e41b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:23.441998 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc30957-937c-4eb0-bad3-3bc826e41b12 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:23.442426 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc30957-937c-4eb0-bad3-3bc826e41b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:23.442869 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc30957-937c-4eb0-bad3-3bc826e41b12 None admin] PATH_INFO: `/v3/projects/5e57c96553df40ff975ec73f2b01cda6` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:23.444949 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc30957-937c-4eb0-bad3-3bc826e41b12 None admin] RBAC: Authorizing `identity:get_project(project_id=5e57c96553df40ff975ec73f2b01cda6)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:23.446815 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc30957-937c-4eb0-bad3-3bc826e41b12 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:23.450150 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 117/232] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:23 2022] GET /identity/v3/projects/5e57c96553df40ff975ec73f2b01cda6 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:23.458308 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc30957-937c-4eb0-bad3-3bc826e41b12 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:23.512618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:23.563203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75761cb-5c43-4584-808a-c1774e6e71ea None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:23.605231 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7f8c4-1210-4745-a784-832a028ef3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:23.606271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7f8c4-1210-4745-a784-832a028ef3c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:23.606745 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7f8c4-1210-4745-a784-832a028ef3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:23.607231 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7f8c4-1210-4745-a784-832a028ef3c5 None admin] PATH_INFO: `/v3/projects/5e57c96553df40ff975ec73f2b01cda6/users/cab681a16fd04297a56bbd549176c66d/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:23.609790 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7f8c4-1210-4745-a784-832a028ef3c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e57c96553df40ff975ec73f2b01cda6, user_id=cab681a16fd04297a56bbd549176c66d, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:23.611818 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7f8c4-1210-4745-a784-832a028ef3c5 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:23.630073 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 116/233] 10.222.0.69 () {58 vars in 1439 bytes} [Mon Aug 29 21:25:23 2022] PUT /identity/v3/projects/5e57c96553df40ff975ec73f2b01cda6/users/cab681a16fd04297a56bbd549176c66d/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:25:23.672761 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc30957-937c-4eb0-bad3-3bc826e41b12 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:23.730442 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8b9e2-6c59-494f-9937-5baac3c14327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:23.731144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8b9e2-6c59-494f-9937-5baac3c14327 None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:23.731426 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8b9e2-6c59-494f-9937-5baac3c14327 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:23.731704 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8b9e2-6c59-494f-9937-5baac3c14327 None admin] PATH_INFO: `/v3/projects/5e57c96553df40ff975ec73f2b01cda6/users/cab681a16fd04297a56bbd549176c66d/roles/ecbc0b9f55214a93a2016b3625d94764` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:23.734155 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8b9e2-6c59-494f-9937-5baac3c14327 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e57c96553df40ff975ec73f2b01cda6, user_id=cab681a16fd04297a56bbd549176c66d, role_id=ecbc0b9f55214a93a2016b3625d94764)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:23.735678 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8b9e2-6c59-494f-9937-5baac3c14327 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:23.767026 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 118/234] 10.222.0.69 () {58 vars in 1439 bytes} [Mon Aug 29 21:25:23 2022] PUT /identity/v3/projects/5e57c96553df40ff975ec73f2b01cda6/users/cab681a16fd04297a56bbd549176c66d/roles/ecbc0b9f55214a93a2016b3625d94764 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:25:24.329735 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e435726-5bbc-4a35-a333-415af8e12e65 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:24.330232 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e435726-5bbc-4a35-a333-415af8e12e65 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:24.330337 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e435726-5bbc-4a35-a333-415af8e12e65 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:24.332157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 117/235] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:24.338242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caa054-006e-43d1-abcf-ed8a48659eba None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:24.338729 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caa054-006e-43d1-abcf-ed8a48659eba None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:24.338992 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caa054-006e-43d1-abcf-ed8a48659eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:24.362918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-e6caa054-006e-43d1-abcf-ed8a48659eba None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:24.364133 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e6caa054-006e-43d1-abcf-ed8a48659eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:24.452354 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 119/236] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:24.483634 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28570c0a-8d00-4ba8-b0ec-fa2bd8032141 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:24.483807 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28570c0a-8d00-4ba8-b0ec-fa2bd8032141 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:24.484086 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28570c0a-8d00-4ba8-b0ec-fa2bd8032141 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:24.485515 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 118/237] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:24.491397 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c880943-ad62-491b-87d8-7b48afe37259 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:24.491675 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c880943-ad62-491b-87d8-7b48afe37259 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:24.491952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c880943-ad62-491b-87d8-7b48afe37259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:24.520795 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-1c880943-ad62-491b-87d8-7b48afe37259 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:24.522057 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1c880943-ad62-491b-87d8-7b48afe37259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:24.535052 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:24.606765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 120/238] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:24.926847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28570c0a-8d00-4ba8-b0ec-fa2bd8032141 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:24.959998 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:24.975693 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c880943-ad62-491b-87d8-7b48afe37259 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:25.055660 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28570c0a-8d00-4ba8-b0ec-fa2bd8032141 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:25.111456 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437dc9f-6e59-490d-802b-9027a5711596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:25.112113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437dc9f-6e59-490d-802b-9027a5711596 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:25.112424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437dc9f-6e59-490d-802b-9027a5711596 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:25.112703 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437dc9f-6e59-490d-802b-9027a5711596 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:25.114461 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437dc9f-6e59-490d-802b-9027a5711596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:25.117050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437dc9f-6e59-490d-802b-9027a5711596 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:25.124291 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 119/239] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:25:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:25.127879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c483e-1bd5-44d1-bcdf-dfe14bb42dc6 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:25.128168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c483e-1bd5-44d1-bcdf-dfe14bb42dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:25.128475 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c483e-1bd5-44d1-bcdf-dfe14bb42dc6 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:25.130478 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 120/240] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:25.131725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c483e-1bd5-44d1-bcdf-dfe14bb42dc6 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:25.134865 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c880943-ad62-491b-87d8-7b48afe37259 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:25.189454 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfdd9b-e35f-4d8c-ba19-a49b797204cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:25.190048 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfdd9b-e35f-4d8c-ba19-a49b797204cb None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:25.190331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfdd9b-e35f-4d8c-ba19-a49b797204cb None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:25.190609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfdd9b-e35f-4d8c-ba19-a49b797204cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:25.210091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfdd9b-e35f-4d8c-ba19-a49b797204cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:25.217149 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-2ccfdd9b-e35f-4d8c-ba19-a49b797204cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:25:25.217149 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:25.217149 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:25.217149 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:25.217149 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:25.217149 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:25.217149 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:25.217149 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:25.217149 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:25.217149 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:25.217149 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:25.217149 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:25.217149 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:25.217149 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:25.217149 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:25.217149 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:25.218146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:25.218146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:25.218146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:25.218146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:25.218146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:25.218146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:25.218146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:25.218146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:25.218146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:25.218146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:25.218146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:25.218146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:25.218146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:25.218146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:25.218146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:25.218146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:25.219367 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:25.219367 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:25.219367 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:25.219367 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:25.219367 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:25.219367 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:25.219367 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:25.219367 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:25.219367 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:25.219367 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:25.219367 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:25:25.219367 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:25:25.224394 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 121/241] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:25:25.225481 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff2fd7-3edd-4635-80f6-4d444f925a28 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:25.225593 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff2fd7-3edd-4635-80f6-4d444f925a28 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:25.225904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff2fd7-3edd-4635-80f6-4d444f925a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:25.246135 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:25.255806 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-dfff2fd7-3edd-4635-80f6-4d444f925a28 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:25.257711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-dfff2fd7-3edd-4635-80f6-4d444f925a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:25.307716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:25.325088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c483e-1bd5-44d1-bcdf-dfe14bb42dc6 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:25.370147 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 122/242] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:25.371445 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff2fd7-3edd-4635-80f6-4d444f925a28 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:25.385154 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc7c94-d02a-452e-893f-a20f54bea3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:25.388170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc7c94-d02a-452e-893f-a20f54bea3e4 None admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:25.388948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc7c94-d02a-452e-893f-a20f54bea3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:25.389438 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc7c94-d02a-452e-893f-a20f54bea3e4 None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:25.390421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc7c94-d02a-452e-893f-a20f54bea3e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:25.393783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc7c94-d02a-452e-893f-a20f54bea3e4 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:25.427271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 121/243] 10.222.0.69 () {60 vars in 1132 bytes} [Mon Aug 29 21:25:25 2022] POST /identity/v3/users => generated 293 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:25:25.530535 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff2fd7-3edd-4635-80f6-4d444f925a28 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:25.573805 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ad0fa-c095-4528-aca0-3f43b30ec98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:25.574481 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ad0fa-c095-4528-aca0-3f43b30ec98b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:25.574781 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ad0fa-c095-4528-aca0-3f43b30ec98b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:25.575298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ad0fa-c095-4528-aca0-3f43b30ec98b None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:25.576117 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ad0fa-c095-4528-aca0-3f43b30ec98b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:25.576458 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ad0fa-c095-4528-aca0-3f43b30ec98b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:25.578000 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ad0fa-c095-4528-aca0-3f43b30ec98b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:25.580770 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:25.590216 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 123/244] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:25.596059 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc7c94-d02a-452e-893f-a20f54bea3e4 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:25.724760 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc7c94-d02a-452e-893f-a20f54bea3e4 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:25.767713 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04089b4b-b1f8-44f8-ba2b-878995f82400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:25.768597 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04089b4b-b1f8-44f8-ba2b-878995f82400 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:25.768901 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04089b4b-b1f8-44f8-ba2b-878995f82400 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:25.769248 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04089b4b-b1f8-44f8-ba2b-878995f82400 None admin] PATH_INFO: `/v3/users/4489799349254058960c0e75dd43d7fb` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:25.786928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04089b4b-b1f8-44f8-ba2b-878995f82400 None admin] RBAC: Authorizing `identity:get_user(user_id=4489799349254058960c0e75dd43d7fb)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:25.788362 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04089b4b-b1f8-44f8-ba2b-878995f82400 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:25.794974 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 122/245] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:25 2022] GET /identity/v3/users/4489799349254058960c0e75dd43d7fb => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:25.796433 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ad0fa-c095-4528-aca0-3f43b30ec98b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:25.817409 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04089b4b-b1f8-44f8-ba2b-878995f82400 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:25.834880 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:25.936478 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04089b4b-b1f8-44f8-ba2b-878995f82400 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:25.977509 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4999ff-66ab-442b-a9c0-9b71ffd325df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:25.978422 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4999ff-66ab-442b-a9c0-9b71ffd325df None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:25.978699 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4999ff-66ab-442b-a9c0-9b71ffd325df None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:25.978971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4999ff-66ab-442b-a9c0-9b71ffd325df None admin] PATH_INFO: `/v3/roles/member` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:25.991325 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4999ff-66ab-442b-a9c0-9b71ffd325df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:25.997215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-fd4999ff-66ab-442b-a9c0-9b71ffd325df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:25.997215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:25.997215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:25.997215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:25.997215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:25.997215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:25.997215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:25.997215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:25.997215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:25.997215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:25.997215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:25.997215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:25.997215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:25.997215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:25.997215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:25.997215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:25.998122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:25.998122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:25.998122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:25.998122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:25.998122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:25.998122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:25.998122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:25.998122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:25.998122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:25.998122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:25.998122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:25.998122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:25.998122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:25.998122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:25.998122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:25.998122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:25.998920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:25.998920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:25.998920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:25.998920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:25.998920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:25.998920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:25.998920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:25.998920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:25.998920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:25.998920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:25.998920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:25.998920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:25.998920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 123/246] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:25:25.999595 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ad0fa-c095-4528-aca0-3f43b30ec98b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:26.004709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4999ff-66ab-442b-a9c0-9b71ffd325df None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:26.066939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c4241-15e4-415e-82b6-a12f041a3f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:26.067910 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c4241-15e4-415e-82b6-a12f041a3f24 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:26.068421 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c4241-15e4-415e-82b6-a12f041a3f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:26.068899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c4241-15e4-415e-82b6-a12f041a3f24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:26.108872 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:26.131721 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4999ff-66ab-442b-a9c0-9b71ffd325df None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:26.175312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88d7eb-38aa-40f9-8cb0-b5f77472fe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:26.176420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88d7eb-38aa-40f9-8cb0-b5f77472fe05 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:26.176754 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88d7eb-38aa-40f9-8cb0-b5f77472fe05 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:26.177190 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88d7eb-38aa-40f9-8cb0-b5f77472fe05 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:26.177903 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88d7eb-38aa-40f9-8cb0-b5f77472fe05 None admin] RBAC: Adding query filter params (name=member) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:26.178408 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88d7eb-38aa-40f9-8cb0-b5f77472fe05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:26.181214 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88d7eb-38aa-40f9-8cb0-b5f77472fe05 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:26.193920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 124/247] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:26.199698 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:26.201075 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88d7eb-38aa-40f9-8cb0-b5f77472fe05 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:26.214359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c4241-15e4-415e-82b6-a12f041a3f24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:26.217093 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c4241-15e4-415e-82b6-a12f041a3f24 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:26.332247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88d7eb-38aa-40f9-8cb0-b5f77472fe05 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:26.381196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 124/248] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:25:26.383464 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fc80b-5970-464b-9fe4-6f5a42b16d50 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:26.383912 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef4d0f-532c-48cf-8a8d-bf60f5a00b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:26.384117 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fc80b-5970-464b-9fe4-6f5a42b16d50 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:26.384580 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fc80b-5970-464b-9fe4-6f5a42b16d50 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:26.384796 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef4d0f-532c-48cf-8a8d-bf60f5a00b48 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:26.385154 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef4d0f-532c-48cf-8a8d-bf60f5a00b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:26.385496 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef4d0f-532c-48cf-8a8d-bf60f5a00b48 None admin] PATH_INFO: `/v3/users/9b261e4283de462a8aabc86d59c511f2` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:26.386763 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef4d0f-532c-48cf-8a8d-bf60f5a00b48 None admin] RBAC: Authorizing `identity:get_user(user_id=9b261e4283de462a8aabc86d59c511f2)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:26.387182 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 125/249] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:26.388712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef4d0f-532c-48cf-8a8d-bf60f5a00b48 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:26.390430 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 125/250] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:26 2022] GET /identity/v3/users/9b261e4283de462a8aabc86d59c511f2 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:26.392393 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7696c-d659-413d-9884-b0b20ca8a364 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:26.392589 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef4d0f-532c-48cf-8a8d-bf60f5a00b48 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:26.392703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7696c-d659-413d-9884-b0b20ca8a364 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:26.393084 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7696c-d659-413d-9884-b0b20ca8a364 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:26.394674 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 126/251] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:26.395394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:26.397036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bcddd-ce47-4739-800f-dcf317176bbd None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:26.397550 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bcddd-ce47-4739-800f-dcf317176bbd None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:26.397674 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bcddd-ce47-4739-800f-dcf317176bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:26.421276 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-2a6bcddd-ce47-4739-800f-dcf317176bbd None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:26.422486 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2a6bcddd-ce47-4739-800f-dcf317176bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:26.520108 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 127/252] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:26.524699 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bcddd-ce47-4739-800f-dcf317176bbd None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:26.527113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef4d0f-532c-48cf-8a8d-bf60f5a00b48 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:26.577432 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:26.600554 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f9b40-cd18-46c3-864f-ac074f336a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:26.601123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f9b40-cd18-46c3-864f-ac074f336a00 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:26.601407 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f9b40-cd18-46c3-864f-ac074f336a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:26.601688 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f9b40-cd18-46c3-864f-ac074f336a00 None admin] PATH_INFO: `/v3/projects/5e57c96553df40ff975ec73f2b01cda6` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:26.604476 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f9b40-cd18-46c3-864f-ac074f336a00 None admin] RBAC: Authorizing `identity:get_project(project_id=5e57c96553df40ff975ec73f2b01cda6)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:26.605959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f9b40-cd18-46c3-864f-ac074f336a00 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:26.608771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 126/253] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:26 2022] GET /identity/v3/projects/5e57c96553df40ff975ec73f2b01cda6 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:26.609971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738211e-26f8-4df0-86c0-a03be80173f4 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:26.610254 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738211e-26f8-4df0-86c0-a03be80173f4 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:26.611336 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738211e-26f8-4df0-86c0-a03be80173f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:26.644766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-0738211e-26f8-4df0-86c0-a03be80173f4 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:26.648430 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-0738211e-26f8-4df0-86c0-a03be80173f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:26.707091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bcddd-ce47-4739-800f-dcf317176bbd None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:26.761979 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:26.767663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 127/254] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:26.768588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738211e-26f8-4df0-86c0-a03be80173f4 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:26.779456 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b222e22-e4a3-4430-9644-89ffaa99c159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:26.780120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b222e22-e4a3-4430-9644-89ffaa99c159 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:26.780429 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b222e22-e4a3-4430-9644-89ffaa99c159 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:26.780706 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b222e22-e4a3-4430-9644-89ffaa99c159 None admin] PATH_INFO: `/v3/projects/5e57c96553df40ff975ec73f2b01cda6` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:26.781853 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b222e22-e4a3-4430-9644-89ffaa99c159 None admin] RBAC: Authorizing `identity:get_project(project_id=5e57c96553df40ff975ec73f2b01cda6)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:26.783309 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b222e22-e4a3-4430-9644-89ffaa99c159 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:26.793357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 128/255] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:26 2022] GET /identity/v3/projects/5e57c96553df40ff975ec73f2b01cda6 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:26.799760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b222e22-e4a3-4430-9644-89ffaa99c159 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:26.968532 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738211e-26f8-4df0-86c0-a03be80173f4 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:26.980825 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:26.988403 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b222e22-e4a3-4430-9644-89ffaa99c159 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:27.034837 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f961aa6-81e4-4c52-a5bc-c620810f9d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:27.035460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f961aa6-81e4-4c52-a5bc-c620810f9d7c None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:27.035740 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f961aa6-81e4-4c52-a5bc-c620810f9d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:27.036018 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f961aa6-81e4-4c52-a5bc-c620810f9d7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:27.036779 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f961aa6-81e4-4c52-a5bc-c620810f9d7c None admin] RBAC: Adding query filter params (role.id=1047d24970f744c38f38ecc563f0f61d, scope.project.id=5e57c96553df40ff975ec73f2b01cda6, user.id=4489799349254058960c0e75dd43d7fb) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:27.037093 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f961aa6-81e4-4c52-a5bc-c620810f9d7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:27.039810 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f961aa6-81e4-4c52-a5bc-c620810f9d7c None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:27.050522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 128/256] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:25:26 2022] GET /identity/v3/role_assignments?user.id=4489799349254058960c0e75dd43d7fb&scope.project.id=5e57c96553df40ff975ec73f2b01cda6&role.id=1047d24970f744c38f38ecc563f0f61d => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:27.051371 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f961aa6-81e4-4c52-a5bc-c620810f9d7c None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:27.058040 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc82b9d-33dd-4369-9f8e-032ceb3dd367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:27.058740 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc82b9d-33dd-4369-9f8e-032ceb3dd367 None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:27.059019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc82b9d-33dd-4369-9f8e-032ceb3dd367 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:27.059290 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc82b9d-33dd-4369-9f8e-032ceb3dd367 None admin] PATH_INFO: `/v3/projects/5e57c96553df40ff975ec73f2b01cda6/users/9b261e4283de462a8aabc86d59c511f2/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:27.062512 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc82b9d-33dd-4369-9f8e-032ceb3dd367 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e57c96553df40ff975ec73f2b01cda6, user_id=9b261e4283de462a8aabc86d59c511f2, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:27.064004 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc82b9d-33dd-4369-9f8e-032ceb3dd367 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:27.094621 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 129/257] 10.222.0.69 () {58 vars in 1439 bytes} [Mon Aug 29 21:25:26 2022] PUT /identity/v3/projects/5e57c96553df40ff975ec73f2b01cda6/users/9b261e4283de462a8aabc86d59c511f2/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:25:27.151418 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc82b9d-33dd-4369-9f8e-032ceb3dd367 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:27.179347 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:27.264930 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f961aa6-81e4-4c52-a5bc-c620810f9d7c None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:27.305735 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4f4d1-1a12-4abb-969a-3ded2390e819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:27.306401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4f4d1-1a12-4abb-969a-3ded2390e819 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:27.306680 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4f4d1-1a12-4abb-969a-3ded2390e819 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:27.306951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4f4d1-1a12-4abb-969a-3ded2390e819 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:27.327789 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4f4d1-1a12-4abb-969a-3ded2390e819 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:27.333663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-3ca4f4d1-1a12-4abb-969a-3ded2390e819 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:25:27.333663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:27.333663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:27.333663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:27.333663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:27.333663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:27.333663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:27.333663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:27.333663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:27.333663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:27.333663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:27.333663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:27.333663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:27.333663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:27.333663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:27.333663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:27.334638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:27.334638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:27.334638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:27.334638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:27.334638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:27.334638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:27.334638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:27.334638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:27.334638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:27.334638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:27.334638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:27.334638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:27.334638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:27.334638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:27.334638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:27.334638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:27.335440 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:27.335440 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:27.335440 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:27.335440 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:27.335440 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:27.335440 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:27.335440 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:27.335440 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:27.335440 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:27.335440 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:27.335440 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:25:27.335440 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:27.340703 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 129/258] 10.222.0.69 () {56 vars in 1114 bytes} [Mon Aug 29 21:25:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:27.346403 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4f4d1-1a12-4abb-969a-3ded2390e819 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:27.349718 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc82b9d-33dd-4369-9f8e-032ceb3dd367 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:27.394263 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a4150-2a9e-4bea-abb1-9c6de5ea8c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:27.395782 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a4150-2a9e-4bea-abb1-9c6de5ea8c80 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:27.396425 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a4150-2a9e-4bea-abb1-9c6de5ea8c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:27.396910 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a4150-2a9e-4bea-abb1-9c6de5ea8c80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:27.410726 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a4150-2a9e-4bea-abb1-9c6de5ea8c80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:27.417111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-a48a4150-2a9e-4bea-abb1-9c6de5ea8c80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:25:27.417111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:27.417111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:27.417111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:27.417111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:27.417111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:27.417111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:27.417111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:27.417111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:27.417111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:27.417111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:27.417111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:27.417111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:27.417111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:27.417111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:27.417111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:27.418094 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:27.418094 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:27.418094 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:27.418094 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:27.418094 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:27.418094 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:27.418094 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:27.418094 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:27.418094 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:27.418094 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:27.418094 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:27.418094 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:27.418094 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:27.418094 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:27.418094 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:27.418094 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:27.418899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:27.418899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:27.418899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:27.418899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:27.418899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:27.418899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:27.418899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:27.418899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:27.418899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:27.418899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:27.418899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:25:27.418899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:25:27.421714 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 130/259] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:25:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:25:27.427905 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a4150-2a9e-4bea-abb1-9c6de5ea8c80 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:27.460794 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:27.529294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4f4d1-1a12-4abb-969a-3ded2390e819 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:27.587960 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a4150-2a9e-4bea-abb1-9c6de5ea8c80 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:27.601531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:27.630208 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d617b-01b2-4f26-836a-2269821ad789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:27.630812 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d617b-01b2-4f26-836a-2269821ad789 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:27.631095 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d617b-01b2-4f26-836a-2269821ad789 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:27.631369 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d617b-01b2-4f26-836a-2269821ad789 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:27.632032 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d617b-01b2-4f26-836a-2269821ad789 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:27.632366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d617b-01b2-4f26-836a-2269821ad789 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:27.633767 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d617b-01b2-4f26-836a-2269821ad789 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:27.643000 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 131/260] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:27.644000 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6f9b0-96f3-43bd-b6cc-f48680caf02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:27.644891 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6f9b0-96f3-43bd-b6cc-f48680caf02f None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:27.645387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6f9b0-96f3-43bd-b6cc-f48680caf02f None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:27.645853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6f9b0-96f3-43bd-b6cc-f48680caf02f None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:27.646728 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6f9b0-96f3-43bd-b6cc-f48680caf02f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:27.647225 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6f9b0-96f3-43bd-b6cc-f48680caf02f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:27.648903 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6f9b0-96f3-43bd-b6cc-f48680caf02f None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:27.651704 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d617b-01b2-4f26-836a-2269821ad789 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:27.658276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 130/261] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:25:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:27.665864 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6f9b0-96f3-43bd-b6cc-f48680caf02f None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:27.750478 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:27.789199 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d617b-01b2-4f26-836a-2269821ad789 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:27.826453 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcefeb1-c387-44bf-b8b8-4de888c73fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:27.827098 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcefeb1-c387-44bf-b8b8-4de888c73fbe None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:27.827374 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcefeb1-c387-44bf-b8b8-4de888c73fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:27.827647 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcefeb1-c387-44bf-b8b8-4de888c73fbe None admin] PATH_INFO: `/v3/users/cab681a16fd04297a56bbd549176c66d` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:27.828954 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcefeb1-c387-44bf-b8b8-4de888c73fbe None admin] RBAC: Authorizing `identity:get_user(user_id=cab681a16fd04297a56bbd549176c66d)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:27.830534 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcefeb1-c387-44bf-b8b8-4de888c73fbe None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:27.832749 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 132/262] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:27 2022] GET /identity/v3/users/cab681a16fd04297a56bbd549176c66d => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:27.841885 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcefeb1-c387-44bf-b8b8-4de888c73fbe None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:27.906700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6f9b0-96f3-43bd-b6cc-f48680caf02f None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:27.967619 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319301e8-8ea0-48f0-9c47-59acd7f8b9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:27.968944 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319301e8-8ea0-48f0-9c47-59acd7f8b9c9 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:27.969433 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319301e8-8ea0-48f0-9c47-59acd7f8b9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:27.969902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319301e8-8ea0-48f0-9c47-59acd7f8b9c9 None admin] PATH_INFO: `/v3/users/cab681a16fd04297a56bbd549176c66d` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:27.971892 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319301e8-8ea0-48f0-9c47-59acd7f8b9c9 None admin] RBAC: Authorizing `identity:get_user(user_id=cab681a16fd04297a56bbd549176c66d)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:27.973825 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319301e8-8ea0-48f0-9c47-59acd7f8b9c9 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:27.976283 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 131/263] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:27 2022] GET /identity/v3/users/cab681a16fd04297a56bbd549176c66d => generated 283 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:27.983175 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319301e8-8ea0-48f0-9c47-59acd7f8b9c9 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:27.999977 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcefeb1-c387-44bf-b8b8-4de888c73fbe None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:28.074696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d6b4c-88cd-4cb7-9cf4-85d91a99599a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:28.075248 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d6b4c-88cd-4cb7-9cf4-85d91a99599a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:28.075527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d6b4c-88cd-4cb7-9cf4-85d91a99599a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:28.075794 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d6b4c-88cd-4cb7-9cf4-85d91a99599a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:28.100363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:28.113630 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:28.191022 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319301e8-8ea0-48f0-9c47-59acd7f8b9c9 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:28.226811 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d6b4c-88cd-4cb7-9cf4-85d91a99599a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:28.229189 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d6b4c-88cd-4cb7-9cf4-85d91a99599a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:28.269538 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ba792-5035-4252-97f5-8e3bbefbf4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:28.270872 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ba792-5035-4252-97f5-8e3bbefbf4d2 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:28.271671 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ba792-5035-4252-97f5-8e3bbefbf4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:28.272216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ba792-5035-4252-97f5-8e3bbefbf4d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:28.410032 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 133/264] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:25:28.412888 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ba792-5035-4252-97f5-8e3bbefbf4d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:28.415007 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ba792-5035-4252-97f5-8e3bbefbf4d2 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:28.418140 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d6b4c-88cd-4cb7-9cf4-85d91a99599a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:28.517125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:28.543180 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:28.580132 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d6b4c-88cd-4cb7-9cf4-85d91a99599a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:28.619427 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 132/265] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 21:25:28.625313 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ba792-5035-4252-97f5-8e3bbefbf4d2 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:28.645022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a8a71-e84a-4b9a-a5a7-b559a602b6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:28.646653 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a8a71-e84a-4b9a-a5a7-b559a602b6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:28.647415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a8a71-e84a-4b9a-a5a7-b559a602b6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:28.648150 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a8a71-e84a-4b9a-a5a7-b559a602b6a9 None admin] PATH_INFO: `/v3/projects/5e57c96553df40ff975ec73f2b01cda6` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:28.650833 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a8a71-e84a-4b9a-a5a7-b559a602b6a9 None admin] RBAC: Authorizing `identity:get_project(project_id=5e57c96553df40ff975ec73f2b01cda6)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:28.653766 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a8a71-e84a-4b9a-a5a7-b559a602b6a9 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:28.657504 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 134/266] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:28 2022] GET /identity/v3/projects/5e57c96553df40ff975ec73f2b01cda6 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:28.667028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a8a71-e84a-4b9a-a5a7-b559a602b6a9 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:28.869780 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a8a71-e84a-4b9a-a5a7-b559a602b6a9 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:28.906168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ba792-5035-4252-97f5-8e3bbefbf4d2 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:28.908651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:28.944682 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424da0e1-e8fc-4f94-9e44-0664afdf2184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:28.946312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424da0e1-e8fc-4f94-9e44-0664afdf2184 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:28.946807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424da0e1-e8fc-4f94-9e44-0664afdf2184 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:28.947291 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424da0e1-e8fc-4f94-9e44-0664afdf2184 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:28.948690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424da0e1-e8fc-4f94-9e44-0664afdf2184 None admin] RBAC: Adding query filter params (role.id=69369872661e4179bb51cd1ca76e28c3, scope.project.id=5e57c96553df40ff975ec73f2b01cda6, user.id=cab681a16fd04297a56bbd549176c66d) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:28.949441 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424da0e1-e8fc-4f94-9e44-0664afdf2184 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:28.952372 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424da0e1-e8fc-4f94-9e44-0664afdf2184 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:28.968749 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 135/267] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:25:28 2022] GET /identity/v3/role_assignments?user.id=cab681a16fd04297a56bbd549176c66d&scope.project.id=5e57c96553df40ff975ec73f2b01cda6&role.id=69369872661e4179bb51cd1ca76e28c3 => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:28.981997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc259cce-93f0-4a55-a36b-247bed1f9d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:28.982669 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc259cce-93f0-4a55-a36b-247bed1f9d06 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:28.982950 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc259cce-93f0-4a55-a36b-247bed1f9d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:28.983227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc259cce-93f0-4a55-a36b-247bed1f9d06 None admin] PATH_INFO: `/v3/projects/5e57c96553df40ff975ec73f2b01cda6` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:28.989124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc259cce-93f0-4a55-a36b-247bed1f9d06 None admin] RBAC: Authorizing `identity:get_project(project_id=5e57c96553df40ff975ec73f2b01cda6)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:28.990625 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc259cce-93f0-4a55-a36b-247bed1f9d06 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:28.993920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 133/268] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:28 2022] GET /identity/v3/projects/5e57c96553df40ff975ec73f2b01cda6 => generated 302 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:29.001290 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424da0e1-e8fc-4f94-9e44-0664afdf2184 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:29.220581 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424da0e1-e8fc-4f94-9e44-0664afdf2184 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:29.225787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65e5b6-4efd-4c6a-a618-6620ffdc8c3b None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:29.226194 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65e5b6-4efd-4c6a-a618-6620ffdc8c3b None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:29.226374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65e5b6-4efd-4c6a-a618-6620ffdc8c3b None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:29.228965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 134/269] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:29.243173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a8397-c957-4904-ab37-25f806316881 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:29.243461 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a8397-c957-4904-ab37-25f806316881 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:29.243763 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a8397-c957-4904-ab37-25f806316881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:29.288893 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a623f7a-e157-413c-ac90-582fb1ddabb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:29.290545 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a623f7a-e157-413c-ac90-582fb1ddabb5 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:29.291051 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a623f7a-e157-413c-ac90-582fb1ddabb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:29.291608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a623f7a-e157-413c-ac90-582fb1ddabb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:29.292309 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-c20a8397-c957-4904-ab37-25f806316881 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:29.293030 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a623f7a-e157-413c-ac90-582fb1ddabb5 None admin] RBAC: Adding query filter params (role.id=ecbc0b9f55214a93a2016b3625d94764, scope.project.id=5e57c96553df40ff975ec73f2b01cda6, user.id=cab681a16fd04297a56bbd549176c66d) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:29.293596 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a623f7a-e157-413c-ac90-582fb1ddabb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:29.294201 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-c20a8397-c957-4904-ab37-25f806316881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:29.296393 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a623f7a-e157-413c-ac90-582fb1ddabb5 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:29.309902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 136/270] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:25:28 2022] GET /identity/v3/role_assignments?user.id=cab681a16fd04297a56bbd549176c66d&scope.project.id=5e57c96553df40ff975ec73f2b01cda6&role.id=ecbc0b9f55214a93a2016b3625d94764 => generated 608 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:29.316046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff70802-f0da-430c-968f-4e82722fcaf4 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:29.316046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff70802-f0da-430c-968f-4e82722fcaf4 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:29.316046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff70802-f0da-430c-968f-4e82722fcaf4 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:29.316046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 137/271] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:29.325730 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826830e-4013-4c20-a7a3-0fe445f604e5 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:29.326018 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826830e-4013-4c20-a7a3-0fe445f604e5 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:29.326441 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826830e-4013-4c20-a7a3-0fe445f604e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:29.331667 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:29.350266 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-0826830e-4013-4c20-a7a3-0fe445f604e5 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:29.352553 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0826830e-4013-4c20-a7a3-0fe445f604e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:29.397612 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:29.441897 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 138/272] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:29.452314 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 135/273] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:25:29.775234 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826830e-4013-4c20-a7a3-0fe445f604e5 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:29.802222 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a8397-c957-4904-ab37-25f806316881 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:29.929020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826830e-4013-4c20-a7a3-0fe445f604e5 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:29.956825 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a8397-c957-4904-ab37-25f806316881 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:29.972493 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b1c0b-348a-47a4-a942-e9a7e4f03133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:29.973706 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b1c0b-348a-47a4-a942-e9a7e4f03133 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:29.974185 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b1c0b-348a-47a4-a942-e9a7e4f03133 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:29.974649 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b1c0b-348a-47a4-a942-e9a7e4f03133 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:29.976012 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b1c0b-348a-47a4-a942-e9a7e4f03133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:29.978518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b1c0b-348a-47a4-a942-e9a7e4f03133 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:29.980407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 139/274] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:25:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:29.986521 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b1c0b-348a-47a4-a942-e9a7e4f03133 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:30.003609 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e637927-564c-42c8-8454-a8291b1059f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:30.004399 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e637927-564c-42c8-8454-a8291b1059f0 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:30.004693 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e637927-564c-42c8-8454-a8291b1059f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:30.004972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e637927-564c-42c8-8454-a8291b1059f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:30.019574 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e637927-564c-42c8-8454-a8291b1059f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:30.027387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-6e637927-564c-42c8-8454-a8291b1059f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:30.027387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:30.027387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:30.027387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:30.027387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:30.027387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:30.027387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:30.027387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:30.027387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:30.027387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:30.027387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:30.027387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:30.027387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:30.027387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:30.027387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:30.027387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:30.028349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:30.028349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:30.028349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:30.028349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:30.028349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:30.028349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:30.028349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:30.028349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:30.028349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:30.028349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:30.028349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:30.028349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:30.028349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:30.028349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:30.028349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:30.028349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:30.029794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:30.029794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:30.029794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:30.029794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:30.029794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:30.029794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:30.029794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:30.029794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:30.029794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:30.029794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:30.029794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:30.029794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:30.029794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 136/275] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:30.034150 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e637927-564c-42c8-8454-a8291b1059f0 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:30.050350 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:30.056489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:30.121096 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b1c0b-348a-47a4-a942-e9a7e4f03133 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:30.161433 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92c93a-201c-4933-b463-bf5f71a2489f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:30.162278 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92c93a-201c-4933-b463-bf5f71a2489f None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:30.162620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92c93a-201c-4933-b463-bf5f71a2489f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:30.162958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92c93a-201c-4933-b463-bf5f71a2489f None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:30.163096 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e637927-564c-42c8-8454-a8291b1059f0 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:30.163894 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92c93a-201c-4933-b463-bf5f71a2489f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:30.165860 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92c93a-201c-4933-b463-bf5f71a2489f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:30.193002 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 140/276] 10.222.0.69 () {60 vars in 1132 bytes} [Mon Aug 29 21:25:29 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:25:30.194471 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05057d-ecff-40c5-b0d4-2a5d4a189b9d None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:30.195061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05057d-ecff-40c5-b0d4-2a5d4a189b9d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:30.195189 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05057d-ecff-40c5-b0d4-2a5d4a189b9d None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:30.196876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 141/277] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:30.202418 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfc396-6d95-49bc-9f5e-dafe1873a125 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:30.202763 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfc396-6d95-49bc-9f5e-dafe1873a125 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:30.203124 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfc396-6d95-49bc-9f5e-dafe1873a125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:30.226196 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c5690-e383-4ac8-8472-51f8fad9c53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:30.227584 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c5690-e383-4ac8-8472-51f8fad9c53b None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:30.228018 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c5690-e383-4ac8-8472-51f8fad9c53b None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:30.228702 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c5690-e383-4ac8-8472-51f8fad9c53b None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:30.229509 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c5690-e383-4ac8-8472-51f8fad9c53b None admin] RBAC: Adding query filter params (name=member) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:30.229917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c5690-e383-4ac8-8472-51f8fad9c53b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:30.231905 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c5690-e383-4ac8-8472-51f8fad9c53b None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:30.232448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-03dfc396-6d95-49bc-9f5e-dafe1873a125 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:30.233768 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-03dfc396-6d95-49bc-9f5e-dafe1873a125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:30.246108 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 137/278] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:30.252982 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c5690-e383-4ac8-8472-51f8fad9c53b None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:30.321167 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 142/279] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:25:30.322621 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f6a94-1adf-42d0-a77a-acf1b687b52e None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:30.322916 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f6a94-1adf-42d0-a77a-acf1b687b52e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:30.323197 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f6a94-1adf-42d0-a77a-acf1b687b52e None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:30.324706 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 143/280] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:30.332554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efccce1-1696-45d8-8ff8-76d3ccc60588 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:30.332924 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efccce1-1696-45d8-8ff8-76d3ccc60588 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:30.333273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efccce1-1696-45d8-8ff8-76d3ccc60588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:30.355846 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-5efccce1-1696-45d8-8ff8-76d3ccc60588 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:30.357542 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5efccce1-1696-45d8-8ff8-76d3ccc60588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:30.364738 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:30.385847 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:30.403712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c5690-e383-4ac8-8472-51f8fad9c53b None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:30.459146 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec24f02-75d8-4933-a7d3-e7df527a942e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:30.459491 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec24f02-75d8-4933-a7d3-e7df527a942e None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:30.459793 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec24f02-75d8-4933-a7d3-e7df527a942e None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:30.460126 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec24f02-75d8-4933-a7d3-e7df527a942e None admin] PATH_INFO: `/v3/users/10ec25a429fe477987a3b543378d8957` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:30.467628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 144/281] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:30.484522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec24f02-75d8-4933-a7d3-e7df527a942e None admin] RBAC: Authorizing `identity:get_user(user_id=10ec25a429fe477987a3b543378d8957)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:30.486242 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec24f02-75d8-4933-a7d3-e7df527a942e None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:30.488129 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 138/282] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:30 2022] GET /identity/v3/users/10ec25a429fe477987a3b543378d8957 => generated 293 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:30.494604 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efccce1-1696-45d8-8ff8-76d3ccc60588 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:30.607075 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec24f02-75d8-4933-a7d3-e7df527a942e None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:30.615444 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efccce1-1696-45d8-8ff8-76d3ccc60588 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:30.656251 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412bb5a-9a0b-417c-a9ce-e4392cb6e43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:30.656251 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412bb5a-9a0b-417c-a9ce-e4392cb6e43a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:30.656251 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412bb5a-9a0b-417c-a9ce-e4392cb6e43a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:30.656251 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412bb5a-9a0b-417c-a9ce-e4392cb6e43a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:30.656866 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412bb5a-9a0b-417c-a9ce-e4392cb6e43a None admin] RBAC: Adding query filter params (role.id=29d2c7708bea4287a21112bb7ffa72df, user.id=10ec25a429fe477987a3b543378d8957, scope.system=all) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:30.656866 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412bb5a-9a0b-417c-a9ce-e4392cb6e43a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:30.657634 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412bb5a-9a0b-417c-a9ce-e4392cb6e43a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:30.663551 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 145/283] 10.222.0.69 () {56 vars in 1308 bytes} [Mon Aug 29 21:25:30 2022] GET /identity/v3/role_assignments?user.id=10ec25a429fe477987a3b543378d8957&scope.system=all&role.id=29d2c7708bea4287a21112bb7ffa72df => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:30.760058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec24f02-75d8-4933-a7d3-e7df527a942e None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:30.793250 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412bb5a-9a0b-417c-a9ce-e4392cb6e43a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:30.800870 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:30.805568 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b5aed-19bf-4379-a968-31c7127e0eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:30.806486 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b5aed-19bf-4379-a968-31c7127e0eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:30.806948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b5aed-19bf-4379-a968-31c7127e0eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:30.807465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b5aed-19bf-4379-a968-31c7127e0eb8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:30.822161 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b5aed-19bf-4379-a968-31c7127e0eb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:30.826772 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:30.828198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-692b5aed-19bf-4379-a968-31c7127e0eb8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:30.828198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:30.828198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:30.828198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:30.828198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:30.828198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:30.828198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:30.828198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:30.828198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:30.828198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:30.828198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:30.828198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:30.828198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:30.828198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:30.828198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:30.828198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:30.829104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:30.829104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:30.829104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:30.829104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:30.829104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:30.829104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:30.829104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:30.829104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:30.829104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:30.829104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:30.829104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:30.829104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:30.829104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:30.829104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:30.829104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:30.829104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:30.829909 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:30.829909 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:30.829909 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:30.829909 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:30.829909 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:30.829909 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:30.829909 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:30.829909 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:30.829909 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:30.829909 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:30.829909 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:30.829909 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:30.829909 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 139/284] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:25:30.835782 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b5aed-19bf-4379-a968-31c7127e0eb8 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:30.954473 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412bb5a-9a0b-417c-a9ce-e4392cb6e43a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:30.996297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc4f78-9288-4acc-abe0-35d242813f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:30.997198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc4f78-9288-4acc-abe0-35d242813f08 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:30.997538 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc4f78-9288-4acc-abe0-35d242813f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:30.997825 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc4f78-9288-4acc-abe0-35d242813f08 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:31.019593 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc4f78-9288-4acc-abe0-35d242813f08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:31.031725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-2ecc4f78-9288-4acc-abe0-35d242813f08 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:25:31.031725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:31.031725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:31.031725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:31.031725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:31.031725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:31.031725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:31.031725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:31.031725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:31.031725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:31.031725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:31.031725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:31.031725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:31.031725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:31.031725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:31.031725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:31.032904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:31.032904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:31.032904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:31.032904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:31.032904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:31.032904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:31.032904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:31.032904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:31.032904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:31.032904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:31.032904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:31.032904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:31.032904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:31.032904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:31.032904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:31.032904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:31.034087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:31.034087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:31.034087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:31.034087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:31.034087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:31.034087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:31.034087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:31.034087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:31.034087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:31.034087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:31.034087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:25:31.034087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:25:31.036214 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 146/285] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:25:31.037541 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b5aed-19bf-4379-a968-31c7127e0eb8 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:31.044870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc4f78-9288-4acc-abe0-35d242813f08 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:31.122869 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af291741-6976-4f01-ab47-57421ed1c025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:31.123557 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af291741-6976-4f01-ab47-57421ed1c025 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:31.123840 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af291741-6976-4f01-ab47-57421ed1c025 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:31.124116 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af291741-6976-4f01-ab47-57421ed1c025 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:31.124824 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af291741-6976-4f01-ab47-57421ed1c025 None admin] RBAC: Adding query filter params (name=member) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:31.125132 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af291741-6976-4f01-ab47-57421ed1c025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:31.126543 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af291741-6976-4f01-ab47-57421ed1c025 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:31.151063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 140/286] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:31.164146 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af291741-6976-4f01-ab47-57421ed1c025 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:31.200569 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:31.242380 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:31.251898 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc4f78-9288-4acc-abe0-35d242813f08 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:31.290999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af291741-6976-4f01-ab47-57421ed1c025 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:31.315778 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445a071-b93f-45b5-b488-e76bb57d7b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:31.316755 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445a071-b93f-45b5-b488-e76bb57d7b18 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:31.317186 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445a071-b93f-45b5-b488-e76bb57d7b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:31.317601 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445a071-b93f-45b5-b488-e76bb57d7b18 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:31.318417 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445a071-b93f-45b5-b488-e76bb57d7b18 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:31.318884 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445a071-b93f-45b5-b488-e76bb57d7b18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:31.320470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445a071-b93f-45b5-b488-e76bb57d7b18 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:31.330049 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 147/287] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:31.336495 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445a071-b93f-45b5-b488-e76bb57d7b18 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:31.357211 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcc5b7-14b7-46f3-a4b3-11f242b8edff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:31.358109 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcc5b7-14b7-46f3-a4b3-11f242b8edff None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:31.358702 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcc5b7-14b7-46f3-a4b3-11f242b8edff None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:31.359263 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcc5b7-14b7-46f3-a4b3-11f242b8edff None admin] PATH_INFO: `/v3/users/9b261e4283de462a8aabc86d59c511f2` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:31.361948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcc5b7-14b7-46f3-a4b3-11f242b8edff None admin] RBAC: Authorizing `identity:get_user(user_id=9b261e4283de462a8aabc86d59c511f2)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:31.363828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcc5b7-14b7-46f3-a4b3-11f242b8edff None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:31.366367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 141/288] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:31 2022] GET /identity/v3/users/9b261e4283de462a8aabc86d59c511f2 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:31.373287 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcc5b7-14b7-46f3-a4b3-11f242b8edff None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:31.494484 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcc5b7-14b7-46f3-a4b3-11f242b8edff None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:31.537700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf997f-3ae8-4cc2-9685-272b5eaab408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:31.538626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf997f-3ae8-4cc2-9685-272b5eaab408 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:31.539053 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf997f-3ae8-4cc2-9685-272b5eaab408 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:31.540072 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf997f-3ae8-4cc2-9685-272b5eaab408 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:31.572439 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:31.635199 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445a071-b93f-45b5-b488-e76bb57d7b18 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:31.651340 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf997f-3ae8-4cc2-9685-272b5eaab408 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:31.654121 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf997f-3ae8-4cc2-9685-272b5eaab408 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:31.739732 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474a117-7a55-4b85-9f8c-926c574c4d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:31.740696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474a117-7a55-4b85-9f8c-926c574c4d3a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:31.741126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474a117-7a55-4b85-9f8c-926c574c4d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:31.741547 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474a117-7a55-4b85-9f8c-926c574c4d3a None admin] PATH_INFO: `/v3/users/4489799349254058960c0e75dd43d7fb` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:31.743489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474a117-7a55-4b85-9f8c-926c574c4d3a None admin] RBAC: Authorizing `identity:get_user(user_id=4489799349254058960c0e75dd43d7fb)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:31.745194 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474a117-7a55-4b85-9f8c-926c574c4d3a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:31.750079 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 148/289] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:31 2022] GET /identity/v3/users/4489799349254058960c0e75dd43d7fb => generated 297 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:31.752821 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474a117-7a55-4b85-9f8c-926c574c4d3a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:31.776031 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:31.819287 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 142/290] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:25:31.823610 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf997f-3ae8-4cc2-9685-272b5eaab408 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:31.870971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:31.938605 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474a117-7a55-4b85-9f8c-926c574c4d3a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:31.981713 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de703c7-572e-4528-a343-a7ddb1e50dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:31.982358 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de703c7-572e-4528-a343-a7ddb1e50dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:31.982638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de703c7-572e-4528-a343-a7ddb1e50dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:31.982931 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de703c7-572e-4528-a343-a7ddb1e50dc1 None admin] PATH_INFO: `/v3/projects/5e57c96553df40ff975ec73f2b01cda6` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:31.984301 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de703c7-572e-4528-a343-a7ddb1e50dc1 None admin] RBAC: Authorizing `identity:get_project(project_id=5e57c96553df40ff975ec73f2b01cda6)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:31.986703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de703c7-572e-4528-a343-a7ddb1e50dc1 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:31.988719 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 149/291] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:31 2022] GET /identity/v3/projects/5e57c96553df40ff975ec73f2b01cda6 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:31.997331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de703c7-572e-4528-a343-a7ddb1e50dc1 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:32.036207 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf997f-3ae8-4cc2-9685-272b5eaab408 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:32.081560 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0b494-5b24-4ee2-92f3-3bcca745d1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:32.083182 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0b494-5b24-4ee2-92f3-3bcca745d1d9 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:32.083783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0b494-5b24-4ee2-92f3-3bcca745d1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:32.086956 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0b494-5b24-4ee2-92f3-3bcca745d1d9 None admin] PATH_INFO: `/v3/projects/5e57c96553df40ff975ec73f2b01cda6` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:32.088856 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0b494-5b24-4ee2-92f3-3bcca745d1d9 None admin] RBAC: Authorizing `identity:get_project(project_id=5e57c96553df40ff975ec73f2b01cda6)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:32.091511 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0b494-5b24-4ee2-92f3-3bcca745d1d9 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:32.098053 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 143/292] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:31 2022] GET /identity/v3/projects/5e57c96553df40ff975ec73f2b01cda6 => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:32.106767 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0b494-5b24-4ee2-92f3-3bcca745d1d9 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:32.187819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:32.237600 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de703c7-572e-4528-a343-a7ddb1e50dc1 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:32.286337 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:32.304875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83ce9e-e149-4673-8b49-012093e00920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:32.305931 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83ce9e-e149-4673-8b49-012093e00920 None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:32.306355 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83ce9e-e149-4673-8b49-012093e00920 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:32.306794 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83ce9e-e149-4673-8b49-012093e00920 None admin] PATH_INFO: `/v3/projects/5e57c96553df40ff975ec73f2b01cda6/users/4489799349254058960c0e75dd43d7fb/roles/1047d24970f744c38f38ecc563f0f61d` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:32.308639 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0b494-5b24-4ee2-92f3-3bcca745d1d9 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:32.309400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83ce9e-e149-4673-8b49-012093e00920 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e57c96553df40ff975ec73f2b01cda6, user_id=4489799349254058960c0e75dd43d7fb, role_id=1047d24970f744c38f38ecc563f0f61d)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:32.311210 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83ce9e-e149-4673-8b49-012093e00920 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:32.328290 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 150/293] 10.222.0.69 () {58 vars in 1439 bytes} [Mon Aug 29 21:25:31 2022] PUT /identity/v3/projects/5e57c96553df40ff975ec73f2b01cda6/users/4489799349254058960c0e75dd43d7fb/roles/1047d24970f744c38f38ecc563f0f61d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:25:32.378398 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877d02d-7d98-4224-ad94-c01030bbeeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:32.379031 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877d02d-7d98-4224-ad94-c01030bbeeb0 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:32.379315 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877d02d-7d98-4224-ad94-c01030bbeeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:32.379591 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877d02d-7d98-4224-ad94-c01030bbeeb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:32.380384 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877d02d-7d98-4224-ad94-c01030bbeeb0 None admin] RBAC: Adding query filter params (role.id=29d2c7708bea4287a21112bb7ffa72df, scope.project.id=5e57c96553df40ff975ec73f2b01cda6, user.id=9b261e4283de462a8aabc86d59c511f2) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:32.380696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877d02d-7d98-4224-ad94-c01030bbeeb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:32.382190 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877d02d-7d98-4224-ad94-c01030bbeeb0 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:32.389763 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 144/294] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:25:32 2022] GET /identity/v3/role_assignments?user.id=9b261e4283de462a8aabc86d59c511f2&scope.project.id=5e57c96553df40ff975ec73f2b01cda6&role.id=29d2c7708bea4287a21112bb7ffa72df => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:32.829295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c994d6-f585-4c02-beb8-197167fc1ec2 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:32.830087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c994d6-f585-4c02-beb8-197167fc1ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:32.830087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c994d6-f585-4c02-beb8-197167fc1ec2 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:32.831699 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 151/295] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:32.838028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0ac20-c193-4b11-8fac-0e2905391b84 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:32.838688 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0ac20-c193-4b11-8fac-0e2905391b84 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:32.838688 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0ac20-c193-4b11-8fac-0e2905391b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:32.863481 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-7ad0ac20-c193-4b11-8fac-0e2905391b84 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:32.864732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-7ad0ac20-c193-4b11-8fac-0e2905391b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:32.921273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e9ec9-3816-4da6-b0dd-87feae71be4f None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:32.921577 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e9ec9-3816-4da6-b0dd-87feae71be4f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:32.921834 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e9ec9-3816-4da6-b0dd-87feae71be4f None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:32.923183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 152/296] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:32.928638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725abda4-ad63-4430-98f5-9f09f31697a1 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:32.928927 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725abda4-ad63-4430-98f5-9f09f31697a1 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:32.929196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725abda4-ad63-4430-98f5-9f09f31697a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:32.942572 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 145/297] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:25:32.949660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-725abda4-ad63-4430-98f5-9f09f31697a1 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:32.950861 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-725abda4-ad63-4430-98f5-9f09f31697a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:33.038578 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 153/298] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:25:33.088709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dfb13-ce88-4131-ac2b-1d86beb07690 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:33.088993 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dfb13-ce88-4131-ac2b-1d86beb07690 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:33.089190 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dfb13-ce88-4131-ac2b-1d86beb07690 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:33.090945 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 146/299] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:33.098332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806eaa53-fb50-4773-b1c2-c24fad8d0de5 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:33.098777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806eaa53-fb50-4773-b1c2-c24fad8d0de5 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:33.099054 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806eaa53-fb50-4773-b1c2-c24fad8d0de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:33.121062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-806eaa53-fb50-4773-b1c2-c24fad8d0de5 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:33.122281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-806eaa53-fb50-4773-b1c2-c24fad8d0de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:33.210218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:33.217258 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 154/300] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:33.237121 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002dfb13-ce88-4131-ac2b-1d86beb07690 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:33.328065 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:33.348995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002dfb13-ce88-4131-ac2b-1d86beb07690 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:33.351702 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806eaa53-fb50-4773-b1c2-c24fad8d0de5 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:33.392140 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc8986-c07c-49fd-ac62-e60f3c683fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:33.392962 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc8986-c07c-49fd-ac62-e60f3c683fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:33.393403 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc8986-c07c-49fd-ac62-e60f3c683fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:33.393802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc8986-c07c-49fd-ac62-e60f3c683fa8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:33.395077 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc8986-c07c-49fd-ac62-e60f3c683fa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:33.396689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc8986-c07c-49fd-ac62-e60f3c683fa8 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:33.399065 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 147/301] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:25:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:33.407718 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc8986-c07c-49fd-ac62-e60f3c683fa8 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:33.477807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806eaa53-fb50-4773-b1c2-c24fad8d0de5 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:33.521107 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf71411-9d8a-4505-adb3-df791ae481db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:33.521933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf71411-9d8a-4505-adb3-df791ae481db None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:33.522222 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf71411-9d8a-4505-adb3-df791ae481db None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:33.522498 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf71411-9d8a-4505-adb3-df791ae481db None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:33.538234 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf71411-9d8a-4505-adb3-df791ae481db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:33.538422 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc8986-c07c-49fd-ac62-e60f3c683fa8 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:33.545362 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-bcf71411-9d8a-4505-adb3-df791ae481db None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:25:33.545362 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:33.545362 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:33.545362 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:33.545362 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:33.545362 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:33.545362 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:33.545362 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:33.545362 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:33.545362 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:33.545362 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:33.545362 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:33.545362 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:33.545362 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:33.545362 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:33.545362 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:33.546319 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:33.546319 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:33.546319 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:33.546319 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:33.546319 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:33.546319 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:33.546319 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:33.546319 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:33.546319 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:33.546319 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:33.546319 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:33.546319 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:33.546319 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:33.546319 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:33.546319 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:33.546319 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:33.547125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:33.547125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:33.547125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:33.547125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:33.547125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:33.547125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:33.547125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:33.547125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:33.547125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:33.547125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:33.547125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:25:33.547125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:25:33.553203 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 155/302] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:25:33.553203 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf71411-9d8a-4505-adb3-df791ae481db None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:33.589392 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd9246-d954-4877-8b34-9be8d3eb2e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:33.590470 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd9246-d954-4877-8b34-9be8d3eb2e28 None admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:33.590997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd9246-d954-4877-8b34-9be8d3eb2e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:33.591715 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd9246-d954-4877-8b34-9be8d3eb2e28 None admin] PATH_INFO: `/v3/groups` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:33.592280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd9246-d954-4877-8b34-9be8d3eb2e28 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:33.594757 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd9246-d954-4877-8b34-9be8d3eb2e28 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:33.626518 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 148/303] 10.222.0.69 () {60 vars in 1134 bytes} [Mon Aug 29 21:25:33 2022] POST /identity/v3/groups => generated 229 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:25:33.627989 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd9246-d954-4877-8b34-9be8d3eb2e28 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:33.659793 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:33.660846 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:33.764134 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf71411-9d8a-4505-adb3-df791ae481db None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:33.800449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd9246-d954-4877-8b34-9be8d3eb2e28 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:33.829091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68b782-e2b3-437d-bb7e-b7f0884b68f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:33.829367 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68b782-e2b3-437d-bb7e-b7f0884b68f5 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:33.830259 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68b782-e2b3-437d-bb7e-b7f0884b68f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:33.830259 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68b782-e2b3-437d-bb7e-b7f0884b68f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:33.849847 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68b782-e2b3-437d-bb7e-b7f0884b68f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:33.861014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-2d68b782-e2b3-437d-bb7e-b7f0884b68f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:33.861014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:33.861014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:33.861014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:33.861014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:33.861014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:33.861014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:33.861014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:33.861014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:33.861014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:33.861014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:33.861014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:33.861014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:33.861014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:33.861014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:33.861014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:33.862100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:33.862100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:33.862100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:33.862100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:33.862100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:33.862100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:33.862100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:33.862100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:33.862100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:33.862100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:33.862100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:33.862100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:33.862100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:33.862100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:33.862100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:33.862100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:33.862891 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:33.862891 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:33.862891 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:33.862891 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:33.862891 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:33.862891 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:33.862891 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:33.862891 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:33.862891 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:33.862891 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:33.862891 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:33.862891 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:25:33.863510 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 156/304] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:33.865108 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3872abe-3a64-42b8-98e3-f98c6f68f52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:33.865700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3872abe-3a64-42b8-98e3-f98c6f68f52c None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:33.865983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3872abe-3a64-42b8-98e3-f98c6f68f52c None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:33.866259 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3872abe-3a64-42b8-98e3-f98c6f68f52c None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:33.866953 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3872abe-3a64-42b8-98e3-f98c6f68f52c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:33.867281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3872abe-3a64-42b8-98e3-f98c6f68f52c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:33.869667 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3872abe-3a64-42b8-98e3-f98c6f68f52c None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:33.873078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68b782-e2b3-437d-bb7e-b7f0884b68f5 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:33.880875 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 149/305] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:33.886748 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3872abe-3a64-42b8-98e3-f98c6f68f52c None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:33.980601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:34.004442 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3872abe-3a64-42b8-98e3-f98c6f68f52c None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:34.019392 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68b782-e2b3-437d-bb7e-b7f0884b68f5 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:34.043680 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:34.045936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5e0e7-879c-4354-9161-5a70a9ef1cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:34.047744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5e0e7-879c-4354-9161-5a70a9ef1cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:34.048258 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5e0e7-879c-4354-9161-5a70a9ef1cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:34.048694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5e0e7-879c-4354-9161-5a70a9ef1cc0 None admin] PATH_INFO: `/v3/users/2d5c87d251b147d086c43c7ecc4940c8` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:34.063248 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bab332-7dd6-4651-babc-dfbd0e79df1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:34.063871 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bab332-7dd6-4651-babc-dfbd0e79df1d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:34.064153 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bab332-7dd6-4651-babc-dfbd0e79df1d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:34.064469 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bab332-7dd6-4651-babc-dfbd0e79df1d None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:34.065379 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bab332-7dd6-4651-babc-dfbd0e79df1d None admin] RBAC: Adding query filter params (name=member) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:34.065813 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bab332-7dd6-4651-babc-dfbd0e79df1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:34.067293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bab332-7dd6-4651-babc-dfbd0e79df1d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:34.068307 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5e0e7-879c-4354-9161-5a70a9ef1cc0 None admin] RBAC: Authorizing `identity:get_user(user_id=2d5c87d251b147d086c43c7ecc4940c8)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:34.070554 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5e0e7-879c-4354-9161-5a70a9ef1cc0 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:34.072816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 150/306] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:33 2022] GET /identity/v3/users/2d5c87d251b147d086c43c7ecc4940c8 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:34.080223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 157/307] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:34.083007 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5e0e7-879c-4354-9161-5a70a9ef1cc0 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:34.084125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bab332-7dd6-4651-babc-dfbd0e79df1d None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:34.214999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5e0e7-879c-4354-9161-5a70a9ef1cc0 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:34.222950 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bab332-7dd6-4651-babc-dfbd0e79df1d None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:34.261377 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad104538-eff8-4586-8f77-92e2188db14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:34.262182 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:34.262608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad104538-eff8-4586-8f77-92e2188db14a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:34.263175 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad104538-eff8-4586-8f77-92e2188db14a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:34.263576 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad104538-eff8-4586-8f77-92e2188db14a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:34.264521 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad104538-eff8-4586-8f77-92e2188db14a None admin] RBAC: Adding query filter params (role.id=1047d24970f744c38f38ecc563f0f61d, user.id=2d5c87d251b147d086c43c7ecc4940c8, scope.system=all) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:34.264930 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad104538-eff8-4586-8f77-92e2188db14a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:34.267018 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad104538-eff8-4586-8f77-92e2188db14a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:34.271312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309489a1-ef24-4e0c-980c-8753b0f5a907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:34.272473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309489a1-ef24-4e0c-980c-8753b0f5a907 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:34.272901 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309489a1-ef24-4e0c-980c-8753b0f5a907 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:34.273349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309489a1-ef24-4e0c-980c-8753b0f5a907 None admin] PATH_INFO: `/v3/users/10ec25a429fe477987a3b543378d8957` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:34.275615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309489a1-ef24-4e0c-980c-8753b0f5a907 None admin] RBAC: Authorizing `identity:get_user(user_id=10ec25a429fe477987a3b543378d8957)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:34.278602 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309489a1-ef24-4e0c-980c-8753b0f5a907 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:34.280819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 158/308] 10.222.0.69 () {56 vars in 1308 bytes} [Mon Aug 29 21:25:34 2022] GET /identity/v3/role_assignments?user.id=2d5c87d251b147d086c43c7ecc4940c8&scope.system=all&role.id=1047d24970f744c38f38ecc563f0f61d => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:34.281769 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 151/309] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:34 2022] GET /identity/v3/users/10ec25a429fe477987a3b543378d8957 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:34.288255 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad104538-eff8-4586-8f77-92e2188db14a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:34.354928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:34.417010 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad104538-eff8-4586-8f77-92e2188db14a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:34.455707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf87348-e0b1-468c-91ca-7bcfe73a3b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:34.456745 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf87348-e0b1-468c-91ca-7bcfe73a3b3b None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:34.457247 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf87348-e0b1-468c-91ca-7bcfe73a3b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:34.457788 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf87348-e0b1-468c-91ca-7bcfe73a3b3b None admin] PATH_INFO: `/v3/system/users/10ec25a429fe477987a3b543378d8957/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:34.459777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf87348-e0b1-468c-91ca-7bcfe73a3b3b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=10ec25a429fe477987a3b543378d8957, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:34.462040 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf87348-e0b1-468c-91ca-7bcfe73a3b3b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:34.476392 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 159/310] 10.222.0.69 () {58 vars in 1334 bytes} [Mon Aug 29 21:25:34 2022] PUT /identity/v3/system/users/10ec25a429fe477987a3b543378d8957/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:25:34.718702 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c0823-f64e-4a80-b1d1-bdff944c61d1 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:34.719018 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c0823-f64e-4a80-b1d1-bdff944c61d1 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:34.719178 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c0823-f64e-4a80-b1d1-bdff944c61d1 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:34.720607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 152/311] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:34.726223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0aa8c7-98b6-4769-8f84-82388aebd9fb None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:34.726641 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0aa8c7-98b6-4769-8f84-82388aebd9fb None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:34.726987 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0aa8c7-98b6-4769-8f84-82388aebd9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:34.747394 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-1b0aa8c7-98b6-4769-8f84-82388aebd9fb None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:34.748628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1b0aa8c7-98b6-4769-8f84-82388aebd9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:34.826712 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 160/312] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:35.104386 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c0823-f64e-4a80-b1d1-bdff944c61d1 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:35.217617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c0823-f64e-4a80-b1d1-bdff944c61d1 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:35.255524 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb330db-c1f3-45f0-a11f-36fbc555fb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:35.256169 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb330db-c1f3-45f0-a11f-36fbc555fb60 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:35.256479 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb330db-c1f3-45f0-a11f-36fbc555fb60 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:35.256753 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb330db-c1f3-45f0-a11f-36fbc555fb60 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:35.268328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb330db-c1f3-45f0-a11f-36fbc555fb60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:35.273602 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-afb330db-c1f3-45f0-a11f-36fbc555fb60 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:25:35.273602 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:35.273602 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:35.273602 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:35.273602 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:35.273602 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:35.273602 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:35.273602 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:35.273602 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:35.273602 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:35.273602 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:35.273602 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:35.273602 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:35.273602 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:35.273602 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:35.273602 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:35.274548 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:35.274548 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:35.274548 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:35.274548 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:35.274548 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:35.274548 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:35.274548 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:35.274548 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:35.274548 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:35.274548 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:35.274548 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:35.274548 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:35.274548 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:35.274548 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:35.274548 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:35.274548 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:35.275452 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:35.275452 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:35.275452 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:35.275452 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:35.275452 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:35.275452 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:35.275452 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:35.275452 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:35.275452 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:35.275452 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:35.275452 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:25:35.275452 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:35.275452 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 153/313] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:35.280895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0aa8c7-98b6-4769-8f84-82388aebd9fb None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:35.333038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:35.415306 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0aa8c7-98b6-4769-8f84-82388aebd9fb None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:35.452042 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d1572-1533-41a5-bfd3-13abb7563ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:35.452712 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d1572-1533-41a5-bfd3-13abb7563ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:35.452994 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d1572-1533-41a5-bfd3-13abb7563ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:35.453265 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d1572-1533-41a5-bfd3-13abb7563ae1 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:35.453947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d1572-1533-41a5-bfd3-13abb7563ae1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:35.454253 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d1572-1533-41a5-bfd3-13abb7563ae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:35.455659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d1572-1533-41a5-bfd3-13abb7563ae1 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:35.466993 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 161/314] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:35.472145 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb330db-c1f3-45f0-a11f-36fbc555fb60 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:35.542779 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:35.586241 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb330db-c1f3-45f0-a11f-36fbc555fb60 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:35.629432 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36592f-9189-4f46-a7fd-dbce072c1081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:35.630089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36592f-9189-4f46-a7fd-dbce072c1081 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:35.630382 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36592f-9189-4f46-a7fd-dbce072c1081 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:35.630646 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36592f-9189-4f46-a7fd-dbce072c1081 None admin] PATH_INFO: `/v3/users/4489799349254058960c0e75dd43d7fb` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:35.631848 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36592f-9189-4f46-a7fd-dbce072c1081 None admin] RBAC: Authorizing `identity:get_user(user_id=4489799349254058960c0e75dd43d7fb)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:35.633393 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36592f-9189-4f46-a7fd-dbce072c1081 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:35.635443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 154/315] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:35 2022] GET /identity/v3/users/4489799349254058960c0e75dd43d7fb => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:35.641136 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d1572-1533-41a5-bfd3-13abb7563ae1 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:35.754655 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:35.757617 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d1572-1533-41a5-bfd3-13abb7563ae1 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:35.796040 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab40693-d19b-4c27-9341-e22ffd4d12f8 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:35.796040 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab40693-d19b-4c27-9341-e22ffd4d12f8 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:35.796040 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab40693-d19b-4c27-9341-e22ffd4d12f8 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:35.796420 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ef4c2-48fd-4b5a-8236-7e317b61c33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:35.796420 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ef4c2-48fd-4b5a-8236-7e317b61c33b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:35.796420 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ef4c2-48fd-4b5a-8236-7e317b61c33b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:35.796420 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ef4c2-48fd-4b5a-8236-7e317b61c33b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:35.797115 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 155/316] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:25:35.802831 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4e07b-c20d-46ba-aed3-5337d4fe9645 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:35.803412 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4e07b-c20d-46ba-aed3-5337d4fe9645 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:35.803879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4e07b-c20d-46ba-aed3-5337d4fe9645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:35.824763 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-cbc4e07b-c20d-46ba-aed3-5337d4fe9645 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:35.826325 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-cbc4e07b-c20d-46ba-aed3-5337d4fe9645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:35.884331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ef4c2-48fd-4b5a-8236-7e317b61c33b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:35.886878 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ef4c2-48fd-4b5a-8236-7e317b61c33b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:35.915003 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 156/317] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:25:36.001264 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 162/318] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:25:36.002594 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:36.010008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4e07b-c20d-46ba-aed3-5337d4fe9645 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:36.074425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:36.122269 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4e07b-c20d-46ba-aed3-5337d4fe9645 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:36.163281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd7347-d3e5-40f5-9237-76f440cd8652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:36.164356 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd7347-d3e5-40f5-9237-76f440cd8652 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:36.176098 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd7347-d3e5-40f5-9237-76f440cd8652 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:36.176723 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd7347-d3e5-40f5-9237-76f440cd8652 None admin] PATH_INFO: `/v3/projects/5e57c96553df40ff975ec73f2b01cda6` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:36.178514 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd7347-d3e5-40f5-9237-76f440cd8652 None admin] RBAC: Authorizing `identity:get_project(project_id=5e57c96553df40ff975ec73f2b01cda6)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:36.180843 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd7347-d3e5-40f5-9237-76f440cd8652 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:36.183427 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 157/319] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:36 2022] GET /identity/v3/projects/5e57c96553df40ff975ec73f2b01cda6 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:36.189566 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ef4c2-48fd-4b5a-8236-7e317b61c33b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:36.189778 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd7347-d3e5-40f5-9237-76f440cd8652 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:36.307344 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd7347-d3e5-40f5-9237-76f440cd8652 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:36.326125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ef4c2-48fd-4b5a-8236-7e317b61c33b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:36.338381 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:36.351062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b900b01-4251-46ce-aa80-3596b1076171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:36.352202 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b900b01-4251-46ce-aa80-3596b1076171 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:36.352680 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b900b01-4251-46ce-aa80-3596b1076171 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:36.353140 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b900b01-4251-46ce-aa80-3596b1076171 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:36.354341 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b900b01-4251-46ce-aa80-3596b1076171 None admin] RBAC: Adding query filter params (role.id=1047d24970f744c38f38ecc563f0f61d, scope.project.id=5e57c96553df40ff975ec73f2b01cda6, user.id=4489799349254058960c0e75dd43d7fb) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:36.354875 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b900b01-4251-46ce-aa80-3596b1076171 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:36.356567 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b900b01-4251-46ce-aa80-3596b1076171 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:36.363667 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 158/320] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:25:36 2022] GET /identity/v3/role_assignments?user.id=4489799349254058960c0e75dd43d7fb&scope.project.id=5e57c96553df40ff975ec73f2b01cda6&role.id=1047d24970f744c38f38ecc563f0f61d => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:36.377761 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690eebf3-b769-4dde-a8dc-ebd548a8b51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:36.379301 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690eebf3-b769-4dde-a8dc-ebd548a8b51f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:36.379978 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690eebf3-b769-4dde-a8dc-ebd548a8b51f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:36.380522 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690eebf3-b769-4dde-a8dc-ebd548a8b51f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:36.382314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690eebf3-b769-4dde-a8dc-ebd548a8b51f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:36.384908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690eebf3-b769-4dde-a8dc-ebd548a8b51f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:36.386822 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ec662-abe1-45c6-b0c1-a132c30f56b9 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:36.387163 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 163/321] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:25:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:36.387276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ec662-abe1-45c6-b0c1-a132c30f56b9 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:36.387685 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ec662-abe1-45c6-b0c1-a132c30f56b9 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:36.389421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 159/322] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:25:36.393057 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690eebf3-b769-4dde-a8dc-ebd548a8b51f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:36.394792 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091660f7-bf94-4025-8a40-58fbc32c4b3f None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:36.395082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091660f7-bf94-4025-8a40-58fbc32c4b3f None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:36.395366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091660f7-bf94-4025-8a40-58fbc32c4b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:36.415221 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-091660f7-bf94-4025-8a40-58fbc32c4b3f None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:36.416639 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-091660f7-bf94-4025-8a40-58fbc32c4b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:36.481325 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:36.534413 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690eebf3-b769-4dde-a8dc-ebd548a8b51f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:36.541172 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 160/323] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:36.577627 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538fad1-a731-426f-9c34-a7367028bee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:36.578169 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538fad1-a731-426f-9c34-a7367028bee4 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:36.578450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538fad1-a731-426f-9c34-a7367028bee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:36.578718 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538fad1-a731-426f-9c34-a7367028bee4 None admin] PATH_INFO: `/v3/groups` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:36.579351 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538fad1-a731-426f-9c34-a7367028bee4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:36.580819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538fad1-a731-426f-9c34-a7367028bee4 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:36.602473 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 164/324] 10.222.0.69 () {60 vars in 1134 bytes} [Mon Aug 29 21:25:36 2022] POST /identity/v3/groups => generated 226 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:25:36.637485 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39d3e7-5cf5-4c6b-a76a-410187349b1e None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:36.638144 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39d3e7-5cf5-4c6b-a76a-410187349b1e None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:36.638633 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39d3e7-5cf5-4c6b-a76a-410187349b1e None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:36.640601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 161/325] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:36.648734 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027540be-6115-4091-8457-78480e9ef60f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:36.649357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027540be-6115-4091-8457-78480e9ef60f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:36.649856 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027540be-6115-4091-8457-78480e9ef60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:36.671761 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-027540be-6115-4091-8457-78480e9ef60f None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:36.673049 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-027540be-6115-4091-8457-78480e9ef60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:36.756281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 165/326] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:36.815646 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39d3e7-5cf5-4c6b-a76a-410187349b1e None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:36.940559 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39d3e7-5cf5-4c6b-a76a-410187349b1e None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:36.968312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:36.985634 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c6c55-199a-41e5-9089-1fa94c0cb8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:36.986389 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c6c55-199a-41e5-9089-1fa94c0cb8df None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:36.986571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c6c55-199a-41e5-9089-1fa94c0cb8df None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:36.986814 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c6c55-199a-41e5-9089-1fa94c0cb8df None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:36.999544 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c6c55-199a-41e5-9089-1fa94c0cb8df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:37.004732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-c57c6c55-199a-41e5-9089-1fa94c0cb8df None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:25:37.004732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:37.004732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:37.004732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:37.004732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:37.004732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:37.004732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:37.004732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:37.004732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:37.004732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:37.004732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:37.004732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:37.004732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:37.004732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:37.004732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:37.004732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:37.005708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:37.005708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:37.005708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:37.005708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:37.005708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:37.005708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:37.005708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:37.005708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:37.005708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:37.005708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:37.005708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:37.005708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:37.005708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:37.005708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:37.005708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:37.005708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:37.007216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:37.007216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:37.007216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:37.007216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:37.007216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:37.007216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:37.007216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:37.007216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:37.007216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:37.007216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:37.007216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:25:37.007216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:37.007216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 162/327] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:25:37.011885 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027540be-6115-4091-8457-78480e9ef60f None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:37.036823 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c6c55-199a-41e5-9089-1fa94c0cb8df None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:37.097493 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:37.168104 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027540be-6115-4091-8457-78480e9ef60f None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:37.191855 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c6c55-199a-41e5-9089-1fa94c0cb8df None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:37.214826 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d7e60-f32c-4f30-8ab6-eb523827b36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:37.215450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d7e60-f32c-4f30-8ab6-eb523827b36c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:37.215729 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d7e60-f32c-4f30-8ab6-eb523827b36c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:37.215999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d7e60-f32c-4f30-8ab6-eb523827b36c None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:37.216733 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d7e60-f32c-4f30-8ab6-eb523827b36c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:37.217035 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d7e60-f32c-4f30-8ab6-eb523827b36c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:37.218435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d7e60-f32c-4f30-8ab6-eb523827b36c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:37.229629 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 166/328] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:37.236593 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d7e60-f32c-4f30-8ab6-eb523827b36c None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:37.237764 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2907d59-81b4-4309-b3e3-f33a3d469dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:37.238624 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2907d59-81b4-4309-b3e3-f33a3d469dca None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:37.238900 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2907d59-81b4-4309-b3e3-f33a3d469dca None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:37.239177 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2907d59-81b4-4309-b3e3-f33a3d469dca None admin] PATH_INFO: `/v3/roles/member` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:37.252173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2907d59-81b4-4309-b3e3-f33a3d469dca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:37.257927 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-d2907d59-81b4-4309-b3e3-f33a3d469dca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:37.257927 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:37.257927 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:37.257927 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:37.257927 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:37.257927 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:37.257927 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:37.257927 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:37.257927 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:37.257927 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:37.257927 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:37.257927 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:37.257927 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:37.257927 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:37.257927 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:37.257927 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:37.259424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:37.259424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:37.259424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:37.259424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:37.259424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:37.259424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:37.259424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:37.259424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:37.259424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:37.259424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:37.259424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:37.259424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:37.259424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:37.259424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:37.259424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:37.259424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:37.260280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:37.260280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:37.260280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:37.260280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:37.260280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:37.260280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:37.260280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:37.260280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:37.260280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:37.260280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:37.260280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:37.260280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:37.261562 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 163/329] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:25:37.273263 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2907d59-81b4-4309-b3e3-f33a3d469dca None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:37.353959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:37.354947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d7e60-f32c-4f30-8ab6-eb523827b36c None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:37.381713 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:37.398283 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586cf6b-92d5-4446-aade-884dbc37b7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:37.399568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586cf6b-92d5-4446-aade-884dbc37b7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:37.399850 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586cf6b-92d5-4446-aade-884dbc37b7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:37.400119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586cf6b-92d5-4446-aade-884dbc37b7d2 None admin] PATH_INFO: `/v3/users/2d5c87d251b147d086c43c7ecc4940c8` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:37.401412 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586cf6b-92d5-4446-aade-884dbc37b7d2 None admin] RBAC: Authorizing `identity:get_user(user_id=2d5c87d251b147d086c43c7ecc4940c8)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:37.402921 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586cf6b-92d5-4446-aade-884dbc37b7d2 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:37.404845 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 167/330] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:37 2022] GET /identity/v3/users/2d5c87d251b147d086c43c7ecc4940c8 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:37.410701 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586cf6b-92d5-4446-aade-884dbc37b7d2 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:37.415245 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2907d59-81b4-4309-b3e3-f33a3d469dca None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:37.464009 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8ab3d-13dd-450b-8096-acab41500a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:37.465285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8ab3d-13dd-450b-8096-acab41500a9d None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:37.465795 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8ab3d-13dd-450b-8096-acab41500a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:37.466281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8ab3d-13dd-450b-8096-acab41500a9d None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:37.467166 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8ab3d-13dd-450b-8096-acab41500a9d None admin] RBAC: Adding query filter params (name=member) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:37.467698 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8ab3d-13dd-450b-8096-acab41500a9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:37.471546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8ab3d-13dd-450b-8096-acab41500a9d None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:37.486524 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 164/331] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:37.488867 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8ab3d-13dd-450b-8096-acab41500a9d None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:37.538083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586cf6b-92d5-4446-aade-884dbc37b7d2 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:37.583111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f3cc1-4a69-4794-9f7c-ebba4f27252b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:37.583782 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f3cc1-4a69-4794-9f7c-ebba4f27252b None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:37.584061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f3cc1-4a69-4794-9f7c-ebba4f27252b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:37.584372 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f3cc1-4a69-4794-9f7c-ebba4f27252b None admin] PATH_INFO: `/v3/system/users/2d5c87d251b147d086c43c7ecc4940c8/roles/1047d24970f744c38f38ecc563f0f61d` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:37.585854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f3cc1-4a69-4794-9f7c-ebba4f27252b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2d5c87d251b147d086c43c7ecc4940c8, role_id=1047d24970f744c38f38ecc563f0f61d)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:37.587978 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f3cc1-4a69-4794-9f7c-ebba4f27252b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:37.600287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 168/332] 10.222.0.69 () {58 vars in 1334 bytes} [Mon Aug 29 21:25:37 2022] PUT /identity/v3/system/users/2d5c87d251b147d086c43c7ecc4940c8/roles/1047d24970f744c38f38ecc563f0f61d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:25:37.627814 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8ab3d-13dd-450b-8096-acab41500a9d None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:37.644670 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:37.674706 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4968818-0472-42cf-bbbc-85d0360d00cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:37.675956 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4968818-0472-42cf-bbbc-85d0360d00cc None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:37.676465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4968818-0472-42cf-bbbc-85d0360d00cc None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:37.676991 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4968818-0472-42cf-bbbc-85d0360d00cc None admin] PATH_INFO: `/v3/users/10ec25a429fe477987a3b543378d8957` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:37.678398 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4968818-0472-42cf-bbbc-85d0360d00cc None admin] RBAC: Authorizing `identity:get_user(user_id=10ec25a429fe477987a3b543378d8957)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:37.680860 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4968818-0472-42cf-bbbc-85d0360d00cc None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:37.687171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 165/333] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:37 2022] GET /identity/v3/users/10ec25a429fe477987a3b543378d8957 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:37.689638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f3cc1-4a69-4794-9f7c-ebba4f27252b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:37.756959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:37.815523 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f3cc1-4a69-4794-9f7c-ebba4f27252b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:37.865426 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789954df-00ac-4641-b0df-b9e3f05d5a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:37.866476 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789954df-00ac-4641-b0df-b9e3f05d5a73 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:37.866984 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789954df-00ac-4641-b0df-b9e3f05d5a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:37.867458 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789954df-00ac-4641-b0df-b9e3f05d5a73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:37.869005 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789954df-00ac-4641-b0df-b9e3f05d5a73 None admin] RBAC: Adding query filter params (role.id=29d2c7708bea4287a21112bb7ffa72df, user.id=10ec25a429fe477987a3b543378d8957, scope.system=all) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:37.869522 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789954df-00ac-4641-b0df-b9e3f05d5a73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:37.871239 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789954df-00ac-4641-b0df-b9e3f05d5a73 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:37.889080 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 169/334] 10.222.0.69 () {56 vars in 1308 bytes} [Mon Aug 29 21:25:37 2022] GET /identity/v3/role_assignments?user.id=10ec25a429fe477987a3b543378d8957&scope.system=all&role.id=29d2c7708bea4287a21112bb7ffa72df => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:39.442136 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8e682-02ce-472b-b05b-0aadc3036bcc None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:39.443454 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8e682-02ce-472b-b05b-0aadc3036bcc None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:39.443925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8e682-02ce-472b-b05b-0aadc3036bcc None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:39.448151 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461f0e7-e87e-4bb4-84f3-60d64a2e48b5 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:39.448599 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 166/335] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:25:39.448675 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461f0e7-e87e-4bb4-84f3-60d64a2e48b5 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:39.448675 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461f0e7-e87e-4bb4-84f3-60d64a2e48b5 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:39.448675 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 170/336] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:39.456171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dc0a3-29b2-42de-964c-9441d31007c0 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:39.456511 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dc0a3-29b2-42de-964c-9441d31007c0 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:39.456933 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dc0a3-29b2-42de-964c-9441d31007c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:39.458278 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d59665-1399-4304-8384-1a239281c036 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:39.458561 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d59665-1399-4304-8384-1a239281c036 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:39.458899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d59665-1399-4304-8384-1a239281c036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:39.491027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-f63dc0a3-29b2-42de-964c-9441d31007c0 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:39.493958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-c2d59665-1399-4304-8384-1a239281c036 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:39.494634 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f63dc0a3-29b2-42de-964c-9441d31007c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:39.495150 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c2d59665-1399-4304-8384-1a239281c036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:39.627470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 171/337] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:25:39.648369 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 167/338] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:40.092015 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9ea5b-30b7-423f-8681-14ea2ceaef64 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:40.092015 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9ea5b-30b7-423f-8681-14ea2ceaef64 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:40.092959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9ea5b-30b7-423f-8681-14ea2ceaef64 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:40.093954 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 172/339] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:40.099874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a53c70-cd0b-4e02-92cc-192dedbbd552 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:40.100195 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a53c70-cd0b-4e02-92cc-192dedbbd552 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:40.100469 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a53c70-cd0b-4e02-92cc-192dedbbd552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:40.126233 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-32a53c70-cd0b-4e02-92cc-192dedbbd552 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:40.127532 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-32a53c70-cd0b-4e02-92cc-192dedbbd552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:40.151205 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9ea5b-30b7-423f-8681-14ea2ceaef64 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:40.259770 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:40.278521 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 168/340] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:40.279247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a53c70-cd0b-4e02-92cc-192dedbbd552 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:40.356713 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:40.397062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9ea5b-30b7-423f-8681-14ea2ceaef64 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:40.453391 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a53c70-cd0b-4e02-92cc-192dedbbd552 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:40.473114 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f74dd1-9073-44b9-a559-aba3ff9c15f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:40.474606 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f74dd1-9073-44b9-a559-aba3ff9c15f1 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:40.475059 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f74dd1-9073-44b9-a559-aba3ff9c15f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:40.475508 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f74dd1-9073-44b9-a559-aba3ff9c15f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:40.500105 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f74dd1-9073-44b9-a559-aba3ff9c15f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:40.505943 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-b2f74dd1-9073-44b9-a559-aba3ff9c15f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:40.505943 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:40.505943 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:40.505943 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:40.505943 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:40.505943 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:40.505943 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:40.505943 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:40.505943 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:40.505943 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:40.505943 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:40.505943 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:40.505943 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:40.505943 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:40.505943 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:40.505943 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:40.507118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:40.507118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:40.507118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:40.507118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:40.507118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:40.507118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:40.507118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:40.507118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:40.507118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:40.507118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:40.507118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:40.507118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:40.507118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:40.507118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:40.507118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:40.507118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:40.508263 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:40.508263 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:40.508263 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:40.508263 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:40.508263 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:40.508263 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:40.508263 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:40.508263 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:40.508263 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:40.508263 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:40.508263 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:40.508263 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:25:40.517459 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82ef33-abfb-4a4c-97a4-026e30143ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:40.517459 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82ef33-abfb-4a4c-97a4-026e30143ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:40.517459 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82ef33-abfb-4a4c-97a4-026e30143ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:40.517459 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82ef33-abfb-4a4c-97a4-026e30143ee5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:40.519077 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 173/341] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:25:40.520386 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f74dd1-9073-44b9-a559-aba3ff9c15f1 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:40.533018 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82ef33-abfb-4a4c-97a4-026e30143ee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:40.546964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-4e82ef33-abfb-4a4c-97a4-026e30143ee5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:25:40.546964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:40.546964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:40.546964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:40.546964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:40.546964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:40.546964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:40.546964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:40.546964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:40.546964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:40.546964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:40.546964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:40.546964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:40.546964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:40.546964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:40.546964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:40.550013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:40.550013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:40.550013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:40.550013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:40.550013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:40.550013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:40.550013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:40.550013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:40.550013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:40.550013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:40.550013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:40.550013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:40.550013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:40.550013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:40.550013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:40.550013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:40.553467 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:40.553467 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:40.553467 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:40.553467 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:40.553467 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:40.553467 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:40.553467 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:40.553467 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:40.553467 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:40.553467 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:40.553467 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:25:40.553467 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:40.553467 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 169/342] 10.222.0.69 () {56 vars in 1114 bytes} [Mon Aug 29 21:25:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:40.593359 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82ef33-abfb-4a4c-97a4-026e30143ee5 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:40.717498 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:40.722266 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f74dd1-9073-44b9-a559-aba3ff9c15f1 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:40.784544 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:40.799425 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f9aab-906b-4435-b251-f0b96f995b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:40.800054 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f9aab-906b-4435-b251-f0b96f995b0b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:40.800366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f9aab-906b-4435-b251-f0b96f995b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:40.800644 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f9aab-906b-4435-b251-f0b96f995b0b None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:40.801331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f9aab-906b-4435-b251-f0b96f995b0b None admin] RBAC: Adding query filter params (name=member) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:40.801642 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f9aab-906b-4435-b251-f0b96f995b0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:40.803036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f9aab-906b-4435-b251-f0b96f995b0b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:40.806811 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82ef33-abfb-4a4c-97a4-026e30143ee5 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:40.833495 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 174/343] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:40.834477 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f9aab-906b-4435-b251-f0b96f995b0b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:40.887679 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea261d7-f33f-4003-b722-0b6aa2e9f79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:40.890206 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea261d7-f33f-4003-b722-0b6aa2e9f79f None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:40.890563 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea261d7-f33f-4003-b722-0b6aa2e9f79f None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:40.890824 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea261d7-f33f-4003-b722-0b6aa2e9f79f None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:40.891507 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea261d7-f33f-4003-b722-0b6aa2e9f79f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:40.891876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea261d7-f33f-4003-b722-0b6aa2e9f79f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:40.893274 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea261d7-f33f-4003-b722-0b6aa2e9f79f None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:40.936294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 170/344] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:25:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:40.937842 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea261d7-f33f-4003-b722-0b6aa2e9f79f None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:41.060610 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f9aab-906b-4435-b251-f0b96f995b0b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:41.115170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005f1b7-2ed5-4f91-9ca9-07dbe845fa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:41.116308 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005f1b7-2ed5-4f91-9ca9-07dbe845fa57 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:41.116841 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005f1b7-2ed5-4f91-9ca9-07dbe845fa57 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:41.117476 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005f1b7-2ed5-4f91-9ca9-07dbe845fa57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:41.136901 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005f1b7-2ed5-4f91-9ca9-07dbe845fa57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:41.144947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-6005f1b7-2ed5-4f91-9ca9-07dbe845fa57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:41.144947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:41.144947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:41.144947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:41.144947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:41.144947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:41.144947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:41.144947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:41.144947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:41.144947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:41.144947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:41.144947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:41.144947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:41.144947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:41.144947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:41.144947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:41.146062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:41.146062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:41.146062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:41.146062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:41.146062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:41.146062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:41.146062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:41.146062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:41.146062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:41.146062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:41.146062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:41.146062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:41.146062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:41.146062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:41.146062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:41.146062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:41.146875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:41.146875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:41.146875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:41.146875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:41.146875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:41.146875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:41.146875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:41.146875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:41.146875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:41.146875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:41.146875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:41.146875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:25:41.149658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 175/345] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:41.150702 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005f1b7-2ed5-4f91-9ca9-07dbe845fa57 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:41.193489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea261d7-f33f-4003-b722-0b6aa2e9f79f None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:41.196036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:41.254637 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468f279-5b58-4ffb-8fd6-349dd45718bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:41.255904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468f279-5b58-4ffb-8fd6-349dd45718bf None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:41.256944 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468f279-5b58-4ffb-8fd6-349dd45718bf None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:41.257473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468f279-5b58-4ffb-8fd6-349dd45718bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:41.290235 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:41.307952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005f1b7-2ed5-4f91-9ca9-07dbe845fa57 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:41.346180 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032442e8-d366-4979-b8c3-d71b7416a294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:41.347197 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032442e8-d366-4979-b8c3-d71b7416a294 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:41.347641 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032442e8-d366-4979-b8c3-d71b7416a294 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:41.348073 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032442e8-d366-4979-b8c3-d71b7416a294 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:41.357527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468f279-5b58-4ffb-8fd6-349dd45718bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:41.360130 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468f279-5b58-4ffb-8fd6-349dd45718bf None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:41.455934 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032442e8-d366-4979-b8c3-d71b7416a294 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:41.457599 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032442e8-d366-4979-b8c3-d71b7416a294 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:41.492123 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:41.509738 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 171/346] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:25:41.516324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468f279-5b58-4ffb-8fd6-349dd45718bf None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:41.593157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:41.609500 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 176/347] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:25:41.611609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf468-5985-40ff-98d4-d3d5689c654f None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:41.612138 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf468-5985-40ff-98d4-d3d5689c654f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:41.613011 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf468-5985-40ff-98d4-d3d5689c654f None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:41.614868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 177/348] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:41.616553 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775a6f6-8761-4e0e-8309-b3e0f4b3d803 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:41.617215 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775a6f6-8761-4e0e-8309-b3e0f4b3d803 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:41.617710 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775a6f6-8761-4e0e-8309-b3e0f4b3d803 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:41.620161 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 178/349] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:41.621406 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775a6f6-8761-4e0e-8309-b3e0f4b3d803 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:41.665898 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468f279-5b58-4ffb-8fd6-349dd45718bf None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:41.723096 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01510004-8b7c-4459-bc63-3fe2fac01619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:41.723990 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01510004-8b7c-4459-bc63-3fe2fac01619 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:41.724443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01510004-8b7c-4459-bc63-3fe2fac01619 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:41.724869 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01510004-8b7c-4459-bc63-3fe2fac01619 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:41.725726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01510004-8b7c-4459-bc63-3fe2fac01619 None admin] RBAC: Adding query filter params (name=member) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:41.726204 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01510004-8b7c-4459-bc63-3fe2fac01619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:41.731504 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01510004-8b7c-4459-bc63-3fe2fac01619 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:41.742535 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 172/350] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:41.743494 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01510004-8b7c-4459-bc63-3fe2fac01619 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:41.772488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775a6f6-8761-4e0e-8309-b3e0f4b3d803 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:41.800688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:41.815310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93833e9b-db10-4961-bb09-f404d19cf308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:41.816328 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93833e9b-db10-4961-bb09-f404d19cf308 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:41.816605 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93833e9b-db10-4961-bb09-f404d19cf308 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:41.816885 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93833e9b-db10-4961-bb09-f404d19cf308 None admin] PATH_INFO: `/v3/projects/9e54ec3d9806409e8a45d9a82823741d` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:41.818391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93833e9b-db10-4961-bb09-f404d19cf308 None admin] RBAC: Authorizing `identity:get_project(project_id=9e54ec3d9806409e8a45d9a82823741d)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:41.820150 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93833e9b-db10-4961-bb09-f404d19cf308 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:41.824216 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 179/351] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:41 2022] GET /identity/v3/projects/9e54ec3d9806409e8a45d9a82823741d => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:41.824216 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ee4d9-ea6c-43d9-a11d-abf05347bc0e None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:41.824541 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ee4d9-ea6c-43d9-a11d-abf05347bc0e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:41.824843 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ee4d9-ea6c-43d9-a11d-abf05347bc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:41.845439 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-bf7ee4d9-ea6c-43d9-a11d-abf05347bc0e None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:41.846643 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-bf7ee4d9-ea6c-43d9-a11d-abf05347bc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:41.880059 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01510004-8b7c-4459-bc63-3fe2fac01619 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:41.898637 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:41.928933 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a90950-2871-4a48-b48c-26c5e7e77f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:41.929598 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a90950-2871-4a48-b48c-26c5e7e77f17 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:41.929999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a90950-2871-4a48-b48c-26c5e7e77f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:41.930319 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a90950-2871-4a48-b48c-26c5e7e77f17 None admin] PATH_INFO: `/v3/projects/9e54ec3d9806409e8a45d9a82823741d` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:41.931501 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a90950-2871-4a48-b48c-26c5e7e77f17 None admin] RBAC: Authorizing `identity:get_project(project_id=9e54ec3d9806409e8a45d9a82823741d)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:41.933050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a90950-2871-4a48-b48c-26c5e7e77f17 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:41.933998 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 180/352] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:41.935076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd414b-72ba-49e9-9a41-f65589861db3 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:41.935363 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd414b-72ba-49e9-9a41-f65589861db3 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:41.935636 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd414b-72ba-49e9-9a41-f65589861db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:41.939918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 173/353] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:41 2022] GET /identity/v3/projects/9e54ec3d9806409e8a45d9a82823741d => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:41.941218 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a90950-2871-4a48-b48c-26c5e7e77f17 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:41.959847 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-65dd414b-72ba-49e9-9a41-f65589861db3 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:41.962286 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-65dd414b-72ba-49e9-9a41-f65589861db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:42.055399 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 181/354] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:42.056408 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd414b-72ba-49e9-9a41-f65589861db3 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:42.089683 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a90950-2871-4a48-b48c-26c5e7e77f17 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:42.128106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:42.152736 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538dade-fdc0-4e2a-9047-ae755d001287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:42.153517 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538dade-fdc0-4e2a-9047-ae755d001287 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:42.153826 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538dade-fdc0-4e2a-9047-ae755d001287 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:42.154176 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538dade-fdc0-4e2a-9047-ae755d001287 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:42.193659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd414b-72ba-49e9-9a41-f65589861db3 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:42.215128 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:42.241602 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538dade-fdc0-4e2a-9047-ae755d001287 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:42.242443 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3cfa5-da4e-4fe5-a0aa-4b0e41b2ca4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:42.243669 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538dade-fdc0-4e2a-9047-ae755d001287 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:42.244084 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3cfa5-da4e-4fe5-a0aa-4b0e41b2ca4e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:42.244536 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3cfa5-da4e-4fe5-a0aa-4b0e41b2ca4e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:42.244945 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3cfa5-da4e-4fe5-a0aa-4b0e41b2ca4e None admin] PATH_INFO: `/v3/groups/2731fdf88f5d4c6cb1183da85421d6a3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:42.260918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3cfa5-da4e-4fe5-a0aa-4b0e41b2ca4e None admin] RBAC: Authorizing `identity:get_group(group_id=2731fdf88f5d4c6cb1183da85421d6a3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:42.262389 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3cfa5-da4e-4fe5-a0aa-4b0e41b2ca4e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:42.264597 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 182/355] 10.222.0.69 () {56 vars in 1180 bytes} [Mon Aug 29 21:25:42 2022] GET /identity/v3/groups/2731fdf88f5d4c6cb1183da85421d6a3 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:42.265595 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3cfa5-da4e-4fe5-a0aa-4b0e41b2ca4e None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:42.384952 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 174/356] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:25:42.386247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d98244-86db-4c0e-be62-c97f3ed39d82 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:42.386526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d98244-86db-4c0e-be62-c97f3ed39d82 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:42.386797 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d98244-86db-4c0e-be62-c97f3ed39d82 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:42.388207 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 175/357] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:42.388818 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d98244-86db-4c0e-be62-c97f3ed39d82 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:42.407355 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3cfa5-da4e-4fe5-a0aa-4b0e41b2ca4e None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:42.423062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:42.452657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b54df-146f-46a4-8bac-6d5f1dd709e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:42.453310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b54df-146f-46a4-8bac-6d5f1dd709e3 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:42.453595 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b54df-146f-46a4-8bac-6d5f1dd709e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:42.453862 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b54df-146f-46a4-8bac-6d5f1dd709e3 None admin] PATH_INFO: `/v3/groups/2731fdf88f5d4c6cb1183da85421d6a3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:42.455037 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b54df-146f-46a4-8bac-6d5f1dd709e3 None admin] RBAC: Authorizing `identity:get_group(group_id=2731fdf88f5d4c6cb1183da85421d6a3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:42.456506 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b54df-146f-46a4-8bac-6d5f1dd709e3 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:42.458248 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 183/358] 10.222.0.69 () {56 vars in 1180 bytes} [Mon Aug 29 21:25:42 2022] GET /identity/v3/groups/2731fdf88f5d4c6cb1183da85421d6a3 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:42.458886 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b54df-146f-46a4-8bac-6d5f1dd709e3 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:42.496259 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:42.525432 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d98244-86db-4c0e-be62-c97f3ed39d82 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:42.569831 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67607f70-d468-46a6-9d50-0376e2922794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:42.570592 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67607f70-d468-46a6-9d50-0376e2922794 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:42.570876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67607f70-d468-46a6-9d50-0376e2922794 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:42.571147 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67607f70-d468-46a6-9d50-0376e2922794 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:42.571886 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67607f70-d468-46a6-9d50-0376e2922794 None admin] RBAC: Adding query filter params (group.id=2731fdf88f5d4c6cb1183da85421d6a3, role.id=29d2c7708bea4287a21112bb7ffa72df, scope.project.id=9e54ec3d9806409e8a45d9a82823741d) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:42.572214 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67607f70-d468-46a6-9d50-0376e2922794 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:42.573772 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67607f70-d468-46a6-9d50-0376e2922794 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:42.580321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 176/359] 10.222.0.69 () {56 vars in 1376 bytes} [Mon Aug 29 21:25:42 2022] GET /identity/v3/role_assignments?group.id=2731fdf88f5d4c6cb1183da85421d6a3&scope.project.id=9e54ec3d9806409e8a45d9a82823741d&role.id=29d2c7708bea4287a21112bb7ffa72df => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:42.580831 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67607f70-d468-46a6-9d50-0376e2922794 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:42.581363 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b54df-146f-46a4-8bac-6d5f1dd709e3 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:42.637908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9089728-4888-4af2-8cc0-1da412f22ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:42.638621 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9089728-4888-4af2-8cc0-1da412f22ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:42.638907 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9089728-4888-4af2-8cc0-1da412f22ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:42.639186 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9089728-4888-4af2-8cc0-1da412f22ef8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:42.654544 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9089728-4888-4af2-8cc0-1da412f22ef8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:42.661527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-e9089728-4888-4af2-8cc0-1da412f22ef8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:25:42.661527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:42.661527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:42.661527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:42.661527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:42.661527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:42.661527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:42.661527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:42.661527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:42.661527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:42.661527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:42.661527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:42.661527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:42.661527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:42.661527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:42.661527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:42.662676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:42.662676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:42.662676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:42.662676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:42.662676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:42.662676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:42.662676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:42.662676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:42.662676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:42.662676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:42.662676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:42.662676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:42.662676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:42.662676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:42.662676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:42.662676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:42.663791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:42.663791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:42.663791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:42.663791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:42.663791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:42.663791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:42.663791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:42.663791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:42.663791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:42.663791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:42.663791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:25:42.663791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:25:42.666094 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 184/360] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:42.667398 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a520fe-7298-4bd0-a7bb-49d19b274516 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:42.667747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a520fe-7298-4bd0-a7bb-49d19b274516 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:42.668019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a520fe-7298-4bd0-a7bb-49d19b274516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:42.697963 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-71a520fe-7298-4bd0-a7bb-49d19b274516 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:42.699301 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-71a520fe-7298-4bd0-a7bb-49d19b274516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:42.732027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67607f70-d468-46a6-9d50-0376e2922794 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:42.762723 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:42.787450 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a7e34-8b36-4a0c-8f5f-0fc4d0bb166c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:42.788157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a7e34-8b36-4a0c-8f5f-0fc4d0bb166c None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:42.788522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a7e34-8b36-4a0c-8f5f-0fc4d0bb166c None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:42.788826 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a7e34-8b36-4a0c-8f5f-0fc4d0bb166c None admin] PATH_INFO: `/v3/projects/5e57c96553df40ff975ec73f2b01cda6` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:42.790624 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a7e34-8b36-4a0c-8f5f-0fc4d0bb166c None admin] RBAC: Authorizing `identity:get_project(project_id=5e57c96553df40ff975ec73f2b01cda6)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:42.792204 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a7e34-8b36-4a0c-8f5f-0fc4d0bb166c None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:42.794208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 177/361] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:42 2022] GET /identity/v3/projects/5e57c96553df40ff975ec73f2b01cda6 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:42.796287 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a7e34-8b36-4a0c-8f5f-0fc4d0bb166c None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:42.816204 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 185/362] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:42.816204 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a520fe-7298-4bd0-a7bb-49d19b274516 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:42.820800 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:42.935989 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a7e34-8b36-4a0c-8f5f-0fc4d0bb166c None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:42.949812 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a520fe-7298-4bd0-a7bb-49d19b274516 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:42.977836 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312e828-6983-4580-9be4-542d05ce1354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:42.978495 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312e828-6983-4580-9be4-542d05ce1354 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:42.978774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312e828-6983-4580-9be4-542d05ce1354 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:42.979300 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312e828-6983-4580-9be4-542d05ce1354 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:42.994361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312e828-6983-4580-9be4-542d05ce1354 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:42.999148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b41c0e-dff7-4db1-85cf-a2852e779e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:42.999779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b41c0e-dff7-4db1-85cf-a2852e779e0b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:43.000060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b41c0e-dff7-4db1-85cf-a2852e779e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:43.000364 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b41c0e-dff7-4db1-85cf-a2852e779e0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:43.000712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-6312e828-6983-4580-9be4-542d05ce1354 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:25:43.000712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:43.000712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:43.000712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:43.000712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:43.000712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:43.000712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:43.000712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:43.000712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:43.000712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:43.000712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:43.000712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:43.000712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:43.000712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:43.000712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:43.000712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:43.001642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:43.001642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:43.001642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:43.001642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:43.001642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:43.001642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:43.001642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:43.001642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:43.001642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:43.001642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:43.001642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:43.001642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:43.001642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:43.001642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:43.001642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:43.001642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:43.002638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:43.002638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:43.002638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:43.002638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:43.002638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:43.002638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:43.002638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:43.002638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:43.002638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:43.002638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:43.002638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:25:43.002638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:43.003252 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b41c0e-dff7-4db1-85cf-a2852e779e0b None admin] RBAC: Adding query filter params (group.id=2731fdf88f5d4c6cb1183da85421d6a3, role.id=ecbc0b9f55214a93a2016b3625d94764, scope.project.id=9e54ec3d9806409e8a45d9a82823741d) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:43.003252 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b41c0e-dff7-4db1-85cf-a2852e779e0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:43.003387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 178/363] 10.222.0.69 () {56 vars in 1114 bytes} [Mon Aug 29 21:25:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:43.003452 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b41c0e-dff7-4db1-85cf-a2852e779e0b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:43.003522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312e828-6983-4580-9be4-542d05ce1354 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:43.010651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 186/364] 10.222.0.69 () {56 vars in 1376 bytes} [Mon Aug 29 21:25:42 2022] GET /identity/v3/role_assignments?group.id=2731fdf88f5d4c6cb1183da85421d6a3&scope.project.id=9e54ec3d9806409e8a45d9a82823741d&role.id=ecbc0b9f55214a93a2016b3625d94764 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:43.011316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b41c0e-dff7-4db1-85cf-a2852e779e0b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:43.057872 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:43.149643 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:43.194184 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312e828-6983-4580-9be4-542d05ce1354 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:43.201177 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b41c0e-dff7-4db1-85cf-a2852e779e0b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:43.249688 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581da3f-6d6c-4365-91f8-a4cf5ccf01ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:43.250309 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581da3f-6d6c-4365-91f8-a4cf5ccf01ee None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:43.250585 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581da3f-6d6c-4365-91f8-a4cf5ccf01ee None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:43.250857 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581da3f-6d6c-4365-91f8-a4cf5ccf01ee None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:43.251745 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9581da3f-6d6c-4365-91f8-a4cf5ccf01ee None admin] RBAC: Adding query filter params (name=reader) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:43.252077 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9581da3f-6d6c-4365-91f8-a4cf5ccf01ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:43.254910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9581da3f-6d6c-4365-91f8-a4cf5ccf01ee None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:43.263154 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9ec96-c7e4-4cc8-aa56-66226101c73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:43.264447 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9ec96-c7e4-4cc8-aa56-66226101c73c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:43.264938 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9ec96-c7e4-4cc8-aa56-66226101c73c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:43.265416 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9ec96-c7e4-4cc8-aa56-66226101c73c None admin] PATH_INFO: `/v3/groups/2731fdf88f5d4c6cb1183da85421d6a3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:43.265940 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 179/365] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:43.269694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581da3f-6d6c-4365-91f8-a4cf5ccf01ee None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:43.272079 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9ec96-c7e4-4cc8-aa56-66226101c73c None admin] RBAC: Authorizing `identity:get_group(group_id=2731fdf88f5d4c6cb1183da85421d6a3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:43.273826 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9ec96-c7e4-4cc8-aa56-66226101c73c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:43.276631 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 187/366] 10.222.0.69 () {56 vars in 1180 bytes} [Mon Aug 29 21:25:43 2022] GET /identity/v3/groups/2731fdf88f5d4c6cb1183da85421d6a3 => generated 226 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:43.277586 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9ec96-c7e4-4cc8-aa56-66226101c73c None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:43.405026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581da3f-6d6c-4365-91f8-a4cf5ccf01ee None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:43.441756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9ec96-c7e4-4cc8-aa56-66226101c73c None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:43.448331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:43.463915 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17d7a5-b490-48b2-bb8d-d3da57d04c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:43.464944 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17d7a5-b490-48b2-bb8d-d3da57d04c02 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:43.465415 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17d7a5-b490-48b2-bb8d-d3da57d04c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:43.465873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17d7a5-b490-48b2-bb8d-d3da57d04c02 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:43.467164 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17d7a5-b490-48b2-bb8d-d3da57d04c02 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:43.467688 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17d7a5-b490-48b2-bb8d-d3da57d04c02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:43.469612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17d7a5-b490-48b2-bb8d-d3da57d04c02 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:43.473104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:43.482579 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 180/367] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:25:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:43.483783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17d7a5-b490-48b2-bb8d-d3da57d04c02 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:43.509594 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6d06b-6055-4a63-baa1-3026563db959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:43.510647 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6d06b-6055-4a63-baa1-3026563db959 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:43.511311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6d06b-6055-4a63-baa1-3026563db959 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:43.511577 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6d06b-6055-4a63-baa1-3026563db959 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:43.531485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6d06b-6055-4a63-baa1-3026563db959 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:43.541357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-59e6d06b-6055-4a63-baa1-3026563db959 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:25:43.541357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:43.541357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:43.541357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:43.541357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:43.541357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:43.541357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:43.541357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:43.541357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:43.541357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:43.541357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:43.541357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:43.541357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:43.541357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:43.541357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:43.541357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:43.542323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:43.542323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:43.542323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:43.542323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:43.542323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:43.542323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:43.542323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:43.542323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:43.542323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:43.542323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:43.542323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:43.542323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:43.542323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:43.542323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:43.542323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:43.542323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:43.543129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:43.543129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:43.543129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:43.543129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:43.543129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:43.543129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:43.543129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:43.543129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:43.543129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:43.543129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:43.543129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:25:43.543129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:25:43.543764 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 188/368] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:25:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:43.545316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6d06b-6055-4a63-baa1-3026563db959 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:43.613432 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17d7a5-b490-48b2-bb8d-d3da57d04c02 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:43.665102 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b576e75-5b26-4696-8596-8224f19013c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:43.666576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b576e75-5b26-4696-8596-8224f19013c2 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:43.667355 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b576e75-5b26-4696-8596-8224f19013c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:43.667838 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b576e75-5b26-4696-8596-8224f19013c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:43.668939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b576e75-5b26-4696-8596-8224f19013c2 None admin] RBAC: Adding query filter params (group.id=2731fdf88f5d4c6cb1183da85421d6a3, role.id=29d2c7708bea4287a21112bb7ffa72df, scope.project.id=5e57c96553df40ff975ec73f2b01cda6) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:43.669777 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b576e75-5b26-4696-8596-8224f19013c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:43.671426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b576e75-5b26-4696-8596-8224f19013c2 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:43.680102 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 181/369] 10.222.0.69 () {56 vars in 1376 bytes} [Mon Aug 29 21:25:43 2022] GET /identity/v3/role_assignments?group.id=2731fdf88f5d4c6cb1183da85421d6a3&scope.project.id=5e57c96553df40ff975ec73f2b01cda6&role.id=29d2c7708bea4287a21112bb7ffa72df => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:43.684318 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b576e75-5b26-4696-8596-8224f19013c2 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:43.700483 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6d06b-6055-4a63-baa1-3026563db959 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:43.768881 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6907b-b04a-4207-9055-08ff227d6870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:43.769548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6907b-b04a-4207-9055-08ff227d6870 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:43.769901 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6907b-b04a-4207-9055-08ff227d6870 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:43.770181 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6907b-b04a-4207-9055-08ff227d6870 None admin] PATH_INFO: `/v3/users/2d5c87d251b147d086c43c7ecc4940c8` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:43.771467 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6907b-b04a-4207-9055-08ff227d6870 None admin] RBAC: Authorizing `identity:get_user(user_id=2d5c87d251b147d086c43c7ecc4940c8)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:43.772973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6907b-b04a-4207-9055-08ff227d6870 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:43.777210 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 189/370] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:25:43 2022] GET /identity/v3/users/2d5c87d251b147d086c43c7ecc4940c8 => generated 293 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:43.778073 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6907b-b04a-4207-9055-08ff227d6870 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:43.817015 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:43.855132 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:43.898077 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b576e75-5b26-4696-8596-8224f19013c2 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:43.959895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec28ff-6bde-401a-8da3-15810aecdd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:43.960885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec28ff-6bde-401a-8da3-15810aecdd50 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:43.961390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec28ff-6bde-401a-8da3-15810aecdd50 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:43.962403 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec28ff-6bde-401a-8da3-15810aecdd50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:43.977077 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6907b-b04a-4207-9055-08ff227d6870 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:44.021585 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c544811-4cbd-4348-b88e-80032699ea56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:44.022209 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c544811-4cbd-4348-b88e-80032699ea56 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:44.022491 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c544811-4cbd-4348-b88e-80032699ea56 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:44.022769 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c544811-4cbd-4348-b88e-80032699ea56 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:44.024703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c544811-4cbd-4348-b88e-80032699ea56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:44.025028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c544811-4cbd-4348-b88e-80032699ea56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:44.026414 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c544811-4cbd-4348-b88e-80032699ea56 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:44.041808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 190/371] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:44.042763 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c544811-4cbd-4348-b88e-80032699ea56 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:44.062801 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec28ff-6bde-401a-8da3-15810aecdd50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:44.064607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec28ff-6bde-401a-8da3-15810aecdd50 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:44.136432 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:44.184509 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:44.191978 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 182/372] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:25:44.192961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c544811-4cbd-4348-b88e-80032699ea56 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:44.193351 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec28ff-6bde-401a-8da3-15810aecdd50 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:44.235364 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d3aca-4218-401c-8eaf-b83ae2c1ed91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:44.236360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d3aca-4218-401c-8eaf-b83ae2c1ed91 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:44.236651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d3aca-4218-401c-8eaf-b83ae2c1ed91 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:44.236927 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d3aca-4218-401c-8eaf-b83ae2c1ed91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:44.237892 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d3aca-4218-401c-8eaf-b83ae2c1ed91 None admin] RBAC: Adding query filter params (role.id=1047d24970f744c38f38ecc563f0f61d, user.id=2d5c87d251b147d086c43c7ecc4940c8, scope.system=all) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:44.238300 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d3aca-4218-401c-8eaf-b83ae2c1ed91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:44.240778 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d3aca-4218-401c-8eaf-b83ae2c1ed91 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:44.256422 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 191/373] 10.222.0.69 () {56 vars in 1308 bytes} [Mon Aug 29 21:25:44 2022] GET /identity/v3/role_assignments?user.id=2d5c87d251b147d086c43c7ecc4940c8&scope.system=all&role.id=1047d24970f744c38f38ecc563f0f61d => generated 510 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:44.257864 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d3aca-4218-401c-8eaf-b83ae2c1ed91 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:44.424212 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d3aca-4218-401c-8eaf-b83ae2c1ed91 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:44.481321 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34db004-186e-443d-ae97-2c4d230b9784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:44.481995 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34db004-186e-443d-ae97-2c4d230b9784 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:44.482414 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34db004-186e-443d-ae97-2c4d230b9784 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:44.482743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34db004-186e-443d-ae97-2c4d230b9784 None admin] PATH_INFO: `/v3/projects/5e57c96553df40ff975ec73f2b01cda6` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:44.484090 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34db004-186e-443d-ae97-2c4d230b9784 None admin] RBAC: Authorizing `identity:get_project(project_id=5e57c96553df40ff975ec73f2b01cda6)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:44.485771 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34db004-186e-443d-ae97-2c4d230b9784 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:44.488240 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 192/374] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:44 2022] GET /identity/v3/projects/5e57c96553df40ff975ec73f2b01cda6 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:44.497944 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34db004-186e-443d-ae97-2c4d230b9784 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:44.524219 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec28ff-6bde-401a-8da3-15810aecdd50 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:44.560645 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:44.613017 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c884d82-5680-44c8-9c32-fab9bf3cf52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:44.613919 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c884d82-5680-44c8-9c32-fab9bf3cf52c None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:44.614776 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c884d82-5680-44c8-9c32-fab9bf3cf52c None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:44.615047 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c884d82-5680-44c8-9c32-fab9bf3cf52c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:44.647940 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34db004-186e-443d-ae97-2c4d230b9784 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:44.657007 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:44.699353 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c884d82-5680-44c8-9c32-fab9bf3cf52c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:44.700982 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c884d82-5680-44c8-9c32-fab9bf3cf52c None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:44.710100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce15e58-2791-4075-a2b7-d8b59342ff59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:44.711465 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce15e58-2791-4075-a2b7-d8b59342ff59 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:44.711933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce15e58-2791-4075-a2b7-d8b59342ff59 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:44.712390 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce15e58-2791-4075-a2b7-d8b59342ff59 None admin] PATH_INFO: `/v3/groups/2731fdf88f5d4c6cb1183da85421d6a3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:44.717884 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce15e58-2791-4075-a2b7-d8b59342ff59 None admin] RBAC: Authorizing `identity:get_group(group_id=2731fdf88f5d4c6cb1183da85421d6a3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:44.719629 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce15e58-2791-4075-a2b7-d8b59342ff59 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:44.721953 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 193/375] 10.222.0.69 () {56 vars in 1180 bytes} [Mon Aug 29 21:25:44 2022] GET /identity/v3/groups/2731fdf88f5d4c6cb1183da85421d6a3 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:44.728017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce15e58-2791-4075-a2b7-d8b59342ff59 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:44.816389 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 183/376] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:25:44.822318 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c884d82-5680-44c8-9c32-fab9bf3cf52c None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:44.891491 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:44.912332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce15e58-2791-4075-a2b7-d8b59342ff59 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:44.923639 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:44.962079 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9e161-bfd3-4b06-8c7f-f096a8021fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:44.962789 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c884d82-5680-44c8-9c32-fab9bf3cf52c None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:44.962899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9e161-bfd3-4b06-8c7f-f096a8021fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:44.963289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9e161-bfd3-4b06-8c7f-f096a8021fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:44.963627 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9e161-bfd3-4b06-8c7f-f096a8021fa7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:44.964656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9e161-bfd3-4b06-8c7f-f096a8021fa7 None admin] RBAC: Adding query filter params (group.id=2731fdf88f5d4c6cb1183da85421d6a3, role.id=ecbc0b9f55214a93a2016b3625d94764, scope.project.id=5e57c96553df40ff975ec73f2b01cda6) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:44.965884 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9e161-bfd3-4b06-8c7f-f096a8021fa7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:44.967431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9e161-bfd3-4b06-8c7f-f096a8021fa7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:44.975343 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 194/377] 10.222.0.69 () {56 vars in 1376 bytes} [Mon Aug 29 21:25:44 2022] GET /identity/v3/role_assignments?group.id=2731fdf88f5d4c6cb1183da85421d6a3&scope.project.id=5e57c96553df40ff975ec73f2b01cda6&role.id=ecbc0b9f55214a93a2016b3625d94764 => generated 260 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:44.976985 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60f242-9c66-48d9-9019-f1109adda818 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:44.978098 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60f242-9c66-48d9-9019-f1109adda818 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:44.978378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60f242-9c66-48d9-9019-f1109adda818 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:44.984606 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 195/378] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:44.986088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56467378-362a-4b4e-8298-86d549607f83 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:44.986371 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56467378-362a-4b4e-8298-86d549607f83 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:44.986730 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56467378-362a-4b4e-8298-86d549607f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:45.019867 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-56467378-362a-4b4e-8298-86d549607f83 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:45.021547 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-56467378-362a-4b4e-8298-86d549607f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:45.042306 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8910f0-3c9d-48b2-be54-659ad3b8d181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:45.042968 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8910f0-3c9d-48b2-be54-659ad3b8d181 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:45.043241 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8910f0-3c9d-48b2-be54-659ad3b8d181 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:45.043566 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8910f0-3c9d-48b2-be54-659ad3b8d181 None admin] PATH_INFO: `/v3/projects/4b8cd30653804c0ead71897871920ce2` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:45.044898 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8910f0-3c9d-48b2-be54-659ad3b8d181 None admin] RBAC: Authorizing `identity:get_project(project_id=4b8cd30653804c0ead71897871920ce2)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:45.046432 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8910f0-3c9d-48b2-be54-659ad3b8d181 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:45.048212 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 184/379] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:44 2022] GET /identity/v3/projects/4b8cd30653804c0ead71897871920ce2 => generated 344 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:45.054703 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8910f0-3c9d-48b2-be54-659ad3b8d181 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:45.188228 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 196/380] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:45.251599 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8910f0-3c9d-48b2-be54-659ad3b8d181 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:45.287014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:45.295954 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f63f3-fbea-4d3d-a4fc-da0368181493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:45.296626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f63f3-fbea-4d3d-a4fc-da0368181493 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:45.296902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f63f3-fbea-4d3d-a4fc-da0368181493 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:45.297175 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f63f3-fbea-4d3d-a4fc-da0368181493 None admin] PATH_INFO: `/v3/groups/94afabff487248f2a7771283c2c8741e` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:45.303837 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f63f3-fbea-4d3d-a4fc-da0368181493 None admin] RBAC: Authorizing `identity:get_group(group_id=94afabff487248f2a7771283c2c8741e)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:45.305839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f63f3-fbea-4d3d-a4fc-da0368181493 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:45.307495 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 185/381] 10.222.0.69 () {56 vars in 1180 bytes} [Mon Aug 29 21:25:45 2022] GET /identity/v3/groups/94afabff487248f2a7771283c2c8741e => generated 229 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:45.313664 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56467378-362a-4b4e-8298-86d549607f83 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:45.417747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:45.454119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56467378-362a-4b4e-8298-86d549607f83 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:45.496421 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162f677-01a6-43d7-b07f-4bbfd7aaff18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:45.497047 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162f677-01a6-43d7-b07f-4bbfd7aaff18 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:45.497325 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162f677-01a6-43d7-b07f-4bbfd7aaff18 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:45.497596 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162f677-01a6-43d7-b07f-4bbfd7aaff18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:45.498319 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162f677-01a6-43d7-b07f-4bbfd7aaff18 None admin] RBAC: Adding query filter params (group.id=94afabff487248f2a7771283c2c8741e, role.id=69369872661e4179bb51cd1ca76e28c3, scope.project.id=4b8cd30653804c0ead71897871920ce2) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:45.498626 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162f677-01a6-43d7-b07f-4bbfd7aaff18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:45.500044 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162f677-01a6-43d7-b07f-4bbfd7aaff18 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:45.507802 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 197/382] 10.222.0.69 () {56 vars in 1376 bytes} [Mon Aug 29 21:25:45 2022] GET /identity/v3/role_assignments?group.id=94afabff487248f2a7771283c2c8741e&scope.project.id=4b8cd30653804c0ead71897871920ce2&role.id=69369872661e4179bb51cd1ca76e28c3 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:45.616252 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f63f3-fbea-4d3d-a4fc-da0368181493 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:45.774506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f63f3-fbea-4d3d-a4fc-da0368181493 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:45.813370 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef1df1-f9cb-4481-9830-d5a7e73a6e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:45.814018 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef1df1-f9cb-4481-9830-d5a7e73a6e83 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:45.814298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef1df1-f9cb-4481-9830-d5a7e73a6e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:45.814574 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef1df1-f9cb-4481-9830-d5a7e73a6e83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:45.828508 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef1df1-f9cb-4481-9830-d5a7e73a6e83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:45.834090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-e9ef1df1-f9cb-4481-9830-d5a7e73a6e83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:45.834090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:45.834090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:45.834090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:45.834090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:45.834090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:45.834090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:45.834090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:45.834090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:45.834090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:45.834090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:45.834090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:45.834090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:45.834090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:45.834090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:45.834090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:45.835156 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:45.835156 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:45.835156 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:45.835156 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:45.835156 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:45.835156 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:45.835156 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:45.835156 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:45.835156 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:45.835156 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:45.835156 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:45.835156 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:45.835156 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:45.835156 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:45.835156 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:45.835156 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:45.835960 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:45.835960 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:45.835960 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:45.835960 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:45.835960 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:45.835960 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:45.835960 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:45.835960 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:45.835960 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:45.835960 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:45.835960 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:45.835960 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:45.835960 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 186/383] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:45.841930 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162f677-01a6-43d7-b07f-4bbfd7aaff18 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:45.947596 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222396b-fdb4-4b7b-b976-f87ae7bfb850 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:45.948238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222396b-fdb4-4b7b-b976-f87ae7bfb850 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:45.948711 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222396b-fdb4-4b7b-b976-f87ae7bfb850 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:45.950529 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 187/384] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:45.956380 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5f4a0-a045-49e3-96ec-9ed7ab12b589 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:45.956926 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5f4a0-a045-49e3-96ec-9ed7ab12b589 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:45.957407 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5f4a0-a045-49e3-96ec-9ed7ab12b589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:45.978955 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162f677-01a6-43d7-b07f-4bbfd7aaff18 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:45.997252 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-60d5f4a0-a045-49e3-96ec-9ed7ab12b589 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:45.998463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-60d5f4a0-a045-49e3-96ec-9ed7ab12b589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:46.020199 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7ad96-4c68-48f5-9ce0-d5a94665d908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:46.020820 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7ad96-4c68-48f5-9ce0-d5a94665d908 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:46.021105 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7ad96-4c68-48f5-9ce0-d5a94665d908 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:46.021383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7ad96-4c68-48f5-9ce0-d5a94665d908 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:46.022059 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7ad96-4c68-48f5-9ce0-d5a94665d908 None admin] RBAC: Adding query filter params (name=member) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:46.022372 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7ad96-4c68-48f5-9ce0-d5a94665d908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:46.023764 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7ad96-4c68-48f5-9ce0-d5a94665d908 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:46.046319 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 198/385] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:46.051070 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7ad96-4c68-48f5-9ce0-d5a94665d908 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:46.074059 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:46.097353 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:46.141913 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 188/386] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:46.209959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7ad96-4c68-48f5-9ce0-d5a94665d908 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:46.263606 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ca59a-bd9f-4086-80fa-7f228c4f39c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:46.264519 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ca59a-bd9f-4086-80fa-7f228c4f39c7 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:46.264939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ca59a-bd9f-4086-80fa-7f228c4f39c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:46.265435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ca59a-bd9f-4086-80fa-7f228c4f39c7 None admin] PATH_INFO: `/v3/groups/2731fdf88f5d4c6cb1183da85421d6a3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:46.272856 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ca59a-bd9f-4086-80fa-7f228c4f39c7 None admin] RBAC: Authorizing `identity:get_group(group_id=2731fdf88f5d4c6cb1183da85421d6a3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:46.275055 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ca59a-bd9f-4086-80fa-7f228c4f39c7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:46.277256 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 199/387] 10.222.0.69 () {56 vars in 1180 bytes} [Mon Aug 29 21:25:46 2022] GET /identity/v3/groups/2731fdf88f5d4c6cb1183da85421d6a3 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:46.282924 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5f4a0-a045-49e3-96ec-9ed7ab12b589 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:46.449861 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5f4a0-a045-49e3-96ec-9ed7ab12b589 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:46.501063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b204d15-46b9-4d68-8d5c-fe2655b3be8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:46.501703 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b204d15-46b9-4d68-8d5c-fe2655b3be8f None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:46.501981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b204d15-46b9-4d68-8d5c-fe2655b3be8f None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:46.502254 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b204d15-46b9-4d68-8d5c-fe2655b3be8f None admin] PATH_INFO: `/v3/projects/9e54ec3d9806409e8a45d9a82823741d` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:46.503382 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b204d15-46b9-4d68-8d5c-fe2655b3be8f None admin] RBAC: Authorizing `identity:get_project(project_id=9e54ec3d9806409e8a45d9a82823741d)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:46.505069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b204d15-46b9-4d68-8d5c-fe2655b3be8f None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:46.506990 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 189/388] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:46 2022] GET /identity/v3/projects/9e54ec3d9806409e8a45d9a82823741d => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:46.513254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ca59a-bd9f-4086-80fa-7f228c4f39c7 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:46.549945 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b204d15-46b9-4d68-8d5c-fe2655b3be8f None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:46.636678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:46.644521 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:46.668349 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ca59a-bd9f-4086-80fa-7f228c4f39c7 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:46.697284 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b204d15-46b9-4d68-8d5c-fe2655b3be8f None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:46.706042 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3b509-0c50-4c0e-9a6e-b86de622d57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:46.707209 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3b509-0c50-4c0e-9a6e-b86de622d57c None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:46.707667 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3b509-0c50-4c0e-9a6e-b86de622d57c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:46.708611 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3b509-0c50-4c0e-9a6e-b86de622d57c None admin] PATH_INFO: `/v3/projects/9e54ec3d9806409e8a45d9a82823741d/groups/2731fdf88f5d4c6cb1183da85421d6a3/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:46.710760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3b509-0c50-4c0e-9a6e-b86de622d57c None admin] RBAC: Authorizing `identity:create_grant(project_id=9e54ec3d9806409e8a45d9a82823741d, group_id=2731fdf88f5d4c6cb1183da85421d6a3, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:46.713182 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3b509-0c50-4c0e-9a6e-b86de622d57c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:46.732352 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 200/389] 10.222.0.69 () {58 vars in 1442 bytes} [Mon Aug 29 21:25:46 2022] PUT /identity/v3/projects/9e54ec3d9806409e8a45d9a82823741d/groups/2731fdf88f5d4c6cb1183da85421d6a3/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:25:46.734030 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f94477-6a9d-4bf9-ae05-5e4321a33ad4 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:46.734518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f94477-6a9d-4bf9-ae05-5e4321a33ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:46.734935 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f94477-6a9d-4bf9-ae05-5e4321a33ad4 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:46.736542 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 201/390] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:46.742971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d9b4b-894d-46b4-809c-5496fcb772ba None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:46.743595 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d9b4b-894d-46b4-809c-5496fcb772ba None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:46.744021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d9b4b-894d-46b4-809c-5496fcb772ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:46.752149 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d6916-0b9d-45fa-8f51-30b2229c23bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:46.753077 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d6916-0b9d-45fa-8f51-30b2229c23bb None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:46.753780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d6916-0b9d-45fa-8f51-30b2229c23bb None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:46.754324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d6916-0b9d-45fa-8f51-30b2229c23bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:46.766355 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-051d9b4b-894d-46b4-809c-5496fcb772ba None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:46.767979 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-051d9b4b-894d-46b4-809c-5496fcb772ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:46.789387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d6916-0b9d-45fa-8f51-30b2229c23bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:46.795594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-9e5d6916-0b9d-45fa-8f51-30b2229c23bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:25:46.795594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:46.795594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:46.795594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:46.795594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:46.795594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:46.795594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:46.795594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:46.795594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:46.795594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:46.795594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:46.795594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:46.795594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:46.795594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:46.795594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:46.795594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:46.796783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:46.796783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:46.796783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:46.796783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:46.796783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:46.796783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:46.796783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:46.796783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:46.796783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:46.796783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:46.796783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:46.796783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:46.796783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:46.796783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:46.796783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:46.796783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:46.797833 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:46.797833 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:46.797833 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:46.797833 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:46.797833 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:46.797833 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:46.797833 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:46.797833 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:46.797833 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:46.797833 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:46.797833 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:25:46.797833 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:46.808233 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 190/391] 10.222.0.69 () {56 vars in 1114 bytes} [Mon Aug 29 21:25:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:25:46.821341 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d6916-0b9d-45fa-8f51-30b2229c23bb None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:46.871036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 202/392] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:47.011401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d6916-0b9d-45fa-8f51-30b2229c23bb None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:47.026240 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:47.049885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7f029-d02d-45b5-92f0-782bd13fcba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:47.050420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7f029-d02d-45b5-92f0-782bd13fcba8 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:47.050697 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7f029-d02d-45b5-92f0-782bd13fcba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:47.050970 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7f029-d02d-45b5-92f0-782bd13fcba8 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:47.051644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7f029-d02d-45b5-92f0-782bd13fcba8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:47.051945 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7f029-d02d-45b5-92f0-782bd13fcba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:47.053352 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7f029-d02d-45b5-92f0-782bd13fcba8 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:47.063059 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 191/393] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:25:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:47.068669 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d9b4b-894d-46b4-809c-5496fcb772ba None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:47.167294 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:47.193809 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7f029-d02d-45b5-92f0-782bd13fcba8 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:47.216562 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d9b4b-894d-46b4-809c-5496fcb772ba None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:47.288275 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeaa8ad-2355-4feb-9b69-29331de4c9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:47.288847 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaa8ad-2355-4feb-9b69-29331de4c9df None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:47.289382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaa8ad-2355-4feb-9b69-29331de4c9df None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:47.289662 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaa8ad-2355-4feb-9b69-29331de4c9df None admin] PATH_INFO: `/v3/groups/2731fdf88f5d4c6cb1183da85421d6a3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:47.291333 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeaa8ad-2355-4feb-9b69-29331de4c9df None admin] RBAC: Authorizing `identity:get_group(group_id=2731fdf88f5d4c6cb1183da85421d6a3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:47.293226 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeaa8ad-2355-4feb-9b69-29331de4c9df None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:47.295263 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 203/394] 10.222.0.69 () {56 vars in 1180 bytes} [Mon Aug 29 21:25:47 2022] GET /identity/v3/groups/2731fdf88f5d4c6cb1183da85421d6a3 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:47.300562 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeaa8ad-2355-4feb-9b69-29331de4c9df None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:47.400587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7f029-d02d-45b5-92f0-782bd13fcba8 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:47.456139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd7e46-1116-40d1-967c-734e7a1c49cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:47.456808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd7e46-1116-40d1-967c-734e7a1c49cc None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:47.457083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd7e46-1116-40d1-967c-734e7a1c49cc None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:47.457348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd7e46-1116-40d1-967c-734e7a1c49cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:47.470383 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd7e46-1116-40d1-967c-734e7a1c49cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:47.476062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-fbfd7e46-1116-40d1-967c-734e7a1c49cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:47.476062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:47.476062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:47.476062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:47.476062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:47.476062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:47.476062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:47.476062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:47.476062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:47.476062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:47.476062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:47.476062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:47.476062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:47.476062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:47.476062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:47.476062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:47.476992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:47.476992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:47.476992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:47.476992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:47.476992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:47.476992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:47.476992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:47.476992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:47.476992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:47.476992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:47.476992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:47.476992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:47.476992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:47.476992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:47.476992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:47.476992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:47.478404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:47.478404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:47.478404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:47.478404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:47.478404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:47.478404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:47.478404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:47.478404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:47.478404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:47.478404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:47.478404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:47.478404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:47.478404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 192/395] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:47.479812 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c3cf3-c6cd-4c9c-a162-b83d40ab8a64 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:47.479812 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c3cf3-c6cd-4c9c-a162-b83d40ab8a64 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:47.480104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c3cf3-c6cd-4c9c-a162-b83d40ab8a64 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:47.486006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 193/396] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:47.487287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeaa8ad-2355-4feb-9b69-29331de4c9df None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:47.487890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c3cf3-c6cd-4c9c-a162-b83d40ab8a64 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:47.525622 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23b963-8a58-4113-9b62-4ce5d1a72899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:47.526272 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23b963-8a58-4113-9b62-4ce5d1a72899 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:47.526538 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23b963-8a58-4113-9b62-4ce5d1a72899 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:47.526813 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23b963-8a58-4113-9b62-4ce5d1a72899 None admin] PATH_INFO: `/v3/projects/9e54ec3d9806409e8a45d9a82823741d` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:47.527970 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23b963-8a58-4113-9b62-4ce5d1a72899 None admin] RBAC: Authorizing `identity:get_project(project_id=9e54ec3d9806409e8a45d9a82823741d)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:47.528505 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:47.530736 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23b963-8a58-4113-9b62-4ce5d1a72899 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:47.533184 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 204/397] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:47 2022] GET /identity/v3/projects/9e54ec3d9806409e8a45d9a82823741d => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:47.534674 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255494a7-a8d3-4234-b5c5-29c0b266f7e6 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:47.535106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255494a7-a8d3-4234-b5c5-29c0b266f7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:47.536340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255494a7-a8d3-4234-b5c5-29c0b266f7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:47.544084 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:47.563649 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-255494a7-a8d3-4234-b5c5-29c0b266f7e6 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:47.564867 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-255494a7-a8d3-4234-b5c5-29c0b266f7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:47.616035 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c3cf3-c6cd-4c9c-a162-b83d40ab8a64 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:47.659818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 205/398] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:47.660474 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef56c63-fa95-4896-b03b-23d87d941051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:47.661005 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255494a7-a8d3-4234-b5c5-29c0b266f7e6 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:47.661251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef56c63-fa95-4896-b03b-23d87d941051 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:47.661652 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef56c63-fa95-4896-b03b-23d87d941051 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:47.661934 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef56c63-fa95-4896-b03b-23d87d941051 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:47.662619 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef56c63-fa95-4896-b03b-23d87d941051 None admin] RBAC: Adding query filter params (name=member) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:47.662920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef56c63-fa95-4896-b03b-23d87d941051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:47.666297 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef56c63-fa95-4896-b03b-23d87d941051 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:47.678274 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 194/399] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:47.683853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef56c63-fa95-4896-b03b-23d87d941051 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:47.849797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255494a7-a8d3-4234-b5c5-29c0b266f7e6 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:47.884039 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:47.895093 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef56c63-fa95-4896-b03b-23d87d941051 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:47.906516 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:47.915583 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7533f-da13-447e-bc86-c857d28ea75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:47.916283 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7533f-da13-447e-bc86-c857d28ea75b None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:47.916569 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7533f-da13-447e-bc86-c857d28ea75b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:47.916843 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7533f-da13-447e-bc86-c857d28ea75b None admin] PATH_INFO: `/v3/projects/9e54ec3d9806409e8a45d9a82823741d/groups/2731fdf88f5d4c6cb1183da85421d6a3/roles/ecbc0b9f55214a93a2016b3625d94764` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:47.920909 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7533f-da13-447e-bc86-c857d28ea75b None admin] RBAC: Authorizing `identity:create_grant(project_id=9e54ec3d9806409e8a45d9a82823741d, group_id=2731fdf88f5d4c6cb1183da85421d6a3, role_id=ecbc0b9f55214a93a2016b3625d94764)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:47.922369 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7533f-da13-447e-bc86-c857d28ea75b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:47.943666 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 206/400] 10.222.0.69 () {58 vars in 1442 bytes} [Mon Aug 29 21:25:47 2022] PUT /identity/v3/projects/9e54ec3d9806409e8a45d9a82823741d/groups/2731fdf88f5d4c6cb1183da85421d6a3/roles/ecbc0b9f55214a93a2016b3625d94764 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:25:47.955127 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264d8fe-11ed-4f87-855a-159737831ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:47.955837 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264d8fe-11ed-4f87-855a-159737831ddf None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:47.956124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264d8fe-11ed-4f87-855a-159737831ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:47.956463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264d8fe-11ed-4f87-855a-159737831ddf None admin] PATH_INFO: `/v3/groups/2731fdf88f5d4c6cb1183da85421d6a3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:47.957627 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264d8fe-11ed-4f87-855a-159737831ddf None admin] RBAC: Authorizing `identity:get_group(group_id=2731fdf88f5d4c6cb1183da85421d6a3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:47.959098 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264d8fe-11ed-4f87-855a-159737831ddf None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:47.961235 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 195/401] 10.222.0.69 () {56 vars in 1180 bytes} [Mon Aug 29 21:25:47 2022] GET /identity/v3/groups/2731fdf88f5d4c6cb1183da85421d6a3 => generated 226 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:47.969913 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7533f-da13-447e-bc86-c857d28ea75b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:48.014061 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264d8fe-11ed-4f87-855a-159737831ddf None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:48.135723 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264d8fe-11ed-4f87-855a-159737831ddf None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:48.178928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7533f-da13-447e-bc86-c857d28ea75b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:48.180919 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99f9e7-aa81-4446-a906-1e01b9b378ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:48.181684 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99f9e7-aa81-4446-a906-1e01b9b378ce None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:48.182064 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99f9e7-aa81-4446-a906-1e01b9b378ce None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:48.182436 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99f9e7-aa81-4446-a906-1e01b9b378ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:48.194227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99f9e7-aa81-4446-a906-1e01b9b378ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:48.200540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-8e99f9e7-aa81-4446-a906-1e01b9b378ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:25:48.200540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:48.200540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:48.200540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:48.200540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:48.200540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:48.200540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:48.200540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:48.200540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:48.200540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:48.200540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:48.200540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:48.200540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:48.200540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:48.200540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:48.200540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:48.201506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:48.201506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:48.201506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:48.201506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:48.201506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:48.201506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:48.201506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:48.201506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:48.201506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:48.201506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:48.201506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:48.201506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:48.201506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:48.201506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:48.201506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:48.201506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:48.202322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:48.202322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:48.202322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:48.202322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:48.202322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:48.202322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:48.202322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:48.202322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:48.202322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:48.202322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:48.202322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:25:48.202322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:48.206982 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 196/402] 10.222.0.69 () {56 vars in 1114 bytes} [Mon Aug 29 21:25:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:25:48.208403 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277b1bc-46a1-4775-a9e7-5049fc8183dd None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:48.209133 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277b1bc-46a1-4775-a9e7-5049fc8183dd None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:48.209133 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277b1bc-46a1-4775-a9e7-5049fc8183dd None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:48.210414 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 197/403] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:48.216219 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ead51-63e2-4794-bdfe-8a5b86c8d830 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:48.216562 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ead51-63e2-4794-bdfe-8a5b86c8d830 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:48.216788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ead51-63e2-4794-bdfe-8a5b86c8d830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:48.226402 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9be62d-c1ab-4857-af77-8757dd8df968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:48.227064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9be62d-c1ab-4857-af77-8757dd8df968 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:48.227382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9be62d-c1ab-4857-af77-8757dd8df968 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:48.227654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9be62d-c1ab-4857-af77-8757dd8df968 None admin] PATH_INFO: `/v3/projects/5e57c96553df40ff975ec73f2b01cda6` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:48.230288 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9be62d-c1ab-4857-af77-8757dd8df968 None admin] RBAC: Authorizing `identity:get_project(project_id=5e57c96553df40ff975ec73f2b01cda6)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:48.231748 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9be62d-c1ab-4857-af77-8757dd8df968 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:48.233691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 207/404] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:47 2022] GET /identity/v3/projects/5e57c96553df40ff975ec73f2b01cda6 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:48.234678 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9be62d-c1ab-4857-af77-8757dd8df968 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:48.238354 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-582ead51-63e2-4794-bdfe-8a5b86c8d830 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:48.239990 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-582ead51-63e2-4794-bdfe-8a5b86c8d830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:48.261812 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:48.313345 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:48.320499 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 198/405] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:25:48.322030 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ead51-63e2-4794-bdfe-8a5b86c8d830 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:48.399504 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9be62d-c1ab-4857-af77-8757dd8df968 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:48.484836 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93264642-59fd-4c9c-a053-830a4bf9aa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:48.485598 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93264642-59fd-4c9c-a053-830a4bf9aa05 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:48.485884 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93264642-59fd-4c9c-a053-830a4bf9aa05 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:48.486152 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93264642-59fd-4c9c-a053-830a4bf9aa05 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:48.486880 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93264642-59fd-4c9c-a053-830a4bf9aa05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:48.487188 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93264642-59fd-4c9c-a053-830a4bf9aa05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:48.488611 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93264642-59fd-4c9c-a053-830a4bf9aa05 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:48.506560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 208/406] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:25:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:48.513241 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93264642-59fd-4c9c-a053-830a4bf9aa05 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:48.518395 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ead51-63e2-4794-bdfe-8a5b86c8d830 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:48.586086 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de6757-da16-4536-b9db-4c8670578a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:48.586871 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de6757-da16-4536-b9db-4c8670578a30 None admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:48.587154 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de6757-da16-4536-b9db-4c8670578a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:48.587430 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de6757-da16-4536-b9db-4c8670578a30 None admin] PATH_INFO: `/v3/projects/5e57c96553df40ff975ec73f2b01cda6/groups/2731fdf88f5d4c6cb1183da85421d6a3/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:48.591054 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de6757-da16-4536-b9db-4c8670578a30 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e57c96553df40ff975ec73f2b01cda6, group_id=2731fdf88f5d4c6cb1183da85421d6a3, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:48.592830 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de6757-da16-4536-b9db-4c8670578a30 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:48.617217 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 199/407] 10.222.0.69 () {58 vars in 1442 bytes} [Mon Aug 29 21:25:48 2022] PUT /identity/v3/projects/5e57c96553df40ff975ec73f2b01cda6/groups/2731fdf88f5d4c6cb1183da85421d6a3/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:25:48.644772 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de6757-da16-4536-b9db-4c8670578a30 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:48.663737 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:48.707228 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93264642-59fd-4c9c-a053-830a4bf9aa05 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:48.770651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:48.773344 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de6757-da16-4536-b9db-4c8670578a30 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:48.796855 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502c080-a42c-4eae-afa2-627d5e1dbcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:48.797510 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502c080-a42c-4eae-afa2-627d5e1dbcdf None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:48.797795 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502c080-a42c-4eae-afa2-627d5e1dbcdf None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:48.798074 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502c080-a42c-4eae-afa2-627d5e1dbcdf None admin] PATH_INFO: `/v3/groups/2731fdf88f5d4c6cb1183da85421d6a3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:48.799437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502c080-a42c-4eae-afa2-627d5e1dbcdf None admin] RBAC: Authorizing `identity:get_group(group_id=2731fdf88f5d4c6cb1183da85421d6a3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:48.801061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502c080-a42c-4eae-afa2-627d5e1dbcdf None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:48.803255 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 209/408] 10.222.0.69 () {56 vars in 1180 bytes} [Mon Aug 29 21:25:48 2022] GET /identity/v3/groups/2731fdf88f5d4c6cb1183da85421d6a3 => generated 226 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:48.809849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502c080-a42c-4eae-afa2-627d5e1dbcdf None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:48.816866 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d8c1d-a804-407f-b2f8-e7f868c320e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:48.817520 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d8c1d-a804-407f-b2f8-e7f868c320e1 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:48.817802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d8c1d-a804-407f-b2f8-e7f868c320e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:48.818078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d8c1d-a804-407f-b2f8-e7f868c320e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:48.830349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d8c1d-a804-407f-b2f8-e7f868c320e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:48.837450 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-b30d8c1d-a804-407f-b2f8-e7f868c320e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:25:48.837450 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:48.837450 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:48.837450 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:48.837450 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:48.837450 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:48.837450 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:48.837450 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:48.837450 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:48.837450 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:48.837450 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:48.837450 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:48.837450 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:48.837450 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:48.837450 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:48.837450 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:48.838374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:48.838374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:48.838374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:48.838374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:48.838374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:48.838374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:48.838374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:48.838374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:48.838374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:48.838374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:48.838374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:48.838374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:48.838374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:48.838374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:48.838374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:48.838374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:48.839611 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:48.839611 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:48.839611 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:48.839611 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:48.839611 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:48.839611 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:48.839611 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:48.839611 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:48.839611 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:48.839611 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:48.839611 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:25:48.839611 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:48.839611 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 200/409] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:25:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:48.845171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d8c1d-a804-407f-b2f8-e7f868c320e1 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:48.944041 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:48.995611 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502c080-a42c-4eae-afa2-627d5e1dbcdf None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:48.999226 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d8c1d-a804-407f-b2f8-e7f868c320e1 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:49.045042 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfebe7d-244d-4273-b97d-69f5a36b2f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:49.046323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfebe7d-244d-4273-b97d-69f5a36b2f0e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:49.046773 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfebe7d-244d-4273-b97d-69f5a36b2f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:49.047056 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfebe7d-244d-4273-b97d-69f5a36b2f0e None admin] PATH_INFO: `/v3/projects/5e57c96553df40ff975ec73f2b01cda6` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:49.048729 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfebe7d-244d-4273-b97d-69f5a36b2f0e None admin] RBAC: Authorizing `identity:get_project(project_id=5e57c96553df40ff975ec73f2b01cda6)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:49.050198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfebe7d-244d-4273-b97d-69f5a36b2f0e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:49.052411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 210/410] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:48 2022] GET /identity/v3/projects/5e57c96553df40ff975ec73f2b01cda6 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:49.065349 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfebe7d-244d-4273-b97d-69f5a36b2f0e None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:49.090085 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a9645-ddfb-4742-9e21-66a17fbdc2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:49.091997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a9645-ddfb-4742-9e21-66a17fbdc2cf None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:49.093854 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a9645-ddfb-4742-9e21-66a17fbdc2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:49.094318 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a9645-ddfb-4742-9e21-66a17fbdc2cf None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:49.095131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a9645-ddfb-4742-9e21-66a17fbdc2cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:49.095764 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a9645-ddfb-4742-9e21-66a17fbdc2cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:49.098278 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a9645-ddfb-4742-9e21-66a17fbdc2cf None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:49.119762 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 201/411] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:49.128355 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a9645-ddfb-4742-9e21-66a17fbdc2cf None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:49.196677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:49.251273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfebe7d-244d-4273-b97d-69f5a36b2f0e None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:49.295473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a9645-ddfb-4742-9e21-66a17fbdc2cf None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:49.297435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20e079-aae8-4675-a100-18711ba1e46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:49.299182 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20e079-aae8-4675-a100-18711ba1e46e None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:49.299629 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20e079-aae8-4675-a100-18711ba1e46e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:49.300076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20e079-aae8-4675-a100-18711ba1e46e None admin] PATH_INFO: `/v3/projects/5e57c96553df40ff975ec73f2b01cda6/groups/2731fdf88f5d4c6cb1183da85421d6a3/roles/ecbc0b9f55214a93a2016b3625d94764` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:49.302719 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20e079-aae8-4675-a100-18711ba1e46e None admin] RBAC: Authorizing `identity:create_grant(project_id=5e57c96553df40ff975ec73f2b01cda6, group_id=2731fdf88f5d4c6cb1183da85421d6a3, role_id=ecbc0b9f55214a93a2016b3625d94764)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:49.304987 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20e079-aae8-4675-a100-18711ba1e46e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:49.323029 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 211/412] 10.222.0.69 () {58 vars in 1442 bytes} [Mon Aug 29 21:25:49 2022] PUT /identity/v3/projects/5e57c96553df40ff975ec73f2b01cda6/groups/2731fdf88f5d4c6cb1183da85421d6a3/roles/ecbc0b9f55214a93a2016b3625d94764 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:25:49.325101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad55ef7-4a51-4e31-8640-5161de1e4436 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:49.325101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad55ef7-4a51-4e31-8640-5161de1e4436 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:49.325343 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad55ef7-4a51-4e31-8640-5161de1e4436 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:49.331200 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 212/413] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:49.332938 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51280752-cef9-44cc-b263-94a6e0a4c3e0 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:49.333318 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51280752-cef9-44cc-b263-94a6e0a4c3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:49.333598 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51280752-cef9-44cc-b263-94a6e0a4c3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:49.351028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e5403-80cd-41cc-9613-be3a71083191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:49.352165 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e5403-80cd-41cc-9613-be3a71083191 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:49.352740 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e5403-80cd-41cc-9613-be3a71083191 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:49.353230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e5403-80cd-41cc-9613-be3a71083191 None admin] PATH_INFO: `/v3/groups/94afabff487248f2a7771283c2c8741e` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:49.355116 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e5403-80cd-41cc-9613-be3a71083191 None admin] RBAC: Authorizing `identity:get_group(group_id=94afabff487248f2a7771283c2c8741e)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:49.355547 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-51280752-cef9-44cc-b263-94a6e0a4c3e0 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:49.357092 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-51280752-cef9-44cc-b263-94a6e0a4c3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:49.357646 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e5403-80cd-41cc-9613-be3a71083191 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:49.360810 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 202/414] 10.222.0.69 () {56 vars in 1180 bytes} [Mon Aug 29 21:25:49 2022] GET /identity/v3/groups/94afabff487248f2a7771283c2c8741e => generated 229 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:49.369259 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e5403-80cd-41cc-9613-be3a71083191 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:49.384419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:49.514951 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 213/415] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:25:49.542651 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e5403-80cd-41cc-9613-be3a71083191 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:49.588396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0249538-8b29-4148-8c7d-6469e9f737b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:49.589040 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0249538-8b29-4148-8c7d-6469e9f737b7 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:49.589322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0249538-8b29-4148-8c7d-6469e9f737b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:49.589602 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0249538-8b29-4148-8c7d-6469e9f737b7 None admin] PATH_INFO: `/v3/projects/4b8cd30653804c0ead71897871920ce2` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:49.590815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0249538-8b29-4148-8c7d-6469e9f737b7 None admin] RBAC: Authorizing `identity:get_project(project_id=4b8cd30653804c0ead71897871920ce2)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:49.592281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0249538-8b29-4148-8c7d-6469e9f737b7 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:49.594272 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 203/416] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:49 2022] GET /identity/v3/projects/4b8cd30653804c0ead71897871920ce2 => generated 344 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:49.599692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51280752-cef9-44cc-b263-94a6e0a4c3e0 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:49.656080 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:49.717780 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51280752-cef9-44cc-b263-94a6e0a4c3e0 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:49.754533 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbfa03-04da-4a74-a8f2-fa3d68bab396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:49.755217 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbfa03-04da-4a74-a8f2-fa3d68bab396 None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:49.755490 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbfa03-04da-4a74-a8f2-fa3d68bab396 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:49.755763 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbfa03-04da-4a74-a8f2-fa3d68bab396 None admin] PATH_INFO: `/v3/projects/4b8cd30653804c0ead71897871920ce2/groups/94afabff487248f2a7771283c2c8741e/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:49.757808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dbfa03-04da-4a74-a8f2-fa3d68bab396 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b8cd30653804c0ead71897871920ce2, group_id=94afabff487248f2a7771283c2c8741e, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:49.759831 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dbfa03-04da-4a74-a8f2-fa3d68bab396 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:49.779513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 214/417] 10.222.0.69 () {58 vars in 1442 bytes} [Mon Aug 29 21:25:49 2022] PUT /identity/v3/projects/4b8cd30653804c0ead71897871920ce2/groups/94afabff487248f2a7771283c2c8741e/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:25:49.876403 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0249538-8b29-4148-8c7d-6469e9f737b7 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:49.986237 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:50.030271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0249538-8b29-4148-8c7d-6469e9f737b7 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:50.073367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeee960-fb9c-420c-9be3-0f76e642419d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:50.074019 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeee960-fb9c-420c-9be3-0f76e642419d None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:50.074301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeee960-fb9c-420c-9be3-0f76e642419d None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:50.074582 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeee960-fb9c-420c-9be3-0f76e642419d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:50.087305 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeee960-fb9c-420c-9be3-0f76e642419d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:50.093234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-5aeee960-fb9c-420c-9be3-0f76e642419d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:50.093234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:50.093234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:50.093234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:50.093234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:50.093234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:50.093234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:50.093234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:50.093234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:50.093234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:50.093234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:50.093234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:50.093234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:50.093234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:50.093234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:50.093234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:50.094163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:50.094163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:50.094163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:50.094163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:50.094163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:50.094163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:50.094163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:50.094163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:50.094163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:50.094163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:50.094163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:50.094163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:50.094163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:50.094163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:50.094163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:50.094163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:50.095058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:50.095058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:50.095058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:50.095058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:50.095058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:50.095058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:50.095058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:50.095058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:50.095058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:50.095058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:50.095058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:50.095058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:50.097837 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 204/418] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:50.103861 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbfa03-04da-4a74-a8f2-fa3d68bab396 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:50.292358 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbfa03-04da-4a74-a8f2-fa3d68bab396 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:50.303257 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:50.339396 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e694eaf-3716-45a3-a1df-f50bff36c0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:50.340428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e694eaf-3716-45a3-a1df-f50bff36c0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:50.340916 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e694eaf-3716-45a3-a1df-f50bff36c0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:50.341405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e694eaf-3716-45a3-a1df-f50bff36c0e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:50.342268 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e694eaf-3716-45a3-a1df-f50bff36c0e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:50.342768 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e694eaf-3716-45a3-a1df-f50bff36c0e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:50.344375 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e694eaf-3716-45a3-a1df-f50bff36c0e1 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:50.355067 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 215/419] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:50.361098 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeee960-fb9c-420c-9be3-0f76e642419d None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:50.424869 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef5d46-fbb3-487d-8195-8f18b6ce70eb None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:50.425497 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef5d46-fbb3-487d-8195-8f18b6ce70eb None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:50.426004 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef5d46-fbb3-487d-8195-8f18b6ce70eb None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:50.427925 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 216/420] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:50.433607 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bb7e2-4e9a-4ff4-9f44-c86a4544d466 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:50.434188 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bb7e2-4e9a-4ff4-9f44-c86a4544d466 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:50.434677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bb7e2-4e9a-4ff4-9f44-c86a4544d466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:50.454884 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-959bb7e2-4e9a-4ff4-9f44-c86a4544d466 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:50.456553 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-959bb7e2-4e9a-4ff4-9f44-c86a4544d466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:50.533994 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 217/421] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:25:50.568013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeee960-fb9c-420c-9be3-0f76e642419d None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:50.613318 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:50.618575 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f5ded-d0a0-4648-8bb6-d1c5ab3e7d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:50.619735 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f5ded-d0a0-4648-8bb6-d1c5ab3e7d52 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:50.620333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f5ded-d0a0-4648-8bb6-d1c5ab3e7d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:50.621098 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f5ded-d0a0-4648-8bb6-d1c5ab3e7d52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:50.700515 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902f5ded-d0a0-4648-8bb6-d1c5ab3e7d52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:50.702001 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902f5ded-d0a0-4648-8bb6-d1c5ab3e7d52 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:50.828567 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bb7e2-4e9a-4ff4-9f44-c86a4544d466 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:50.863511 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 205/422] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:25:50.871750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f5ded-d0a0-4648-8bb6-d1c5ab3e7d52 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:50.934988 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:50.969356 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:50.972864 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bb7e2-4e9a-4ff4-9f44-c86a4544d466 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:51.057056 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767a145-85d4-4526-aecc-40e1f86a7230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:51.058180 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767a145-85d4-4526-aecc-40e1f86a7230 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:51.058669 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767a145-85d4-4526-aecc-40e1f86a7230 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:51.059144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767a145-85d4-4526-aecc-40e1f86a7230 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:51.079741 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767a145-85d4-4526-aecc-40e1f86a7230 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:51.090282 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-a767a145-85d4-4526-aecc-40e1f86a7230 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:25:51.090282 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:51.090282 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:51.090282 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:51.090282 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:51.090282 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:51.090282 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:51.090282 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:51.090282 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:51.090282 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:51.090282 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:51.090282 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:51.090282 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:51.090282 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:51.090282 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:51.090282 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:51.091243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:51.091243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:51.091243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:51.091243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:51.091243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:51.091243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:51.091243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:51.091243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:51.091243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:51.091243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:51.091243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:51.091243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:51.091243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:51.091243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:51.091243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:51.091243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:51.092085 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:51.092085 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:51.092085 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:51.092085 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:51.092085 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:51.092085 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:51.092085 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:51.092085 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:51.092085 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:51.092085 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:51.092085 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:25:51.092085 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:25:51.092726 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 218/423] 10.222.0.69 () {56 vars in 1114 bytes} [Mon Aug 29 21:25:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:25:51.100020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767a145-85d4-4526-aecc-40e1f86a7230 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:51.102694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f5ded-d0a0-4648-8bb6-d1c5ab3e7d52 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:51.183815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922eefa5-dd23-425e-a030-169d3885d813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:51.184495 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922eefa5-dd23-425e-a030-169d3885d813 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:51.184843 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922eefa5-dd23-425e-a030-169d3885d813 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:51.185124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922eefa5-dd23-425e-a030-169d3885d813 None admin] PATH_INFO: `/v3/projects/9e54ec3d9806409e8a45d9a82823741d` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:51.186545 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922eefa5-dd23-425e-a030-169d3885d813 None admin] RBAC: Authorizing `identity:get_project(project_id=9e54ec3d9806409e8a45d9a82823741d)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:51.188007 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922eefa5-dd23-425e-a030-169d3885d813 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:51.190071 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 206/424] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:50 2022] GET /identity/v3/projects/9e54ec3d9806409e8a45d9a82823741d => generated 298 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:51.195242 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922eefa5-dd23-425e-a030-169d3885d813 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:51.274638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767a145-85d4-4526-aecc-40e1f86a7230 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:51.322463 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3b0b5-977c-42e3-b8a4-f45895321c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:51.323086 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3b0b5-977c-42e3-b8a4-f45895321c8b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:51.323367 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3b0b5-977c-42e3-b8a4-f45895321c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:51.324079 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3b0b5-977c-42e3-b8a4-f45895321c8b None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:51.324780 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3b0b5-977c-42e3-b8a4-f45895321c8b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:51.325087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3b0b5-977c-42e3-b8a4-f45895321c8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:51.326834 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3b0b5-977c-42e3-b8a4-f45895321c8b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:51.338701 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 219/425] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:25:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:51.340460 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c98e7-09a2-4156-b4ad-17e0ab45b5ca None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:51.340829 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c98e7-09a2-4156-b4ad-17e0ab45b5ca None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:51.341114 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c98e7-09a2-4156-b4ad-17e0ab45b5ca None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:51.347720 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 220/426] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:51.348640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c98e7-09a2-4156-b4ad-17e0ab45b5ca None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:51.361129 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:51.367736 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922eefa5-dd23-425e-a030-169d3885d813 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:51.385720 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:51.408153 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37513f21-020d-4a12-82fb-5fcc4cd2b023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:51.408953 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37513f21-020d-4a12-82fb-5fcc4cd2b023 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:51.409073 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37513f21-020d-4a12-82fb-5fcc4cd2b023 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:51.409350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37513f21-020d-4a12-82fb-5fcc4cd2b023 None admin] PATH_INFO: `/v3/groups/2731fdf88f5d4c6cb1183da85421d6a3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:51.410857 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37513f21-020d-4a12-82fb-5fcc4cd2b023 None admin] RBAC: Authorizing `identity:get_group(group_id=2731fdf88f5d4c6cb1183da85421d6a3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:51.412235 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37513f21-020d-4a12-82fb-5fcc4cd2b023 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:51.418726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 207/427] 10.222.0.69 () {56 vars in 1180 bytes} [Mon Aug 29 21:25:51 2022] GET /identity/v3/groups/2731fdf88f5d4c6cb1183da85421d6a3 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:51.418726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14d413-408c-42ce-8413-b2ccd0afc384 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:51.418726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14d413-408c-42ce-8413-b2ccd0afc384 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:51.418726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14d413-408c-42ce-8413-b2ccd0afc384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:51.434814 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-2e14d413-408c-42ce-8413-b2ccd0afc384 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:51.436063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-2e14d413-408c-42ce-8413-b2ccd0afc384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:51.482970 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c98e7-09a2-4156-b4ad-17e0ab45b5ca None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:51.516227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 208/428] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:51.516227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14d413-408c-42ce-8413-b2ccd0afc384 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:51.536909 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11feb5f2-fdef-4e95-bb47-4a91649d319f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:51.537935 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feb5f2-fdef-4e95-bb47-4a91649d319f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:51.538644 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feb5f2-fdef-4e95-bb47-4a91649d319f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:51.539068 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feb5f2-fdef-4e95-bb47-4a91649d319f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:51.631540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:51.636216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14d413-408c-42ce-8413-b2ccd0afc384 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:51.674703 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fa688-267c-4a61-8ba9-67fa0a0de63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:51.675327 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fa688-267c-4a61-8ba9-67fa0a0de63b None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:51.675744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fa688-267c-4a61-8ba9-67fa0a0de63b None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:51.676089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fa688-267c-4a61-8ba9-67fa0a0de63b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:51.676996 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fa688-267c-4a61-8ba9-67fa0a0de63b None admin] RBAC: Adding query filter params (group.id=2731fdf88f5d4c6cb1183da85421d6a3, role.id=29d2c7708bea4287a21112bb7ffa72df, scope.project.id=9e54ec3d9806409e8a45d9a82823741d) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:51.677315 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fa688-267c-4a61-8ba9-67fa0a0de63b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:51.678935 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fa688-267c-4a61-8ba9-67fa0a0de63b None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:51.686910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 209/429] 10.222.0.69 () {56 vars in 1376 bytes} [Mon Aug 29 21:25:51 2022] GET /identity/v3/role_assignments?group.id=2731fdf88f5d4c6cb1183da85421d6a3&scope.project.id=9e54ec3d9806409e8a45d9a82823741d&role.id=29d2c7708bea4287a21112bb7ffa72df => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:51.710099 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11feb5f2-fdef-4e95-bb47-4a91649d319f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:51.711975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11feb5f2-fdef-4e95-bb47-4a91649d319f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:51.740248 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:51.858772 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 221/430] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:25:51.864575 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fa688-267c-4a61-8ba9-67fa0a0de63b None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:51.982896 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5be04d-ff23-42d5-9991-8b96b839a6fc None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:51.983296 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5be04d-ff23-42d5-9991-8b96b839a6fc None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:51.983602 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5be04d-ff23-42d5-9991-8b96b839a6fc None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:51.985438 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 222/431] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:25:51.991183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76064870-5a64-4392-b20f-bcf968cc2301 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:51.991576 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76064870-5a64-4392-b20f-bcf968cc2301 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:51.991754 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76064870-5a64-4392-b20f-bcf968cc2301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:52.011979 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fa688-267c-4a61-8ba9-67fa0a0de63b None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:52.012505 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-76064870-5a64-4392-b20f-bcf968cc2301 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:52.013366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-76064870-5a64-4392-b20f-bcf968cc2301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:52.061800 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bf4bd-1114-49be-812b-07c3f988cb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:52.062399 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bf4bd-1114-49be-812b-07c3f988cb46 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:52.062682 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bf4bd-1114-49be-812b-07c3f988cb46 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:52.062959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bf4bd-1114-49be-812b-07c3f988cb46 None admin] PATH_INFO: `/v3/projects/9e54ec3d9806409e8a45d9a82823741d` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:52.064716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bf4bd-1114-49be-812b-07c3f988cb46 None admin] RBAC: Authorizing `identity:get_project(project_id=9e54ec3d9806409e8a45d9a82823741d)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:52.066225 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bf4bd-1114-49be-812b-07c3f988cb46 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:52.068170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 210/432] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:51 2022] GET /identity/v3/projects/9e54ec3d9806409e8a45d9a82823741d => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:52.068827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bf4bd-1114-49be-812b-07c3f988cb46 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:52.104696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 223/433] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:52.106426 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76064870-5a64-4392-b20f-bcf968cc2301 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:52.115618 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:52.199366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:52.209319 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bf4bd-1114-49be-812b-07c3f988cb46 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:52.259941 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe52ac6-ae57-49e5-a5de-45a058b418fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:52.260534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe52ac6-ae57-49e5-a5de-45a058b418fe None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:52.260813 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe52ac6-ae57-49e5-a5de-45a058b418fe None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:52.261084 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe52ac6-ae57-49e5-a5de-45a058b418fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:52.262211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76064870-5a64-4392-b20f-bcf968cc2301 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:52.278048 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe52ac6-ae57-49e5-a5de-45a058b418fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:52.283282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-bfe52ac6-ae57-49e5-a5de-45a058b418fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:52.283282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:52.283282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:52.283282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:52.283282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:52.283282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:52.283282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:52.283282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:52.283282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:52.283282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:52.283282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:52.283282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:52.283282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:52.283282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:52.283282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:52.283282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:52.284281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:52.284281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:52.284281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:52.284281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:52.284281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:52.284281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:52.284281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:52.284281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:52.284281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:52.284281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:52.284281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:52.284281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:52.284281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:52.284281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:52.284281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:52.284281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:52.285100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:52.285100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:52.285100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:52.285100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:52.285100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:52.285100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:52.285100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:52.285100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:52.285100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:52.285100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:52.285100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:25:52.285100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:52.285100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 211/434] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:52.286050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30074f6f-3aea-41d5-b446-d95328d8d305 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:52.286050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30074f6f-3aea-41d5-b446-d95328d8d305 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:52.286050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30074f6f-3aea-41d5-b446-d95328d8d305 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:52.287261 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 212/435] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:52.290404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30074f6f-3aea-41d5-b446-d95328d8d305 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:52.318988 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f941237-7ded-4324-8c62-37e3f89e1bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:52.321719 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f941237-7ded-4324-8c62-37e3f89e1bdd None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:52.321719 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f941237-7ded-4324-8c62-37e3f89e1bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:52.321719 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f941237-7ded-4324-8c62-37e3f89e1bdd None admin] PATH_INFO: `/v3/groups/2731fdf88f5d4c6cb1183da85421d6a3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:52.323979 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f941237-7ded-4324-8c62-37e3f89e1bdd None admin] RBAC: Authorizing `identity:get_group(group_id=2731fdf88f5d4c6cb1183da85421d6a3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:52.325638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f941237-7ded-4324-8c62-37e3f89e1bdd None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:52.327564 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 224/436] 10.222.0.69 () {56 vars in 1180 bytes} [Mon Aug 29 21:25:52 2022] GET /identity/v3/groups/2731fdf88f5d4c6cb1183da85421d6a3 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:52.332241 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae507851-a0fd-47d3-a157-524b84403454 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:52.332241 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae507851-a0fd-47d3-a157-524b84403454 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:52.332241 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae507851-a0fd-47d3-a157-524b84403454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:52.352154 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ae507851-a0fd-47d3-a157-524b84403454 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:52.353428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ae507851-a0fd-47d3-a157-524b84403454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:52.433712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:52.443939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 225/437] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:52.444842 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae507851-a0fd-47d3-a157-524b84403454 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:52.449546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30074f6f-3aea-41d5-b446-d95328d8d305 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:52.489188 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fedc53-af65-4c2d-91cb-6ca72267e16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:52.489799 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fedc53-af65-4c2d-91cb-6ca72267e16a None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:52.490079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fedc53-af65-4c2d-91cb-6ca72267e16a None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:52.490353 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fedc53-af65-4c2d-91cb-6ca72267e16a None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:52.491024 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fedc53-af65-4c2d-91cb-6ca72267e16a None admin] RBAC: Adding query filter params (name=member) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:52.491391 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fedc53-af65-4c2d-91cb-6ca72267e16a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:52.492872 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fedc53-af65-4c2d-91cb-6ca72267e16a None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:52.500614 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:52.504354 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 213/438] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:25:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:52.505143 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fedc53-af65-4c2d-91cb-6ca72267e16a None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:52.563876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae507851-a0fd-47d3-a157-524b84403454 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:52.602510 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cf4ae-af53-43e7-afaf-0acc808460f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:52.603138 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cf4ae-af53-43e7-afaf-0acc808460f3 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:52.603417 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cf4ae-af53-43e7-afaf-0acc808460f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:52.603690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cf4ae-af53-43e7-afaf-0acc808460f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:52.604454 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cf4ae-af53-43e7-afaf-0acc808460f3 None admin] RBAC: Adding query filter params (group.id=2731fdf88f5d4c6cb1183da85421d6a3, role.id=ecbc0b9f55214a93a2016b3625d94764, scope.project.id=9e54ec3d9806409e8a45d9a82823741d) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:52.605023 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cf4ae-af53-43e7-afaf-0acc808460f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:52.606462 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cf4ae-af53-43e7-afaf-0acc808460f3 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:52.612750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 226/439] 10.222.0.69 () {56 vars in 1376 bytes} [Mon Aug 29 21:25:52 2022] GET /identity/v3/role_assignments?group.id=2731fdf88f5d4c6cb1183da85421d6a3&scope.project.id=9e54ec3d9806409e8a45d9a82823741d&role.id=ecbc0b9f55214a93a2016b3625d94764 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:52.613600 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cf4ae-af53-43e7-afaf-0acc808460f3 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:52.632428 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fedc53-af65-4c2d-91cb-6ca72267e16a None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:52.681508 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd2bd1-635a-425f-a9fb-5a619cf2d79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:52.682619 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd2bd1-635a-425f-a9fb-5a619cf2d79d None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:52.683112 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd2bd1-635a-425f-a9fb-5a619cf2d79d None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:52.683622 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd2bd1-635a-425f-a9fb-5a619cf2d79d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:52.709874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd2bd1-635a-425f-a9fb-5a619cf2d79d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:52.717535 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-c0cd2bd1-635a-425f-a9fb-5a619cf2d79d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:25:52.717535 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:52.717535 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:52.717535 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:52.717535 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:52.717535 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:52.717535 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:52.717535 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:52.717535 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:52.717535 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:52.717535 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:52.717535 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:52.717535 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:52.717535 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:52.717535 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:52.717535 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:52.718527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:52.718527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:52.718527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:52.718527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:52.718527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:52.718527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:52.718527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:52.718527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:52.718527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:52.718527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:52.718527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:52.718527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:52.718527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:52.718527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:52.718527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:52.718527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:52.719939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:52.719939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:52.719939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:52.719939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:52.719939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:52.719939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:52.719939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:52.719939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:52.719939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:52.719939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:52.719939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:25:52.719939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:52.719939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 214/440] 10.222.0.69 () {56 vars in 1114 bytes} [Mon Aug 29 21:25:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:52.719939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd2bd1-635a-425f-a9fb-5a619cf2d79d None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:52.738853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:52.764037 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cf4ae-af53-43e7-afaf-0acc808460f3 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:52.782596 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:52.812041 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4464931-4eb9-477f-a28d-0de1f46a19ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:52.812702 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4464931-4eb9-477f-a28d-0de1f46a19ab None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:52.812992 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4464931-4eb9-477f-a28d-0de1f46a19ab None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:52.813266 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4464931-4eb9-477f-a28d-0de1f46a19ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:52.863977 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd2bd1-635a-425f-a9fb-5a619cf2d79d None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:52.907411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4464931-4eb9-477f-a28d-0de1f46a19ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:52.908825 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4be62-b051-4d2f-9a34-5713b176a236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:52.909164 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4464931-4eb9-477f-a28d-0de1f46a19ab None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:52.909567 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4be62-b051-4d2f-9a34-5713b176a236 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:52.909816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4be62-b051-4d2f-9a34-5713b176a236 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:52.910407 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4be62-b051-4d2f-9a34-5713b176a236 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:52.923136 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4be62-b051-4d2f-9a34-5713b176a236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:52.930427 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-7cf4be62-b051-4d2f-9a34-5713b176a236 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:25:52.930427 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:52.930427 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:52.930427 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:52.930427 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:52.930427 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:52.930427 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:52.930427 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:52.930427 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:52.930427 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:52.930427 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:52.930427 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:52.930427 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:52.930427 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:52.930427 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:52.930427 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:52.931883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:52.931883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:52.931883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:52.931883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:52.931883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:52.931883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:52.931883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:52.931883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:52.931883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:52.931883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:52.931883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:52.931883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:52.931883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:52.931883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:52.931883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:52.931883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:52.933632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:52.933632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:52.933632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:52.933632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:52.933632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:52.933632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:52.933632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:52.933632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:52.933632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:52.933632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:52.933632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:25:52.933632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:52.933632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 215/441] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:25:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:52.934301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4be62-b051-4d2f-9a34-5713b176a236 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:53.024656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:53.040680 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 227/442] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:25:53.041552 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4464931-4eb9-477f-a28d-0de1f46a19ab None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:53.057455 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:53.059062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4be62-b051-4d2f-9a34-5713b176a236 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:53.095255 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76271a-ef97-4b85-b7a4-13e4eed94531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:53.095864 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76271a-ef97-4b85-b7a4-13e4eed94531 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:53.096147 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76271a-ef97-4b85-b7a4-13e4eed94531 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:53.096455 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76271a-ef97-4b85-b7a4-13e4eed94531 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:53.097236 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76271a-ef97-4b85-b7a4-13e4eed94531 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:53.098018 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76271a-ef97-4b85-b7a4-13e4eed94531 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:53.098940 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76271a-ef97-4b85-b7a4-13e4eed94531 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:53.108162 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 216/443] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:25:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:53.109037 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76271a-ef97-4b85-b7a4-13e4eed94531 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:53.149437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4464931-4eb9-477f-a28d-0de1f46a19ab None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:53.188381 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f85c4-3cab-42eb-8c0a-f928db555fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:53.188993 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f85c4-3cab-42eb-8c0a-f928db555fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:53.189272 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f85c4-3cab-42eb-8c0a-f928db555fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:53.189542 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f85c4-3cab-42eb-8c0a-f928db555fc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:53.190208 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f85c4-3cab-42eb-8c0a-f928db555fc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:53.190558 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f85c4-3cab-42eb-8c0a-f928db555fc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:53.191976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f85c4-3cab-42eb-8c0a-f928db555fc6 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:53.200454 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 228/444] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:25:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:53.201111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f85c4-3cab-42eb-8c0a-f928db555fc6 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:53.221624 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76271a-ef97-4b85-b7a4-13e4eed94531 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:53.257222 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cc677-6ce8-4e3a-95b7-edf7ba0a2a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:53.257846 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cc677-6ce8-4e3a-95b7-edf7ba0a2a77 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:53.258120 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cc677-6ce8-4e3a-95b7-edf7ba0a2a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:53.258389 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cc677-6ce8-4e3a-95b7-edf7ba0a2a77 None admin] PATH_INFO: `/v3/projects/5e57c96553df40ff975ec73f2b01cda6` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:53.259513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039cc677-6ce8-4e3a-95b7-edf7ba0a2a77 None admin] RBAC: Authorizing `identity:get_project(project_id=5e57c96553df40ff975ec73f2b01cda6)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:53.260972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039cc677-6ce8-4e3a-95b7-edf7ba0a2a77 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:53.262593 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 217/445] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:53 2022] GET /identity/v3/projects/5e57c96553df40ff975ec73f2b01cda6 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:53.263341 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cc677-6ce8-4e3a-95b7-edf7ba0a2a77 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:53.270148 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:53.286817 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:53.310414 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f85c4-3cab-42eb-8c0a-f928db555fc6 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:53.345230 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a9c3d-8d23-44de-b463-2127c23cfbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:53.345910 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a9c3d-8d23-44de-b463-2127c23cfbec None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:53.346100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a9c3d-8d23-44de-b463-2127c23cfbec None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:53.346369 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a9c3d-8d23-44de-b463-2127c23cfbec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:53.373113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cc677-6ce8-4e3a-95b7-edf7ba0a2a77 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:53.408552 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e367f62-9797-4593-a663-fbed51e2b4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:53.409072 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e367f62-9797-4593-a663-fbed51e2b4a7 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:53.410067 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e367f62-9797-4593-a663-fbed51e2b4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:53.410067 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e367f62-9797-4593-a663-fbed51e2b4a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:53.419744 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a9c3d-8d23-44de-b463-2127c23cfbec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:53.421275 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a9c3d-8d23-44de-b463-2127c23cfbec None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:53.498713 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e367f62-9797-4593-a663-fbed51e2b4a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:53.500310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e367f62-9797-4593-a663-fbed51e2b4a7 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:53.502598 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:53.509394 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:53.535118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 229/446] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:25:53.535981 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a9c3d-8d23-44de-b463-2127c23cfbec None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:53.605270 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 218/447] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:25:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:25:53.606115 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e367f62-9797-4593-a663-fbed51e2b4a7 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:53.639915 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a9c3d-8d23-44de-b463-2127c23cfbec None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:53.675580 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8458a39-5c1f-42c6-b8dd-715fe2622d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:53.676143 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8458a39-5c1f-42c6-b8dd-715fe2622d2f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:53.676474 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8458a39-5c1f-42c6-b8dd-715fe2622d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:53.676749 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8458a39-5c1f-42c6-b8dd-715fe2622d2f None admin] PATH_INFO: `/v3/groups/2731fdf88f5d4c6cb1183da85421d6a3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:53.677951 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8458a39-5c1f-42c6-b8dd-715fe2622d2f None admin] RBAC: Authorizing `identity:get_group(group_id=2731fdf88f5d4c6cb1183da85421d6a3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:53.679348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8458a39-5c1f-42c6-b8dd-715fe2622d2f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:53.681020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 230/448] 10.222.0.69 () {56 vars in 1180 bytes} [Mon Aug 29 21:25:53 2022] GET /identity/v3/groups/2731fdf88f5d4c6cb1183da85421d6a3 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:53.685407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8458a39-5c1f-42c6-b8dd-715fe2622d2f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:53.710292 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e367f62-9797-4593-a663-fbed51e2b4a7 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:53.712575 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:53.735635 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:53.751290 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e25ac-bbaa-47e0-bfe4-57e480d5998b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:53.751924 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e25ac-bbaa-47e0-bfe4-57e480d5998b None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:53.752226 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e25ac-bbaa-47e0-bfe4-57e480d5998b None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:53.752510 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e25ac-bbaa-47e0-bfe4-57e480d5998b None admin] PATH_INFO: `/v3/projects/5e57c96553df40ff975ec73f2b01cda6` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:53.754025 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e25ac-bbaa-47e0-bfe4-57e480d5998b None admin] RBAC: Authorizing `identity:get_project(project_id=5e57c96553df40ff975ec73f2b01cda6)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:53.755513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e25ac-bbaa-47e0-bfe4-57e480d5998b None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:53.757221 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 219/449] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:53 2022] GET /identity/v3/projects/5e57c96553df40ff975ec73f2b01cda6 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:53.757983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e25ac-bbaa-47e0-bfe4-57e480d5998b None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:53.804562 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8458a39-5c1f-42c6-b8dd-715fe2622d2f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:53.843108 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af628b31-1d93-4103-8b8a-5d5271812512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:53.844266 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af628b31-1d93-4103-8b8a-5d5271812512 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:53.844609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af628b31-1d93-4103-8b8a-5d5271812512 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:53.844886 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af628b31-1d93-4103-8b8a-5d5271812512 None admin] PATH_INFO: `/v3/projects/4b8cd30653804c0ead71897871920ce2` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:53.846354 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af628b31-1d93-4103-8b8a-5d5271812512 None admin] RBAC: Authorizing `identity:get_project(project_id=4b8cd30653804c0ead71897871920ce2)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:53.848280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af628b31-1d93-4103-8b8a-5d5271812512 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:53.850142 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 231/450] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:25:53 2022] GET /identity/v3/projects/4b8cd30653804c0ead71897871920ce2 => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:53.850828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af628b31-1d93-4103-8b8a-5d5271812512 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:53.874336 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e25ac-bbaa-47e0-bfe4-57e480d5998b None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:53.914584 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710931a6-55cc-4858-bb32-f02e991e6322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:53.915233 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710931a6-55cc-4858-bb32-f02e991e6322 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:53.915508 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710931a6-55cc-4858-bb32-f02e991e6322 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:53.915780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710931a6-55cc-4858-bb32-f02e991e6322 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:53.916538 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710931a6-55cc-4858-bb32-f02e991e6322 None admin] RBAC: Adding query filter params (group.id=2731fdf88f5d4c6cb1183da85421d6a3, role.id=29d2c7708bea4287a21112bb7ffa72df, scope.project.id=5e57c96553df40ff975ec73f2b01cda6) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:53.916845 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710931a6-55cc-4858-bb32-f02e991e6322 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:53.918306 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710931a6-55cc-4858-bb32-f02e991e6322 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:53.934617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 220/451] 10.222.0.69 () {56 vars in 1376 bytes} [Mon Aug 29 21:25:53 2022] GET /identity/v3/role_assignments?group.id=2731fdf88f5d4c6cb1183da85421d6a3&scope.project.id=5e57c96553df40ff975ec73f2b01cda6&role.id=29d2c7708bea4287a21112bb7ffa72df => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:53.934617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710931a6-55cc-4858-bb32-f02e991e6322 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:53.968254 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:53.995579 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af628b31-1d93-4103-8b8a-5d5271812512 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:54.013850 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:54.043061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e5fb5-67d8-4452-bc3d-8c11064c8fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:54.043725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e5fb5-67d8-4452-bc3d-8c11064c8fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:54.044007 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e5fb5-67d8-4452-bc3d-8c11064c8fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:54.044328 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e5fb5-67d8-4452-bc3d-8c11064c8fc9 None admin] PATH_INFO: `/v3/groups/2731fdf88f5d4c6cb1183da85421d6a3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:54.045879 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e5fb5-67d8-4452-bc3d-8c11064c8fc9 None admin] RBAC: Authorizing `identity:get_group(group_id=2731fdf88f5d4c6cb1183da85421d6a3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:54.047363 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e5fb5-67d8-4452-bc3d-8c11064c8fc9 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:54.049094 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 232/452] 10.222.0.69 () {56 vars in 1180 bytes} [Mon Aug 29 21:25:53 2022] GET /identity/v3/groups/2731fdf88f5d4c6cb1183da85421d6a3 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:54.055857 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e5fb5-67d8-4452-bc3d-8c11064c8fc9 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:54.058499 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710931a6-55cc-4858-bb32-f02e991e6322 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:54.103760 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f50af3-e79a-43c6-a2c3-d15ef33576d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:54.105366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f50af3-e79a-43c6-a2c3-d15ef33576d9 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:54.105653 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f50af3-e79a-43c6-a2c3-d15ef33576d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:54.105927 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f50af3-e79a-43c6-a2c3-d15ef33576d9 None admin] PATH_INFO: `/v3/groups/94afabff487248f2a7771283c2c8741e` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:54.107795 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f50af3-e79a-43c6-a2c3-d15ef33576d9 None admin] RBAC: Authorizing `identity:get_group(group_id=94afabff487248f2a7771283c2c8741e)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:54.109971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f50af3-e79a-43c6-a2c3-d15ef33576d9 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:54.112596 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 221/453] 10.222.0.69 () {56 vars in 1180 bytes} [Mon Aug 29 21:25:53 2022] GET /identity/v3/groups/94afabff487248f2a7771283c2c8741e => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:54.120077 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f50af3-e79a-43c6-a2c3-d15ef33576d9 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:54.183979 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e5fb5-67d8-4452-bc3d-8c11064c8fc9 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:54.234279 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56812597-f898-4dfc-a303-84e2b71d3fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:54.235057 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56812597-f898-4dfc-a303-84e2b71d3fec None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:54.235340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56812597-f898-4dfc-a303-84e2b71d3fec None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:54.235609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56812597-f898-4dfc-a303-84e2b71d3fec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:54.236380 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56812597-f898-4dfc-a303-84e2b71d3fec None admin] RBAC: Adding query filter params (group.id=2731fdf88f5d4c6cb1183da85421d6a3, role.id=ecbc0b9f55214a93a2016b3625d94764, scope.project.id=5e57c96553df40ff975ec73f2b01cda6) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:54.236688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56812597-f898-4dfc-a303-84e2b71d3fec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:54.238457 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56812597-f898-4dfc-a303-84e2b71d3fec None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:54.247168 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 233/454] 10.222.0.69 () {56 vars in 1376 bytes} [Mon Aug 29 21:25:54 2022] GET /identity/v3/role_assignments?group.id=2731fdf88f5d4c6cb1183da85421d6a3&scope.project.id=5e57c96553df40ff975ec73f2b01cda6&role.id=ecbc0b9f55214a93a2016b3625d94764 => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:54.255280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f50af3-e79a-43c6-a2c3-d15ef33576d9 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:54.257257 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:54.303109 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3509dfa-5c1a-407e-bc81-4af998003990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:54.303754 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3509dfa-5c1a-407e-bc81-4af998003990 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:54.304038 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3509dfa-5c1a-407e-bc81-4af998003990 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:54.304342 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3509dfa-5c1a-407e-bc81-4af998003990 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:54.305108 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3509dfa-5c1a-407e-bc81-4af998003990 None admin] RBAC: Adding query filter params (group.id=94afabff487248f2a7771283c2c8741e, role.id=69369872661e4179bb51cd1ca76e28c3, scope.project.id=4b8cd30653804c0ead71897871920ce2) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:54.305421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3509dfa-5c1a-407e-bc81-4af998003990 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:54.307547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3509dfa-5c1a-407e-bc81-4af998003990 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:54.314709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 222/455] 10.222.0.69 () {56 vars in 1376 bytes} [Mon Aug 29 21:25:54 2022] GET /identity/v3/role_assignments?group.id=94afabff487248f2a7771283c2c8741e&scope.project.id=4b8cd30653804c0ead71897871920ce2&role.id=69369872661e4179bb51cd1ca76e28c3 => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:56.788140 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5834e4-1b8c-4438-9aeb-f8e81a19ba70 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:56.788676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5834e4-1b8c-4438-9aeb-f8e81a19ba70 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:56.788752 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5834e4-1b8c-4438-9aeb-f8e81a19ba70 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:56.790575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 234/456] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:56.795805 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129d448-c838-487b-9332-0d512c0713a0 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:56.796274 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129d448-c838-487b-9332-0d512c0713a0 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:56.796486 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129d448-c838-487b-9332-0d512c0713a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:56.821087 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-1129d448-c838-487b-9332-0d512c0713a0 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:56.822838 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-1129d448-c838-487b-9332-0d512c0713a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:56.919714 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 223/457] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:25:57.228556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b0d05-5e78-44c0-908f-4ff3fec06878 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:57.229190 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b0d05-5e78-44c0-908f-4ff3fec06878 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:57.229670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b0d05-5e78-44c0-908f-4ff3fec06878 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:57.231867 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 235/458] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:57.237959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fd91d-1618-430e-aa91-f7be89a7b687 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:57.238591 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fd91d-1618-430e-aa91-f7be89a7b687 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:57.239071 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fd91d-1618-430e-aa91-f7be89a7b687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:57.263708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-697fd91d-1618-430e-aa91-f7be89a7b687 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:57.265285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-697fd91d-1618-430e-aa91-f7be89a7b687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:57.266936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ce6eb-3c50-4aeb-b649-9d0ce4db2b0e None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:57.267227 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ce6eb-3c50-4aeb-b649-9d0ce4db2b0e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:57.267725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ce6eb-3c50-4aeb-b649-9d0ce4db2b0e None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:57.269844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 236/459] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:57.274960 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985b836-78b3-424a-8497-1acfd147b859 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:57.275717 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985b836-78b3-424a-8497-1acfd147b859 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:57.276284 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985b836-78b3-424a-8497-1acfd147b859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:57.306999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-8985b836-78b3-424a-8497-1acfd147b859 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:57.309562 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-8985b836-78b3-424a-8497-1acfd147b859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:57.374615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 224/460] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:57.377653 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fd91d-1618-430e-aa91-f7be89a7b687 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:57.397483 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:57.431648 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:57.458248 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 237/461] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:57.525491 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fd91d-1618-430e-aa91-f7be89a7b687 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:57.567889 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229d947-c37d-4644-9f88-7c5ba8c663da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:57.568562 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229d947-c37d-4644-9f88-7c5ba8c663da None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:57.568838 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229d947-c37d-4644-9f88-7c5ba8c663da None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:57.569112 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229d947-c37d-4644-9f88-7c5ba8c663da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:57.580429 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229d947-c37d-4644-9f88-7c5ba8c663da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:57.581947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229d947-c37d-4644-9f88-7c5ba8c663da None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:57.614360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-1229d947-c37d-4644-9f88-7c5ba8c663da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:25:57.614360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:57.614360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:57.614360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:57.614360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:57.614360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:57.614360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:57.614360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:57.614360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:57.614360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:57.614360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:57.614360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:57.614360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:25:57.614360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:25:57.614360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:25:57.614360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:25:57.615358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:57.615358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:57.615358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:57.615358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:57.615358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:57.615358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:57.615358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:57.615358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:57.615358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:57.615358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:57.615358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:57.615358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:57.615358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:57.615358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:57.615358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:57.615358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:57.615358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:25:57.616255 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:25:57.616255 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:25:57.616255 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:57.616255 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 225/462] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:57.621994 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985b836-78b3-424a-8497-1acfd147b859 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:57.775264 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229d947-c37d-4644-9f88-7c5ba8c663da None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:57.787891 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985b836-78b3-424a-8497-1acfd147b859 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:57.859834 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc500393-dfd8-439c-84b2-d8deb9bfd768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:57.861649 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc500393-dfd8-439c-84b2-d8deb9bfd768 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:57.862562 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc500393-dfd8-439c-84b2-d8deb9bfd768 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:57.864288 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc500393-dfd8-439c-84b2-d8deb9bfd768 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:57.865294 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc500393-dfd8-439c-84b2-d8deb9bfd768 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:57.865807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc500393-dfd8-439c-84b2-d8deb9bfd768 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:57.867416 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc500393-dfd8-439c-84b2-d8deb9bfd768 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:57.874327 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:57.888137 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 238/463] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:57.889771 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1437c1-46f8-4cc4-b351-b0eda1248513 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:57.890288 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1437c1-46f8-4cc4-b351-b0eda1248513 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:57.890765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1437c1-46f8-4cc4-b351-b0eda1248513 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:57.896440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 239/464] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:57.898138 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1437c1-46f8-4cc4-b351-b0eda1248513 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:57.914189 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229d947-c37d-4644-9f88-7c5ba8c663da None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:57.944486 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:57.956068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f07a63-3178-4d4f-b7a0-21208cd064e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:57.956752 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f07a63-3178-4d4f-b7a0-21208cd064e6 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:57.957151 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f07a63-3178-4d4f-b7a0-21208cd064e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:57.957500 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f07a63-3178-4d4f-b7a0-21208cd064e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:57.970007 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f07a63-3178-4d4f-b7a0-21208cd064e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:57.971739 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f07a63-3178-4d4f-b7a0-21208cd064e6 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:57.987758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-58f07a63-3178-4d4f-b7a0-21208cd064e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:25:57.987758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:57.987758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:57.987758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:57.987758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:57.987758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:57.987758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:57.987758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:57.987758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:57.987758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:57.987758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:57.987758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:57.987758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:25:57.987758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:25:57.987758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:25:57.987758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:25:57.989396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:57.989396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:57.989396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:57.989396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:57.989396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:57.989396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:57.989396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:57.989396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:57.989396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:57.989396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:57.989396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:57.989396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:57.989396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:57.989396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:57.989396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:57.989396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:57.989396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:25:57.990258 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:25:57.990258 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:25:57.990258 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:57.992533 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 226/465] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:25:57.994621 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9b824-6278-44d3-ae6f-67a282e57d94 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:57.994908 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9b824-6278-44d3-ae6f-67a282e57d94 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:57.995607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9b824-6278-44d3-ae6f-67a282e57d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:58.016436 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-36e9b824-6278-44d3-ae6f-67a282e57d94 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:58.017672 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-36e9b824-6278-44d3-ae6f-67a282e57d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:58.021665 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1437c1-46f8-4cc4-b351-b0eda1248513 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:58.061256 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896f80e-702e-4290-a23d-9de420e1f341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:58.062166 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896f80e-702e-4290-a23d-9de420e1f341 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:58.063163 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896f80e-702e-4290-a23d-9de420e1f341 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:58.063640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896f80e-702e-4290-a23d-9de420e1f341 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:58.064868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896f80e-702e-4290-a23d-9de420e1f341 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:58.066877 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896f80e-702e-4290-a23d-9de420e1f341 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:58.092465 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 240/466] 10.222.0.69 () {60 vars in 1132 bytes} [Mon Aug 29 21:25:57 2022] POST /identity/v3/users => generated 246 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:25:58.093320 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896f80e-702e-4290-a23d-9de420e1f341 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:58.103870 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 227/467] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:58.105458 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9b824-6278-44d3-ae6f-67a282e57d94 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:58.244238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:58.247859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:58.275370 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896f80e-702e-4290-a23d-9de420e1f341 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:58.298168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9b824-6278-44d3-ae6f-67a282e57d94 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:58.331277 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9cbc6-ba41-4826-bbac-048e3f588367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:58.332139 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9cbc6-ba41-4826-bbac-048e3f588367 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:58.332600 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9cbc6-ba41-4826-bbac-048e3f588367 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:58.332939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9cbc6-ba41-4826-bbac-048e3f588367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:58.341921 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2798a0f-0bad-4ca4-98a2-0511d5da9b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:58.341921 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2798a0f-0bad-4ca4-98a2-0511d5da9b32 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:58.341921 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2798a0f-0bad-4ca4-98a2-0511d5da9b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:58.341921 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2798a0f-0bad-4ca4-98a2-0511d5da9b32 None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:58.342329 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2798a0f-0bad-4ca4-98a2-0511d5da9b32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:58.342580 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2798a0f-0bad-4ca4-98a2-0511d5da9b32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:58.343884 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2798a0f-0bad-4ca4-98a2-0511d5da9b32 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:58.348062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec9cbc6-ba41-4826-bbac-048e3f588367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:58.349496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec9cbc6-ba41-4826-bbac-048e3f588367 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:58.359483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 228/468] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:58.360833 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb627667-be2a-4022-a1f7-f27c675448e6 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:58.361256 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb627667-be2a-4022-a1f7-f27c675448e6 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:58.361619 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb627667-be2a-4022-a1f7-f27c675448e6 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:58.363511 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 229/469] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:25:58.369129 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb627667-be2a-4022-a1f7-f27c675448e6 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:58.376738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-1ec9cbc6-ba41-4826-bbac-048e3f588367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:25:58.376738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:58.376738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:58.376738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:58.376738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:58.376738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:58.376738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:58.376738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:58.376738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:58.376738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:58.376738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:58.376738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:58.376738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:25:58.376738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:25:58.376738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:25:58.376738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:25:58.378232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:58.378232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:58.378232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:58.378232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:58.378232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:58.378232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:58.378232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:58.378232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:58.378232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:58.378232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:58.378232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:58.378232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:58.378232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:58.378232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:58.378232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:58.378232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:58.378232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:25:58.379910 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:25:58.379910 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:25:58.379910 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:25:58.382122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 241/470] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:58.384676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc778d8-ead0-4355-8efc-6ee288035681 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:58.385286 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc778d8-ead0-4355-8efc-6ee288035681 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:58.385821 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc778d8-ead0-4355-8efc-6ee288035681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:58.406757 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-3dc778d8-ead0-4355-8efc-6ee288035681 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:25:58.408381 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3dc778d8-ead0-4355-8efc-6ee288035681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:25:58.491527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 242/471] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:25:58.492543 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc778d8-ead0-4355-8efc-6ee288035681 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:58.501437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb627667-be2a-4022-a1f7-f27c675448e6 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:58.527015 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:58.544513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038a855-c200-4b8d-a028-e8458525ea48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:58.545469 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038a855-c200-4b8d-a028-e8458525ea48 None admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:58.545968 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038a855-c200-4b8d-a028-e8458525ea48 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:58.546437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038a855-c200-4b8d-a028-e8458525ea48 None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:58.547298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038a855-c200-4b8d-a028-e8458525ea48 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:58.549042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038a855-c200-4b8d-a028-e8458525ea48 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:58.572367 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:58.576226 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 230/472] 10.222.0.69 () {60 vars in 1132 bytes} [Mon Aug 29 21:25:58 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:25:58.577540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038a855-c200-4b8d-a028-e8458525ea48 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:58.609164 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc778d8-ead0-4355-8efc-6ee288035681 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:58.650354 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd193b-06c5-4d55-a4aa-d764b4cbd3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:58.651005 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd193b-06c5-4d55-a4aa-d764b4cbd3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:58.651262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd193b-06c5-4d55-a4aa-d764b4cbd3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:58.651604 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd193b-06c5-4d55-a4aa-d764b4cbd3b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:58.652196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd193b-06c5-4d55-a4aa-d764b4cbd3b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:58.652536 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd193b-06c5-4d55-a4aa-d764b4cbd3b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:58.653952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd193b-06c5-4d55-a4aa-d764b4cbd3b2 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:58.667956 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 243/473] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:25:58.672566 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd193b-06c5-4d55-a4aa-d764b4cbd3b2 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:58.705403 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038a855-c200-4b8d-a028-e8458525ea48 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:58.744536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221c6dc-90eb-47e0-97ad-392383ac1735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:58.745476 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221c6dc-90eb-47e0-97ad-392383ac1735 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:58.745899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221c6dc-90eb-47e0-97ad-392383ac1735 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:58.746308 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221c6dc-90eb-47e0-97ad-392383ac1735 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:58.759882 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e221c6dc-90eb-47e0-97ad-392383ac1735 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:58.761824 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e221c6dc-90eb-47e0-97ad-392383ac1735 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:58.783660 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-e221c6dc-90eb-47e0-97ad-392383ac1735 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:25:58.783660 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:58.783660 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:58.783660 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:58.783660 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:58.783660 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:58.783660 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:58.783660 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:58.783660 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:58.783660 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:58.783660 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:58.783660 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:58.783660 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:25:58.783660 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:25:58.783660 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:25:58.783660 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:25:58.784780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:58.784780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:58.784780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:58.784780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:58.784780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:58.784780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:58.784780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:58.784780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:58.784780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:58.784780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:58.784780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:58.784780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:58.784780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:58.784780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:58.784780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:58.784780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:58.784780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:25:58.785641 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:25:58.785641 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:25:58.785641 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:25:58.785641 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 231/474] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:58.795735 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221c6dc-90eb-47e0-97ad-392383ac1735 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:58.814526 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd193b-06c5-4d55-a4aa-d764b4cbd3b2 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:58.851358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:58.864391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:58.872896 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b2e57-f15d-4ac9-a889-dca1774772f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:58.873547 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b2e57-f15d-4ac9-a889-dca1774772f7 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:58.873840 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b2e57-f15d-4ac9-a889-dca1774772f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:58.874712 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b2e57-f15d-4ac9-a889-dca1774772f7 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:58.875613 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b2e57-f15d-4ac9-a889-dca1774772f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:58.877978 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b2e57-f15d-4ac9-a889-dca1774772f7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:58.910242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 244/475] 10.222.0.69 () {60 vars in 1132 bytes} [Mon Aug 29 21:25:58 2022] POST /identity/v3/users => generated 248 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:25:58.911072 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b2e57-f15d-4ac9-a889-dca1774772f7 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:58.966804 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221c6dc-90eb-47e0-97ad-392383ac1735 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:59.012857 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e348d5-bd04-49b3-9901-9acf849af004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:59.013494 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e348d5-bd04-49b3-9901-9acf849af004 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:59.013772 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e348d5-bd04-49b3-9901-9acf849af004 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:59.014049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e348d5-bd04-49b3-9901-9acf849af004 None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:59.014713 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e348d5-bd04-49b3-9901-9acf849af004 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:59.015018 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e348d5-bd04-49b3-9901-9acf849af004 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:59.017414 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e348d5-bd04-49b3-9901-9acf849af004 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:59.036432 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 232/476] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:25:59.037786 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e348d5-bd04-49b3-9901-9acf849af004 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:59.056076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b2e57-f15d-4ac9-a889-dca1774772f7 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:59.100511 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd281e-c7c8-4e4b-ab5a-ad0cd4e5df6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:59.101691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd281e-c7c8-4e4b-ab5a-ad0cd4e5df6b None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:59.102157 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd281e-c7c8-4e4b-ab5a-ad0cd4e5df6b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:59.102655 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd281e-c7c8-4e4b-ab5a-ad0cd4e5df6b None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:59.103420 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd281e-c7c8-4e4b-ab5a-ad0cd4e5df6b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:59.105341 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd281e-c7c8-4e4b-ab5a-ad0cd4e5df6b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:59.115774 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.sql.core [None req-99cd281e-c7c8-4e4b-ab5a-ad0cd4e5df6b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 21:25:59.115774 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 21:25:59.115774 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [parameters: {'id': '46d720271c2344138f0fdb252f3fa64f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 21:25:59.115774 dv-cinder-854267-3-smb devstack@keystone.service[81658]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81658) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 21:25:59.138353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-99cd281e-c7c8-4e4b-ab5a-ad0cd4e5df6b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 21:25:59.138353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:59.138353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 21:25:59.138353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 21:25:59.138353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 21:25:59.138353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 21:25:59.138353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 21:25:59.138353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 21:25:59.138353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 21:25:59.138353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application conn.query(q) Aug 29 21:25:59.138353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 21:25:59.138353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 21:25:59.138353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 21:25:59.138353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application result.read() Aug 29 21:25:59.138353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 21:25:59.139311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 21:25:59.139311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 21:25:59.139311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 21:25:59.139311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 21:25:59.139311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 21:25:59.139311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 21:25:59.139311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 21:25:59.139311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 21:25:59.139311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:25:59.139311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 21:25:59.139311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:25:59.139311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:59.139311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 21:25:59.139311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 21:25:59.139311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 29 21:25:59.139311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return ref.to_dict() Aug 29 21:25:59.139311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 21:25:59.139311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application next(self.gen) Aug 29 21:25:59.140926 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 21:25:59.140926 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application yield resource Aug 29 21:25:59.140926 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 21:25:59.140926 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application next(self.gen) Aug 29 21:25:59.140926 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 21:25:59.140926 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 21:25:59.140926 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 21:25:59.140926 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 21:25:59.140926 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 21:25:59.140926 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise self.value Aug 29 21:25:59.140926 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 21:25:59.140926 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 21:25:59.140926 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 21:25:59.140926 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application session.commit() Aug 29 21:25:59.140926 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 21:25:59.140926 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 21:25:59.140926 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 21:25:59.141797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 21:25:59.141797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 21:25:59.141797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self.session.flush() Aug 29 21:25:59.141797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 21:25:59.141797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 21:25:59.141797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 21:25:59.141797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 21:25:59.141797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 21:25:59.141797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application compat.raise_( Aug 29 21:25:59.141797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 21:25:59.141797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception Aug 29 21:25:59.141797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 21:25:59.141797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 21:25:59.141797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 21:25:59.141797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 21:25:59.141797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 21:25:59.141797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 21:25:59.143260 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 21:25:59.143260 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 21:25:59.143260 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 21:25:59.143260 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 21:25:59.143260 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 21:25:59.143260 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 21:25:59.143260 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 21:25:59.143260 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 21:25:59.143260 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 21:25:59.143260 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 21:25:59.143260 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 21:25:59.143260 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 21:25:59.143260 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 21:25:59.143260 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 21:25:59.143260 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 21:25:59.143260 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception Aug 29 21:25:59.144316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 21:25:59.144316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 21:25:59.144316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 21:25:59.144316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 21:25:59.144316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 21:25:59.144316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 21:25:59.144316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 21:25:59.144316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application conn.query(q) Aug 29 21:25:59.144316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 21:25:59.144316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 21:25:59.144316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 21:25:59.144316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application result.read() Aug 29 21:25:59.144316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 21:25:59.144316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 21:25:59.144316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 21:25:59.144316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 21:25:59.145796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 21:25:59.145796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 21:25:59.145796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 21:25:59.145796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 21:25:59.145796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 21:25:59.145796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 21:25:59.145796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [parameters: {'id': '46d720271c2344138f0fdb252f3fa64f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 21:25:59.145796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 21:25:59.145796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:25:59.145796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:25:59.145796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:25:59.145796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:59.145796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:59.145796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:59.145796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:59.145796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:59.146720 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:59.146720 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:59.146720 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:59.146720 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:59.146720 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:59.146720 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:59.146720 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 29 21:25:59.146720 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 29 21:25:59.146720 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:59.146720 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:59.146720 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 29 21:25:59.146720 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 29 21:25:59.146720 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 21:25:59.146720 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 21:25:59.146720 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 21:25:59.146720 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:25:59.153018 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 245/477] 10.222.0.69 () {60 vars in 1131 bytes} [Mon Aug 29 21:25:58 2022] POST /identity/v3/roles => generated 144 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:59.153018 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd281e-c7c8-4e4b-ab5a-ad0cd4e5df6b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:59.157172 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:59.181060 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e348d5-bd04-49b3-9901-9acf849af004 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:59.232680 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f713eaf-6544-4770-a9d0-5453d21a3b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:59.233508 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f713eaf-6544-4770-a9d0-5453d21a3b43 None admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:59.233865 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f713eaf-6544-4770-a9d0-5453d21a3b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:59.234217 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f713eaf-6544-4770-a9d0-5453d21a3b43 None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:59.234948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f713eaf-6544-4770-a9d0-5453d21a3b43 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:59.236492 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:25:59.236632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f713eaf-6544-4770-a9d0-5453d21a3b43 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:59.272377 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 233/478] 10.222.0.69 () {60 vars in 1132 bytes} [Mon Aug 29 21:25:59 2022] POST /identity/v3/users => generated 249 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:25:59.303697 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd281e-c7c8-4e4b-ab5a-ad0cd4e5df6b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:59.347164 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5094d5-f289-4367-bb8f-d1d7fe6bd680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:59.347842 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5094d5-f289-4367-bb8f-d1d7fe6bd680 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:59.348556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5094d5-f289-4367-bb8f-d1d7fe6bd680 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:59.349106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5094d5-f289-4367-bb8f-d1d7fe6bd680 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:59.363303 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5094d5-f289-4367-bb8f-d1d7fe6bd680 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:25:59.369559 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-bd5094d5-f289-4367-bb8f-d1d7fe6bd680 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:25:59.369559 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:25:59.369559 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:25:59.369559 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:25:59.369559 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:25:59.369559 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:25:59.369559 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:25:59.369559 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:25:59.369559 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:25:59.369559 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:25:59.369559 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:25:59.369559 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:25:59.369559 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:25:59.369559 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:25:59.369559 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:25:59.369559 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:25:59.370548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:25:59.370548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:25:59.370548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:25:59.370548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:25:59.370548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:25:59.370548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:25:59.370548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:25:59.370548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:25:59.370548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:25:59.370548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:25:59.370548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:25:59.370548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:25:59.370548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:25:59.370548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:25:59.370548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:25:59.370548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:25:59.371365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:25:59.371365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:25:59.371365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:25:59.371365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:25:59.371365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:25:59.371365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:25:59.371365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:25:59.371365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:25:59.371365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:25:59.371365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:25:59.371365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:25:59.371365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:25:59.371365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 246/479] 10.222.0.69 () {56 vars in 1114 bytes} [Mon Aug 29 21:25:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:25:59.381375 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f713eaf-6544-4770-a9d0-5453d21a3b43 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:25:59.546012 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f713eaf-6544-4770-a9d0-5453d21a3b43 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:25:59.589749 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12974ed6-66f4-4963-92f4-057831b2dac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:25:59.590432 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12974ed6-66f4-4963-92f4-057831b2dac9 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:25:59.590717 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12974ed6-66f4-4963-92f4-057831b2dac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:25:59.590988 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12974ed6-66f4-4963-92f4-057831b2dac9 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:25:59.591668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12974ed6-66f4-4963-92f4-057831b2dac9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:25:59.591972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12974ed6-66f4-4963-92f4-057831b2dac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:25:59.593398 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12974ed6-66f4-4963-92f4-057831b2dac9 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:25:59.603703 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 234/480] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:25:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:00.572411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01d5ff-6bef-4442-8eb8-8bf3f65f8cdf None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:00.572919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01d5ff-6bef-4442-8eb8-8bf3f65f8cdf None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:00.572919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01d5ff-6bef-4442-8eb8-8bf3f65f8cdf None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:00.574517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 247/481] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:00.580007 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845270ee-b2c2-492d-a073-c3751cbcc76c None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:00.580600 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845270ee-b2c2-492d-a073-c3751cbcc76c None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:00.580600 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845270ee-b2c2-492d-a073-c3751cbcc76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:00.596991 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:00.603811 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-845270ee-b2c2-492d-a073-c3751cbcc76c None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:00.606232 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-845270ee-b2c2-492d-a073-c3751cbcc76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:00.698945 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 235/482] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:01.053730 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01d5ff-6bef-4442-8eb8-8bf3f65f8cdf None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:01.175548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01d5ff-6bef-4442-8eb8-8bf3f65f8cdf None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:01.189384 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:01.216110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee63e08-dcfe-4e94-8eb7-9ec2c6194094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:01.216790 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee63e08-dcfe-4e94-8eb7-9ec2c6194094 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:01.217068 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee63e08-dcfe-4e94-8eb7-9ec2c6194094 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:01.217339 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee63e08-dcfe-4e94-8eb7-9ec2c6194094 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:01.232127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee63e08-dcfe-4e94-8eb7-9ec2c6194094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:01.237481 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-dee63e08-dcfe-4e94-8eb7-9ec2c6194094 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:01.237481 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:01.237481 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:01.237481 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:01.237481 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:01.237481 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:01.237481 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:01.237481 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:01.237481 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:01.237481 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:01.237481 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:01.237481 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:01.237481 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:01.237481 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:01.237481 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:01.237481 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:01.238791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:01.238791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:01.238791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:01.238791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:01.238791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:01.238791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:01.238791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:01.238791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:01.238791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:01.238791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:01.238791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:01.238791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:01.238791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:01.238791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:01.238791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:01.238791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:01.239604 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:01.239604 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:01.239604 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:01.239604 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:01.239604 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:01.239604 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:01.239604 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:01.239604 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:01.239604 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:01.239604 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:01.239604 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:01.239604 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:01.241983 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 248/483] 10.222.0.69 () {56 vars in 1102 bytes} [Mon Aug 29 21:26:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:01.247881 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845270ee-b2c2-492d-a073-c3751cbcc76c None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:01.265507 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e375775-8890-4dcf-a47d-10ca4340275a None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:01.266183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e375775-8890-4dcf-a47d-10ca4340275a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:01.266659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e375775-8890-4dcf-a47d-10ca4340275a None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:01.268618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 249/484] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:26:01.274294 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee2b7f-f2f1-45a0-a0fc-a3e8084fcb02 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:01.275452 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee2b7f-f2f1-45a0-a0fc-a3e8084fcb02 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:01.275993 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee2b7f-f2f1-45a0-a0fc-a3e8084fcb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:01.298097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-90ee2b7f-f2f1-45a0-a0fc-a3e8084fcb02 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:01.300544 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-90ee2b7f-f2f1-45a0-a0fc-a3e8084fcb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:01.410709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845270ee-b2c2-492d-a073-c3751cbcc76c None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:01.456432 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf8173-c6da-4e47-ada2-064f8bbd55c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:01.458302 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf8173-c6da-4e47-ada2-064f8bbd55c5 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:01.459768 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 250/485] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:26:01.464383 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf8173-c6da-4e47-ada2-064f8bbd55c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:01.464966 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf8173-c6da-4e47-ada2-064f8bbd55c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:01.465903 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf8173-c6da-4e47-ada2-064f8bbd55c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:01.466414 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf8173-c6da-4e47-ada2-064f8bbd55c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:01.468027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf8173-c6da-4e47-ada2-064f8bbd55c5 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:01.470997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:01.483583 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 236/486] 10.222.0.69 () {56 vars in 1103 bytes} [Mon Aug 29 21:26:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:01.488891 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee2b7f-f2f1-45a0-a0fc-a3e8084fcb02 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:01.592172 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581d105-8d5b-4d2f-9ead-302e33a375e4 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:01.592700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581d105-8d5b-4d2f-9ead-302e33a375e4 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:01.592776 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581d105-8d5b-4d2f-9ead-302e33a375e4 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:01.595397 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 237/487] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:26:01.599733 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f239b46-7465-4002-85c1-c4e484ff061b None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:01.600014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f239b46-7465-4002-85c1-c4e484ff061b None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:01.600340 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f239b46-7465-4002-85c1-c4e484ff061b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:01.627371 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-4f239b46-7465-4002-85c1-c4e484ff061b None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:01.628641 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-4f239b46-7465-4002-85c1-c4e484ff061b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:01.655056 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee2b7f-f2f1-45a0-a0fc-a3e8084fcb02 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:01.663902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:01.724366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943273c3-1ea9-4575-b510-4568372a07d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:01.725020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943273c3-1ea9-4575-b510-4568372a07d4 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:01.725297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943273c3-1ea9-4575-b510-4568372a07d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:01.725569 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943273c3-1ea9-4575-b510-4568372a07d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:01.745620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943273c3-1ea9-4575-b510-4568372a07d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:01.747112 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943273c3-1ea9-4575-b510-4568372a07d4 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:01.763300 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 238/488] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:26:01.776646 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-943273c3-1ea9-4575-b510-4568372a07d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:01.776646 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:01.776646 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:01.776646 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:01.776646 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:01.776646 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:01.776646 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:01.776646 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:01.776646 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:01.776646 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:01.776646 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:01.776646 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:01.776646 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:01.776646 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:01.776646 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:01.776646 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:01.777659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:01.777659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:01.777659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:01.777659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:01.777659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:01.777659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:01.777659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:01.777659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:01.777659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:01.777659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:01.777659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:01.777659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:01.777659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:01.777659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:01.777659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:01.777659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:01.777659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:01.778526 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:01.778526 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:01.778526 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:01.778526 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 251/489] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:01.783624 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f239b46-7465-4002-85c1-c4e484ff061b None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:01.803026 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943273c3-1ea9-4575-b510-4568372a07d4 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:01.932241 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f239b46-7465-4002-85c1-c4e484ff061b None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:01.964015 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943273c3-1ea9-4575-b510-4568372a07d4 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:01.971289 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:01.983399 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea7c37-ef0c-4aaf-8217-d6179ad6bc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:01.984337 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea7c37-ef0c-4aaf-8217-d6179ad6bc7a None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:01.984624 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea7c37-ef0c-4aaf-8217-d6179ad6bc7a None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:01.984932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea7c37-ef0c-4aaf-8217-d6179ad6bc7a None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:01.985966 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea7c37-ef0c-4aaf-8217-d6179ad6bc7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:01.986273 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea7c37-ef0c-4aaf-8217-d6179ad6bc7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:01.987737 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea7c37-ef0c-4aaf-8217-d6179ad6bc7a None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:02.005188 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1311b49-cf66-4c8a-b816-3b22f76d2992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:02.005510 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 239/490] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:02.006880 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbb5ae-7b55-4352-a74f-996f103cff29 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:02.007167 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbb5ae-7b55-4352-a74f-996f103cff29 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:02.007443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbb5ae-7b55-4352-a74f-996f103cff29 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:02.010982 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1311b49-cf66-4c8a-b816-3b22f76d2992 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:02.011376 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1311b49-cf66-4c8a-b816-3b22f76d2992 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:02.011720 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1311b49-cf66-4c8a-b816-3b22f76d2992 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:02.013411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 240/491] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:02.014638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fbb5ae-7b55-4352-a74f-996f103cff29 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:02.024999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1311b49-cf66-4c8a-b816-3b22f76d2992 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:02.031281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-d1311b49-cf66-4c8a-b816-3b22f76d2992 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:02.031281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:02.031281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:02.031281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:02.031281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:02.031281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:02.031281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:02.031281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:02.031281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:02.031281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:02.031281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:02.031281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:02.031281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:02.031281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:02.031281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:02.031281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:02.032220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:02.032220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:02.032220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:02.032220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:02.032220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:02.032220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:02.032220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:02.032220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:02.032220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:02.032220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:02.032220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:02.032220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:02.032220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:02.032220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:02.032220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:02.032220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:02.033246 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:02.033246 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:02.033246 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:02.033246 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:02.033246 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:02.033246 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:02.033246 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:02.033246 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:02.033246 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:02.033246 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:02.033246 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:02.033246 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:02.034010 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 252/492] 10.222.0.69 () {56 vars in 1102 bytes} [Mon Aug 29 21:26:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:26:02.037882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065090a7-8ae6-49d3-9a3e-5c09035bbc03 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:02.037882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065090a7-8ae6-49d3-9a3e-5c09035bbc03 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:02.037882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065090a7-8ae6-49d3-9a3e-5c09035bbc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:02.058773 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-065090a7-8ae6-49d3-9a3e-5c09035bbc03 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:02.060171 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-065090a7-8ae6-49d3-9a3e-5c09035bbc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:02.071929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:02.142186 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 253/493] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:02.143495 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065090a7-8ae6-49d3-9a3e-5c09035bbc03 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:02.173362 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fbb5ae-7b55-4352-a74f-996f103cff29 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:02.218081 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd251f-8f88-40b9-a244-1628836a6f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:02.219199 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd251f-8f88-40b9-a244-1628836a6f92 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:02.219484 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd251f-8f88-40b9-a244-1628836a6f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:02.219760 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd251f-8f88-40b9-a244-1628836a6f92 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:02.229462 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd251f-8f88-40b9-a244-1628836a6f92 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:02.231272 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd251f-8f88-40b9-a244-1628836a6f92 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:02.248159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-85dd251f-8f88-40b9-a244-1628836a6f92 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:26:02.248159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:02.248159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:02.248159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:02.248159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:02.248159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:02.248159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:02.248159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:02.248159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:02.248159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:02.248159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:02.248159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:02.248159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:02.248159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:02.248159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:02.248159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:02.249168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:02.249168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:02.249168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:02.249168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:02.249168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:02.249168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:02.249168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:02.249168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:02.249168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:02.249168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:02.249168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:02.249168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:02.249168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:02.249168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:02.249168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:02.249168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:02.249168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:02.249168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:02.250092 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:02.250092 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:02.250092 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:02.250092 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:02.250092 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:02.250092 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:02.250092 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:02.250092 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:02.250092 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:26:02.250092 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:02.252395 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 241/494] 10.222.0.69 () {56 vars in 1093 bytes} [Mon Aug 29 21:26:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:02.253434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd251f-8f88-40b9-a244-1628836a6f92 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:02.276256 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065090a7-8ae6-49d3-9a3e-5c09035bbc03 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:02.309555 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:02.316222 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a4269-9884-4f21-a96b-062c91264301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:02.316984 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a4269-9884-4f21-a96b-062c91264301 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:02.317284 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a4269-9884-4f21-a96b-062c91264301 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:02.317627 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a4269-9884-4f21-a96b-062c91264301 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:02.318366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a4269-9884-4f21-a96b-062c91264301 None admin] RBAC: Adding query filter params (name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:02.318739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a4269-9884-4f21-a96b-062c91264301 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:02.320475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a4269-9884-4f21-a96b-062c91264301 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:02.335796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 254/495] 10.222.0.69 () {56 vars in 1103 bytes} [Mon Aug 29 21:26:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:02.335796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a4269-9884-4f21-a96b-062c91264301 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:02.348079 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:02.401980 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd251f-8f88-40b9-a244-1628836a6f92 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:02.440282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de417e17-dccb-4692-ba0a-48be05ed5d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:02.440933 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de417e17-dccb-4692-ba0a-48be05ed5d6d None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:02.441213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de417e17-dccb-4692-ba0a-48be05ed5d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:02.441485 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de417e17-dccb-4692-ba0a-48be05ed5d6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:02.452299 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de417e17-dccb-4692-ba0a-48be05ed5d6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:02.457798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-de417e17-dccb-4692-ba0a-48be05ed5d6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:02.457798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:02.457798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:02.457798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:02.457798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:02.457798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:02.457798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:02.457798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:02.457798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:02.457798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:02.457798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:02.457798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:02.457798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:02.457798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:02.457798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:02.457798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:02.458899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:02.458899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:02.458899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:02.458899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:02.458899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:02.458899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:02.458899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:02.458899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:02.458899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:02.458899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:02.458899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:02.458899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:02.458899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:02.458899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:02.458899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:02.458899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:02.459755 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:02.459755 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:02.459755 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:02.459755 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:02.459755 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:02.459755 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:02.459755 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:02.459755 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:02.459755 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:02.459755 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:02.459755 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:02.459755 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:02.459755 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 242/496] 10.222.0.69 () {56 vars in 1102 bytes} [Mon Aug 29 21:26:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:02.460471 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de417e17-dccb-4692-ba0a-48be05ed5d6d None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:02.471056 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a4269-9884-4f21-a96b-062c91264301 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:02.507361 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38b42a-29c1-4dac-9ef2-8c13cf3cc181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:02.507970 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38b42a-29c1-4dac-9ef2-8c13cf3cc181 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:02.508289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38b42a-29c1-4dac-9ef2-8c13cf3cc181 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:02.508569 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38b42a-29c1-4dac-9ef2-8c13cf3cc181 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:02.509471 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38b42a-29c1-4dac-9ef2-8c13cf3cc181 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:02.509641 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38b42a-29c1-4dac-9ef2-8c13cf3cc181 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:02.511095 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38b42a-29c1-4dac-9ef2-8c13cf3cc181 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:02.550926 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 255/497] 10.222.0.69 () {56 vars in 1133 bytes} [Mon Aug 29 21:26:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:02.552163 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8bddd-3457-4b06-9e73-c6d4f8811518 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:02.552614 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8bddd-3457-4b06-9e73-c6d4f8811518 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:02.552765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8bddd-3457-4b06-9e73-c6d4f8811518 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:02.554193 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 256/498] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:02.554743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8bddd-3457-4b06-9e73-c6d4f8811518 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:02.574927 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de417e17-dccb-4692-ba0a-48be05ed5d6d None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:02.584660 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:02.612799 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54890b-af58-43d7-9ca6-47fe1b19cfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:02.613904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54890b-af58-43d7-9ca6-47fe1b19cfc0 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:02.614414 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54890b-af58-43d7-9ca6-47fe1b19cfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:02.614916 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54890b-af58-43d7-9ca6-47fe1b19cfc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:02.626490 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:02.627584 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54890b-af58-43d7-9ca6-47fe1b19cfc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:02.630383 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54890b-af58-43d7-9ca6-47fe1b19cfc0 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:02.657972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-6e54890b-af58-43d7-9ca6-47fe1b19cfc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:02.657972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:02.657972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:02.657972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:02.657972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:02.657972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:02.657972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:02.657972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:02.657972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:02.657972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:02.657972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:02.657972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:02.657972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:02.657972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:02.657972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:02.657972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:02.659139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:02.659139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:02.659139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:02.659139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:02.659139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:02.659139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:02.659139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:02.659139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:02.659139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:02.659139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:02.659139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:02.659139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:02.659139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:02.659139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:02.659139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:02.659139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:02.659139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:02.660137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:02.660137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:02.660137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:02.660137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 243/499] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:02.661665 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54890b-af58-43d7-9ca6-47fe1b19cfc0 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:02.668885 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8bddd-3457-4b06-9e73-c6d4f8811518 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:02.705756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676c684-deac-4730-a5b2-641a7f202e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:02.706517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676c684-deac-4730-a5b2-641a7f202e66 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:02.706802 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676c684-deac-4730-a5b2-641a7f202e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:02.707073 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676c684-deac-4730-a5b2-641a7f202e66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:02.718894 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676c684-deac-4730-a5b2-641a7f202e66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:02.723708 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-1676c684-deac-4730-a5b2-641a7f202e66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:02.723708 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:02.723708 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:02.723708 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:02.723708 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:02.723708 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:02.723708 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:02.723708 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:02.723708 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:02.723708 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:02.723708 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:02.723708 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:02.723708 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:02.723708 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:02.723708 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:02.723708 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:02.724791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:02.724791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:02.724791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:02.724791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:02.724791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:02.724791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:02.724791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:02.724791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:02.724791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:02.724791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:02.724791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:02.724791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:02.724791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:02.724791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:02.724791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:02.724791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:02.725633 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:02.725633 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:02.725633 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:02.725633 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:02.725633 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:02.725633 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:02.725633 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:02.725633 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:02.725633 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:02.725633 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:02.725633 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:02.725633 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:02.728365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 257/500] 10.222.0.69 () {56 vars in 1102 bytes} [Mon Aug 29 21:26:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:02.729367 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676c684-deac-4730-a5b2-641a7f202e66 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:02.784701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54890b-af58-43d7-9ca6-47fe1b19cfc0 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:02.819020 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046efd33-4d5f-438e-9e0e-5a3610167fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:02.819635 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046efd33-4d5f-438e-9e0e-5a3610167fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:02.819915 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046efd33-4d5f-438e-9e0e-5a3610167fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:02.820202 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046efd33-4d5f-438e-9e0e-5a3610167fb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:02.820894 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046efd33-4d5f-438e-9e0e-5a3610167fb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:02.821192 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046efd33-4d5f-438e-9e0e-5a3610167fb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:02.823084 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046efd33-4d5f-438e-9e0e-5a3610167fb6 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:02.831888 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 244/501] 10.222.0.69 () {56 vars in 1103 bytes} [Mon Aug 29 21:26:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:02.834505 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676c684-deac-4730-a5b2-641a7f202e66 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:02.837876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cff3e-e5b9-4dea-a672-978056fc04a5 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:02.838233 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cff3e-e5b9-4dea-a672-978056fc04a5 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:02.838512 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cff3e-e5b9-4dea-a672-978056fc04a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:02.860528 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-0e9cff3e-e5b9-4dea-a672-978056fc04a5 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:02.861638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:02.862230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-0e9cff3e-e5b9-4dea-a672-978056fc04a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:02.875884 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb17f0-d153-4dce-94f8-8d85c68db1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:02.876533 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb17f0-d153-4dce-94f8-8d85c68db1bb None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:02.876816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb17f0-d153-4dce-94f8-8d85c68db1bb None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:02.877087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb17f0-d153-4dce-94f8-8d85c68db1bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:02.882411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:02.937434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 245/502] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:02.938436 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cff3e-e5b9-4dea-a672-978056fc04a5 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:02.957838 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb17f0-d153-4dce-94f8-8d85c68db1bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:02.959880 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb17f0-d153-4dce-94f8-8d85c68db1bb None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:03.053582 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cff3e-e5b9-4dea-a672-978056fc04a5 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:03.074715 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 258/503] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:26:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:03.075671 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb17f0-d153-4dce-94f8-8d85c68db1bb None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:03.097242 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dbac8-8229-4960-94f1-39798f5f37da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:03.098108 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dbac8-8229-4960-94f1-39798f5f37da None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:03.098389 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dbac8-8229-4960-94f1-39798f5f37da None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:03.098664 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dbac8-8229-4960-94f1-39798f5f37da None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:03.099310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dbac8-8229-4960-94f1-39798f5f37da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:03.099616 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dbac8-8229-4960-94f1-39798f5f37da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:03.101309 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dbac8-8229-4960-94f1-39798f5f37da None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:03.107134 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:03.117828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 246/504] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:03.117828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dbac8-8229-4960-94f1-39798f5f37da None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:03.131225 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:03.200975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb17f0-d153-4dce-94f8-8d85c68db1bb None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:03.242314 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dbac8-8229-4960-94f1-39798f5f37da None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:03.243914 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418e818-8773-4fa4-b947-55f21964bf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:03.244724 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418e818-8773-4fa4-b947-55f21964bf80 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:03.245001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418e818-8773-4fa4-b947-55f21964bf80 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:03.245277 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418e818-8773-4fa4-b947-55f21964bf80 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:03.245949 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418e818-8773-4fa4-b947-55f21964bf80 None admin] RBAC: Adding query filter params (name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:03.246252 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418e818-8773-4fa4-b947-55f21964bf80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:03.247677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418e818-8773-4fa4-b947-55f21964bf80 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:03.258250 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 259/505] 10.222.0.69 () {56 vars in 1103 bytes} [Mon Aug 29 21:26:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:03.259725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418e818-8773-4fa4-b947-55f21964bf80 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:03.284846 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73181c00-439e-40ab-a6ad-f150f5c8d68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:03.285494 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73181c00-439e-40ab-a6ad-f150f5c8d68d None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:03.285910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73181c00-439e-40ab-a6ad-f150f5c8d68d None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:03.286025 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73181c00-439e-40ab-a6ad-f150f5c8d68d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:03.298465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73181c00-439e-40ab-a6ad-f150f5c8d68d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:03.299966 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73181c00-439e-40ab-a6ad-f150f5c8d68d None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:03.315766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-73181c00-439e-40ab-a6ad-f150f5c8d68d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:03.315766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:03.315766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:03.315766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:03.315766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:03.315766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:03.315766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:03.315766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:03.315766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:03.315766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:03.315766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:03.315766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:03.315766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:03.315766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:03.315766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:03.315766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:03.316751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:03.316751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:03.316751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:03.316751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:03.316751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:03.316751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:03.316751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:03.316751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:03.316751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:03.316751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:03.316751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:03.316751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:03.316751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:03.316751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:03.316751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:03.316751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:03.316751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:03.317815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:03.317815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:03.317815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:03.317815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 247/506] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:03.317815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73181c00-439e-40ab-a6ad-f150f5c8d68d None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:03.359597 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:03.376883 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418e818-8773-4fa4-b947-55f21964bf80 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:03.388619 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:03.417473 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553f788-42a4-4e6e-87c1-e618532c6d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:03.418119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553f788-42a4-4e6e-87c1-e618532c6d5c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:03.418397 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553f788-42a4-4e6e-87c1-e618532c6d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:03.418669 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553f788-42a4-4e6e-87c1-e618532c6d5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:03.431274 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553f788-42a4-4e6e-87c1-e618532c6d5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:03.432790 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73181c00-439e-40ab-a6ad-f150f5c8d68d None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:03.432917 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553f788-42a4-4e6e-87c1-e618532c6d5c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:03.449314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-f553f788-42a4-4e6e-87c1-e618532c6d5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:03.449314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:03.449314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:03.449314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:03.449314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:03.449314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:03.449314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:03.449314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:03.449314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:03.449314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:03.449314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:03.449314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:03.449314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:03.449314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:03.449314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:03.449314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:03.450431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:03.450431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:03.450431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:03.450431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:03.450431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:03.450431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:03.450431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:03.450431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:03.450431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:03.450431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:03.450431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:03.450431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:03.450431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:03.450431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:03.450431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:03.450431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:03.450431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:03.451359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:03.451359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:03.451359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:03.451359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 260/507] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:03.451359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553f788-42a4-4e6e-87c1-e618532c6d5c None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:03.472710 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2bf6d-9018-4829-b4f0-f02f823d3862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:03.473354 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2bf6d-9018-4829-b4f0-f02f823d3862 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:03.473629 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2bf6d-9018-4829-b4f0-f02f823d3862 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:03.473901 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2bf6d-9018-4829-b4f0-f02f823d3862 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:03.483219 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2bf6d-9018-4829-b4f0-f02f823d3862 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:03.484718 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2bf6d-9018-4829-b4f0-f02f823d3862 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:03.498033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-f4b2bf6d-9018-4829-b4f0-f02f823d3862 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 21:26:03.498033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:03.498033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:03.498033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:03.498033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:03.498033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:03.498033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:03.498033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:03.498033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:03.498033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:03.498033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:03.498033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:03.498033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:03.498033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:03.498033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:03.498033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:03.499173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:03.499173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:03.499173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:03.499173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:03.499173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:03.499173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:03.499173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:03.499173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:03.499173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:03.499173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:03.499173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:03.499173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:03.499173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:03.499173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:03.499173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:03.499173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:03.499173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:03.499173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:03.500425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:03.500425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:03.500425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:03.500425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:03.500425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:03.500425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:03.500425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:03.500425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:03.500425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 21:26:03.500425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:03.500425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 248/508] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:26:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:03.500425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2bf6d-9018-4829-b4f0-f02f823d3862 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:03.563766 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553f788-42a4-4e6e-87c1-e618532c6d5c None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:03.598389 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68960b93-bc53-4d68-923d-ed2d52f28fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:03.598958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68960b93-bc53-4d68-923d-ed2d52f28fee None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:03.599241 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68960b93-bc53-4d68-923d-ed2d52f28fee None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:03.599517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68960b93-bc53-4d68-923d-ed2d52f28fee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:03.606280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2bf6d-9018-4829-b4f0-f02f823d3862 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:03.610247 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:03.612578 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68960b93-bc53-4d68-923d-ed2d52f28fee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:03.614478 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68960b93-bc53-4d68-923d-ed2d52f28fee None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:03.630269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-68960b93-bc53-4d68-923d-ed2d52f28fee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:03.630269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:03.630269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:03.630269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:03.630269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:03.630269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:03.630269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:03.630269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:03.630269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:03.630269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:03.630269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:03.630269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:03.630269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:03.630269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:03.630269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:03.630269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:03.631233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:03.631233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:03.631233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:03.631233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:03.631233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:03.631233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:03.631233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:03.631233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:03.631233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:03.631233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:03.631233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:03.631233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:03.631233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:03.631233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:03.631233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:03.631233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:03.631233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:03.633069 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:03.633069 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:03.633069 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:03.633235 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:03.633790 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 261/509] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:03.633790 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68960b93-bc53-4d68-923d-ed2d52f28fee None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:03.644337 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4ced4-1dc6-436f-9679-1c2a8ba46834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:03.645028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4ced4-1dc6-436f-9679-1c2a8ba46834 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:03.645212 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4ced4-1dc6-436f-9679-1c2a8ba46834 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:03.645485 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4ced4-1dc6-436f-9679-1c2a8ba46834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:03.656634 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f4ced4-1dc6-436f-9679-1c2a8ba46834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:03.658096 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f4ced4-1dc6-436f-9679-1c2a8ba46834 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:03.673542 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-d7f4ced4-1dc6-436f-9679-1c2a8ba46834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:03.673542 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:03.673542 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:03.673542 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:03.673542 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:03.673542 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:03.673542 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:03.673542 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:03.673542 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:03.673542 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:03.673542 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:03.673542 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:03.673542 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:03.673542 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:03.673542 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:03.673542 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:03.674536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:03.674536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:03.674536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:03.674536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:03.674536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:03.674536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:03.674536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:03.674536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:03.674536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:03.674536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:03.674536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:03.674536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:03.674536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:03.674536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:03.674536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:03.674536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:03.674536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:03.675681 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:03.675681 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:03.675681 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:03.675681 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 249/510] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:03.675681 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4ced4-1dc6-436f-9679-1c2a8ba46834 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:03.741888 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68960b93-bc53-4d68-923d-ed2d52f28fee None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:03.777287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0418a76-38a5-4d54-895c-b87c32fac90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:03.777899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0418a76-38a5-4d54-895c-b87c32fac90f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:03.778183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0418a76-38a5-4d54-895c-b87c32fac90f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:03.778457 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0418a76-38a5-4d54-895c-b87c32fac90f None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:03.779103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0418a76-38a5-4d54-895c-b87c32fac90f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:03.779410 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0418a76-38a5-4d54-895c-b87c32fac90f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:03.779560 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4ced4-1dc6-436f-9679-1c2a8ba46834 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:03.780835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0418a76-38a5-4d54-895c-b87c32fac90f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:03.793572 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 262/511] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:03.794340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0418a76-38a5-4d54-895c-b87c32fac90f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:03.823202 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c20b21-bb02-47bb-ae0f-75bfe1ad24e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:03.823813 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c20b21-bb02-47bb-ae0f-75bfe1ad24e0 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:03.824098 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c20b21-bb02-47bb-ae0f-75bfe1ad24e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:03.824404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c20b21-bb02-47bb-ae0f-75bfe1ad24e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:03.825044 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c20b21-bb02-47bb-ae0f-75bfe1ad24e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:03.825345 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c20b21-bb02-47bb-ae0f-75bfe1ad24e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:03.826719 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c20b21-bb02-47bb-ae0f-75bfe1ad24e0 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:03.838961 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 250/512] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:03.839808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c20b21-bb02-47bb-ae0f-75bfe1ad24e0 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:03.848311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:03.886459 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:03.904131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0418a76-38a5-4d54-895c-b87c32fac90f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:03.940458 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f67b1-1943-4b89-9e28-5f5621e91b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:03.941386 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f67b1-1943-4b89-9e28-5f5621e91b2d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:03.941676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f67b1-1943-4b89-9e28-5f5621e91b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:03.942186 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f67b1-1943-4b89-9e28-5f5621e91b2d None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:03.943144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f67b1-1943-4b89-9e28-5f5621e91b2d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:03.943450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f67b1-1943-4b89-9e28-5f5621e91b2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:03.944945 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f67b1-1943-4b89-9e28-5f5621e91b2d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:03.953984 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c20b21-bb02-47bb-ae0f-75bfe1ad24e0 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:03.963141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 263/513] 10.222.0.69 () {56 vars in 1137 bytes} [Mon Aug 29 21:26:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:03.964267 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f67b1-1943-4b89-9e28-5f5621e91b2d None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:03.999739 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc82d34-fa53-4055-8b27-899f729fc78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:04.000384 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc82d34-fa53-4055-8b27-899f729fc78e None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:04.000667 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc82d34-fa53-4055-8b27-899f729fc78e None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:04.000942 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc82d34-fa53-4055-8b27-899f729fc78e None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:04.001583 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc82d34-fa53-4055-8b27-899f729fc78e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:04.001887 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc82d34-fa53-4055-8b27-899f729fc78e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:04.003271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc82d34-fa53-4055-8b27-899f729fc78e None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:04.015294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 251/514] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:04.016408 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc82d34-fa53-4055-8b27-899f729fc78e None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:04.076391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f67b1-1943-4b89-9e28-5f5621e91b2d None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:04.086313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:04.114411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb37e8-6fcd-4a57-a342-c55d6d8b1225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:04.115044 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb37e8-6fcd-4a57-a342-c55d6d8b1225 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:04.115329 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb37e8-6fcd-4a57-a342-c55d6d8b1225 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:04.115647 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb37e8-6fcd-4a57-a342-c55d6d8b1225 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:04.116281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb37e8-6fcd-4a57-a342-c55d6d8b1225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:04.117041 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb37e8-6fcd-4a57-a342-c55d6d8b1225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:04.117962 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb37e8-6fcd-4a57-a342-c55d6d8b1225 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:04.119595 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:04.125992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc82d34-fa53-4055-8b27-899f729fc78e None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:04.129902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 264/515] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:04.130755 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb37e8-6fcd-4a57-a342-c55d6d8b1225 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:04.162949 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d03156-621c-4d34-9f9f-bf4d4e101c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:04.163498 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d03156-621c-4d34-9f9f-bf4d4e101c4d None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:04.163773 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d03156-621c-4d34-9f9f-bf4d4e101c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:04.164045 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d03156-621c-4d34-9f9f-bf4d4e101c4d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:04.172489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d03156-621c-4d34-9f9f-bf4d4e101c4d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:04.173984 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d03156-621c-4d34-9f9f-bf4d4e101c4d None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:04.185895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-44d03156-621c-4d34-9f9f-bf4d4e101c4d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 21:26:04.185895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:04.185895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:04.185895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:04.185895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:04.185895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:04.185895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:04.185895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:04.185895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:04.185895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:04.185895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:04.185895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:04.185895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:04.185895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:04.185895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:04.185895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:04.187008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:04.187008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:04.187008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:04.187008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:04.187008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:04.187008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:04.187008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:04.187008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:04.187008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:04.187008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:04.187008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:04.187008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:04.187008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:04.187008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:04.187008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:04.187008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:04.187008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:04.187008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:04.187908 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:04.187908 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:04.187908 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:04.187908 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:04.187908 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:04.187908 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:04.187908 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:04.187908 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:04.187908 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 21:26:04.187908 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:04.187908 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 252/516] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:26:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:04.187908 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d03156-621c-4d34-9f9f-bf4d4e101c4d None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:04.240984 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb37e8-6fcd-4a57-a342-c55d6d8b1225 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:04.276853 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf27b02-8183-4d97-a870-377c923e7c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:04.277489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf27b02-8183-4d97-a870-377c923e7c1a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:04.277765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf27b02-8183-4d97-a870-377c923e7c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:04.278035 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf27b02-8183-4d97-a870-377c923e7c1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:04.285072 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf27b02-8183-4d97-a870-377c923e7c1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:04.286505 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf27b02-8183-4d97-a870-377c923e7c1a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:04.298622 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-ebf27b02-8183-4d97-a870-377c923e7c1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:04.298622 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:04.298622 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:04.298622 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:04.298622 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:04.298622 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:04.298622 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:04.298622 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:04.298622 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:04.298622 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:04.298622 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:04.298622 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:04.298622 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:04.298622 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:04.298622 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:04.299608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:04.299608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:04.299608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:04.299608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:04.299608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:04.299608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:04.299608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:04.299608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:04.299608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:04.299608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:04.299608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:04.299608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:04.299608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:04.299608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:04.299608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:04.299608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:04.299608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:04.300535 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:04.300535 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:04.300535 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:04.300535 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:04.300535 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:04.300535 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:04.300535 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:04.300535 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:04.301336 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d03156-621c-4d34-9f9f-bf4d4e101c4d None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:04.301469 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 265/517] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:04.301469 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf27b02-8183-4d97-a870-377c923e7c1a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:04.338762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:04.339183 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06427071-1095-40dd-856f-589eea3a32f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:04.339893 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06427071-1095-40dd-856f-589eea3a32f5 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:04.340230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06427071-1095-40dd-856f-589eea3a32f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:04.340545 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06427071-1095-40dd-856f-589eea3a32f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:04.382715 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:04.421750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf27b02-8183-4d97-a870-377c923e7c1a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:04.450311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06427071-1095-40dd-856f-589eea3a32f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:04.451779 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06427071-1095-40dd-856f-589eea3a32f5 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:04.460283 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f0483-8a69-40bc-9c0f-12f0d02595c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:04.460881 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f0483-8a69-40bc-9c0f-12f0d02595c7 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:04.461029 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f0483-8a69-40bc-9c0f-12f0d02595c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:04.461328 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f0483-8a69-40bc-9c0f-12f0d02595c7 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:04.461950 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f0483-8a69-40bc-9c0f-12f0d02595c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:04.463978 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f0483-8a69-40bc-9c0f-12f0d02595c7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:04.487097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 266/518] 10.222.0.69 () {60 vars in 1132 bytes} [Mon Aug 29 21:26:04 2022] POST /identity/v3/users => generated 247 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:26:04.488390 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f0483-8a69-40bc-9c0f-12f0d02595c7 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:04.578458 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 253/519] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:26:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:04.579489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06427071-1095-40dd-856f-589eea3a32f5 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:04.607130 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:04.626492 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f0483-8a69-40bc-9c0f-12f0d02595c7 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:04.651802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:04.668259 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953aca2-5121-4189-874b-9e9b919d3ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:04.668907 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953aca2-5121-4189-874b-9e9b919d3ebf None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:04.669187 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953aca2-5121-4189-874b-9e9b919d3ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:04.669493 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953aca2-5121-4189-874b-9e9b919d3ebf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:04.678115 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953aca2-5121-4189-874b-9e9b919d3ebf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:04.680008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953aca2-5121-4189-874b-9e9b919d3ebf None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:04.697232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-c953aca2-5121-4189-874b-9e9b919d3ebf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 21:26:04.697232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:04.697232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:04.697232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:04.697232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:04.697232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:04.697232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:04.697232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:04.697232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:04.697232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:04.697232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:04.697232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:04.697232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:04.697232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:04.697232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:04.697232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:04.699036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:04.699036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:04.699036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:04.699036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:04.699036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:04.699036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:04.699036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:04.699036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:04.699036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:04.699036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:04.699036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:04.699036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:04.699036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:04.699036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:04.699036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:04.699036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:04.699036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:04.699036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:04.700890 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:04.700890 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:04.700890 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:04.700890 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:04.700890 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:04.700890 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:04.700890 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:04.700890 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:04.700890 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 21:26:04.700890 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:04.700890 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 267/520] 10.222.0.69 () {56 vars in 1102 bytes} [Mon Aug 29 21:26:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:04.700890 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953aca2-5121-4189-874b-9e9b919d3ebf None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:04.716687 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06427071-1095-40dd-856f-589eea3a32f5 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:04.754541 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cade56-fbff-4098-a5b9-c3eb9ab0518a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:04.755154 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cade56-fbff-4098-a5b9-c3eb9ab0518a None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:04.755432 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cade56-fbff-4098-a5b9-c3eb9ab0518a None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:04.755704 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cade56-fbff-4098-a5b9-c3eb9ab0518a None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:04.756469 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cade56-fbff-4098-a5b9-c3eb9ab0518a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:04.756776 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cade56-fbff-4098-a5b9-c3eb9ab0518a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:04.758207 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cade56-fbff-4098-a5b9-c3eb9ab0518a None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:04.804283 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 254/521] 10.222.0.69 () {56 vars in 1137 bytes} [Mon Aug 29 21:26:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:04.804283 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cade56-fbff-4098-a5b9-c3eb9ab0518a None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:04.828554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953aca2-5121-4189-874b-9e9b919d3ebf None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:04.866665 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c0dcf-7820-4c30-85d9-7170ff67cbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:04.867411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c0dcf-7820-4c30-85d9-7170ff67cbd6 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:04.867606 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c0dcf-7820-4c30-85d9-7170ff67cbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:04.867838 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c0dcf-7820-4c30-85d9-7170ff67cbd6 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:04.869735 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c0dcf-7820-4c30-85d9-7170ff67cbd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:04.869735 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c0dcf-7820-4c30-85d9-7170ff67cbd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:04.871413 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c0dcf-7820-4c30-85d9-7170ff67cbd6 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:04.898455 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 268/522] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:04.898455 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c0dcf-7820-4c30-85d9-7170ff67cbd6 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:04.904044 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:04.916776 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cade56-fbff-4098-a5b9-c3eb9ab0518a None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:04.935098 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:04.960916 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239b5ac-66a7-43ca-97c0-a1107ffa14eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:04.961574 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239b5ac-66a7-43ca-97c0-a1107ffa14eb None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:04.961830 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239b5ac-66a7-43ca-97c0-a1107ffa14eb None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:04.962131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239b5ac-66a7-43ca-97c0-a1107ffa14eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:04.972984 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239b5ac-66a7-43ca-97c0-a1107ffa14eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:04.974503 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239b5ac-66a7-43ca-97c0-a1107ffa14eb None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:04.993928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-1239b5ac-66a7-43ca-97c0-a1107ffa14eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:04.993928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:04.993928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:04.993928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:04.993928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:04.993928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:04.993928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:04.993928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:04.993928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:04.993928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:04.993928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:04.993928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:04.993928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:04.993928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:04.993928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:04.993928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:04.994955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:04.994955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:04.994955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:04.994955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:04.994955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:04.994955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:04.994955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:04.994955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:04.994955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:04.994955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:04.994955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:04.994955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:04.994955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:04.994955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:04.994955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:04.994955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:04.994955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:04.995814 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:04.995814 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:04.995814 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:04.999619 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 255/523] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:05.000569 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239b5ac-66a7-43ca-97c0-a1107ffa14eb None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:05.020956 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c0dcf-7820-4c30-85d9-7170ff67cbd6 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:05.059087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5644647-49ee-4de5-87e7-1c078d014fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:05.059802 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5644647-49ee-4de5-87e7-1c078d014fbc None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:05.060091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5644647-49ee-4de5-87e7-1c078d014fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:05.060402 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5644647-49ee-4de5-87e7-1c078d014fbc None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:05.061147 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5644647-49ee-4de5-87e7-1c078d014fbc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:05.061461 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5644647-49ee-4de5-87e7-1c078d014fbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:05.062916 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5644647-49ee-4de5-87e7-1c078d014fbc None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:05.081268 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 269/524] 10.222.0.69 () {56 vars in 1139 bytes} [Mon Aug 29 21:26:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:05.082134 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5644647-49ee-4de5-87e7-1c078d014fbc None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:05.137313 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239b5ac-66a7-43ca-97c0-a1107ffa14eb None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:05.156429 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:05.179083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4934aea-6b94-444a-9192-46d61a18ddbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:05.179716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4934aea-6b94-444a-9192-46d61a18ddbd None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:05.180008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4934aea-6b94-444a-9192-46d61a18ddbd None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:05.180304 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4934aea-6b94-444a-9192-46d61a18ddbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:05.209282 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5644647-49ee-4de5-87e7-1c078d014fbc None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:05.222080 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:05.252943 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa09c14-b480-4352-943d-0d72524ac851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:05.253562 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa09c14-b480-4352-943d-0d72524ac851 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:05.253841 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa09c14-b480-4352-943d-0d72524ac851 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:05.254113 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa09c14-b480-4352-943d-0d72524ac851 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:05.254832 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa09c14-b480-4352-943d-0d72524ac851 None admin] RBAC: Adding query filter params (role.id=3766508ffa094bb5bbec6d9209745261, scope.project.id=a302406c548c43c983625c0d66da47cc, user.id=96c35c544cae4ad187f1a1be723e0d21) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:05.255143 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa09c14-b480-4352-943d-0d72524ac851 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:05.256693 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa09c14-b480-4352-943d-0d72524ac851 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:05.263567 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 270/525] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:26:05 2022] GET /identity/v3/role_assignments?user.id=96c35c544cae4ad187f1a1be723e0d21&scope.project.id=a302406c548c43c983625c0d66da47cc&role.id=3766508ffa094bb5bbec6d9209745261 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:05.264102 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4934aea-6b94-444a-9192-46d61a18ddbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:05.264409 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa09c14-b480-4352-943d-0d72524ac851 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:05.266141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4934aea-6b94-444a-9192-46d61a18ddbd None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:05.391081 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 256/526] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:26:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:05.392611 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4934aea-6b94-444a-9192-46d61a18ddbd None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:05.424548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa09c14-b480-4352-943d-0d72524ac851 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:05.481370 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:05.500621 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:05.515596 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd08d98-4fbe-4961-b276-8aecd0c57fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:05.516254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd08d98-4fbe-4961-b276-8aecd0c57fff None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:05.516542 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd08d98-4fbe-4961-b276-8aecd0c57fff None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:05.516818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd08d98-4fbe-4961-b276-8aecd0c57fff None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:05.517480 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd08d98-4fbe-4961-b276-8aecd0c57fff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:05.517786 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd08d98-4fbe-4961-b276-8aecd0c57fff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:05.519188 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd08d98-4fbe-4961-b276-8aecd0c57fff None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:05.556287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 271/527] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:05.556287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd08d98-4fbe-4961-b276-8aecd0c57fff None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:05.572651 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4934aea-6b94-444a-9192-46d61a18ddbd None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:05.649471 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de961f-5c9f-4ca3-ab5a-868b58228320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:05.650657 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de961f-5c9f-4ca3-ab5a-868b58228320 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:05.652775 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de961f-5c9f-4ca3-ab5a-868b58228320 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:05.653317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de961f-5c9f-4ca3-ab5a-868b58228320 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:05.750823 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd08d98-4fbe-4961-b276-8aecd0c57fff None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:05.793892 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc81474-bf1c-4712-b233-b753640d0391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:05.800201 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc81474-bf1c-4712-b233-b753640d0391 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:05.800201 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc81474-bf1c-4712-b233-b753640d0391 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:05.800201 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc81474-bf1c-4712-b233-b753640d0391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:05.809282 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc81474-bf1c-4712-b233-b753640d0391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:05.810748 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc81474-bf1c-4712-b233-b753640d0391 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:05.819763 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de961f-5c9f-4ca3-ab5a-868b58228320 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:05.825855 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de961f-5c9f-4ca3-ab5a-868b58228320 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:05.845451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-7bc81474-bf1c-4712-b233-b753640d0391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:05.845451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:05.845451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:05.845451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:05.845451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:05.845451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:05.845451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:05.845451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:05.845451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:05.845451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:05.845451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:05.845451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:05.845451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:05.845451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:05.845451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:05.845451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:05.846758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:05.846758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:05.846758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:05.846758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:05.846758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:05.846758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:05.846758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:05.846758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:05.846758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:05.846758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:05.846758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:05.846758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:05.846758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:05.846758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:05.846758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:05.846758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:05.846758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:05.847629 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:05.847629 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:05.847629 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:05.850377 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 272/528] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:05.851859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc81474-bf1c-4712-b233-b753640d0391 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:05.938374 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:05.944071 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:05.995141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 257/529] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:26:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:05.996148 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de961f-5c9f-4ca3-ab5a-868b58228320 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:06.020130 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc81474-bf1c-4712-b233-b753640d0391 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:06.058066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e7588-5379-4191-b40d-f4f97fd7c826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:06.058715 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e7588-5379-4191-b40d-f4f97fd7c826 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:06.059150 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e7588-5379-4191-b40d-f4f97fd7c826 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:06.059453 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e7588-5379-4191-b40d-f4f97fd7c826 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:06.067140 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e7588-5379-4191-b40d-f4f97fd7c826 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:06.068707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e7588-5379-4191-b40d-f4f97fd7c826 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:06.081660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-177e7588-5379-4191-b40d-f4f97fd7c826 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:06.081660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:06.081660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:06.081660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:06.081660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:06.081660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:06.081660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:06.081660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:06.081660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:06.081660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:06.081660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:06.081660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:06.081660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:06.081660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:06.081660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:06.083690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:06.083690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:06.083690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:06.083690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:06.083690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:06.083690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:06.083690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:06.083690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:06.083690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:06.083690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:06.083690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:06.083690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:06.083690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:06.083690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:06.083690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:06.083690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:06.083690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:06.085784 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:06.085784 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:06.085784 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:06.085784 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:06.085784 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:06.085784 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:06.085784 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:06.085784 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:06.085784 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 273/530] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:06.085784 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e7588-5379-4191-b40d-f4f97fd7c826 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:06.113635 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de961f-5c9f-4ca3-ab5a-868b58228320 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:06.152583 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bd6fc-aae5-46eb-84f4-ff41aad7e147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:06.153202 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bd6fc-aae5-46eb-84f4-ff41aad7e147 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:06.153484 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bd6fc-aae5-46eb-84f4-ff41aad7e147 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:06.153764 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bd6fc-aae5-46eb-84f4-ff41aad7e147 None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:06.154461 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905bd6fc-aae5-46eb-84f4-ff41aad7e147 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:06.154784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905bd6fc-aae5-46eb-84f4-ff41aad7e147 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:06.156191 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905bd6fc-aae5-46eb-84f4-ff41aad7e147 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:06.170341 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 258/531] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:06.170628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bd6fc-aae5-46eb-84f4-ff41aad7e147 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:06.197609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:06.201359 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:06.210722 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e7588-5379-4191-b40d-f4f97fd7c826 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:06.251269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c72e63-8815-423a-925c-5407da4ff903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:06.252138 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c72e63-8815-423a-925c-5407da4ff903 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:06.252583 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c72e63-8815-423a-925c-5407da4ff903 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:06.253021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c72e63-8815-423a-925c-5407da4ff903 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:06.264731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c72e63-8815-423a-925c-5407da4ff903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:06.266532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c72e63-8815-423a-925c-5407da4ff903 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:06.282986 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-a0c72e63-8815-423a-925c-5407da4ff903 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:06.282986 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:06.282986 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:06.282986 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:06.282986 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:06.282986 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:06.282986 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:06.282986 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:06.282986 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:06.282986 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:06.282986 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:06.282986 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:06.282986 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:06.282986 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:06.282986 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:06.282986 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:06.284125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:06.284125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:06.284125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:06.284125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:06.284125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:06.284125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:06.284125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:06.284125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:06.284125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:06.284125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:06.284125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:06.284125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:06.284125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:06.284125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:06.284125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:06.284125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:06.284125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:06.285284 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:06.285284 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:06.285284 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:06.287910 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 274/532] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:06.289473 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c72e63-8815-423a-925c-5407da4ff903 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:06.302760 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bd6fc-aae5-46eb-84f4-ff41aad7e147 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:06.341026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ceb54-410c-46ea-95ad-f84cc916f826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:06.341651 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ceb54-410c-46ea-95ad-f84cc916f826 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:06.341935 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ceb54-410c-46ea-95ad-f84cc916f826 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:06.342216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ceb54-410c-46ea-95ad-f84cc916f826 None admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:06.342917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ceb54-410c-46ea-95ad-f84cc916f826 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:06.343224 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ceb54-410c-46ea-95ad-f84cc916f826 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:06.344758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ceb54-410c-46ea-95ad-f84cc916f826 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:06.364810 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 259/533] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:06.365708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ceb54-410c-46ea-95ad-f84cc916f826 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:06.411188 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c72e63-8815-423a-925c-5407da4ff903 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:06.448211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca93c4a-c128-4aff-aa91-3754822e52fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:06.449033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca93c4a-c128-4aff-aa91-3754822e52fe None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:06.449485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca93c4a-c128-4aff-aa91-3754822e52fe None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:06.449861 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca93c4a-c128-4aff-aa91-3754822e52fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:06.458020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca93c4a-c128-4aff-aa91-3754822e52fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:06.459693 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca93c4a-c128-4aff-aa91-3754822e52fe None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:06.472292 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-dca93c4a-c128-4aff-aa91-3754822e52fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:06.472292 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:06.472292 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:06.472292 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:06.472292 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:06.472292 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:06.472292 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:06.472292 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:06.472292 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:06.472292 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:06.472292 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:06.472292 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:06.472292 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:06.472292 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:06.472292 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:06.473532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:06.473532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:06.473532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:06.473532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:06.473532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:06.473532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:06.473532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:06.473532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:06.473532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:06.473532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:06.473532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:06.473532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:06.473532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:06.473532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:06.473532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:06.473532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:06.473532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:06.474627 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:06.474627 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:06.474627 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:06.474627 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:06.474627 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:06.474627 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:06.474627 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:06.474627 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:06.474627 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 275/534] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:06.475187 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca93c4a-c128-4aff-aa91-3754822e52fe None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:06.475561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:06.482914 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ceb54-410c-46ea-95ad-f84cc916f826 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:06.492954 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:06.524931 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb4f0c-a3ee-42bd-b239-79e91ff21615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:06.525918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb4f0c-a3ee-42bd-b239-79e91ff21615 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:06.526330 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb4f0c-a3ee-42bd-b239-79e91ff21615 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:06.526715 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb4f0c-a3ee-42bd-b239-79e91ff21615 None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:06.527577 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb4f0c-a3ee-42bd-b239-79e91ff21615 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:06.527987 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb4f0c-a3ee-42bd-b239-79e91ff21615 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:06.529716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb4f0c-a3ee-42bd-b239-79e91ff21615 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:06.544684 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 260/535] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:06.545627 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb4f0c-a3ee-42bd-b239-79e91ff21615 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:06.601148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca93c4a-c128-4aff-aa91-3754822e52fe None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:06.644196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864eb427-a1e4-4f87-a23f-6fde358fca60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:06.644833 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864eb427-a1e4-4f87-a23f-6fde358fca60 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:06.645119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864eb427-a1e4-4f87-a23f-6fde358fca60 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:06.645396 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864eb427-a1e4-4f87-a23f-6fde358fca60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:06.646129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864eb427-a1e4-4f87-a23f-6fde358fca60 None admin] RBAC: Adding query filter params (role.id=3766508ffa094bb5bbec6d9209745261, scope.project.id=a302406c548c43c983625c0d66da47cc, user.id=df18e704834948c4bb480691fa8d0824) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:06.646473 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864eb427-a1e4-4f87-a23f-6fde358fca60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:06.647930 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864eb427-a1e4-4f87-a23f-6fde358fca60 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:06.654427 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 276/536] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:26:06 2022] GET /identity/v3/role_assignments?user.id=df18e704834948c4bb480691fa8d0824&scope.project.id=a302406c548c43c983625c0d66da47cc&role.id=3766508ffa094bb5bbec6d9209745261 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:06.655624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0f1e7-31c0-49f5-96b9-b4d6fa745b88 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:06.655912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0f1e7-31c0-49f5-96b9-b4d6fa745b88 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:06.656205 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0f1e7-31c0-49f5-96b9-b4d6fa745b88 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:06.657631 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 277/537] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:06.662552 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0f1e7-31c0-49f5-96b9-b4d6fa745b88 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:06.674762 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb4f0c-a3ee-42bd-b239-79e91ff21615 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:06.723464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71173ac-e6d6-4e1c-911d-ae9c57e78ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:06.724084 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71173ac-e6d6-4e1c-911d-ae9c57e78ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:06.724399 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71173ac-e6d6-4e1c-911d-ae9c57e78ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:06.724800 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71173ac-e6d6-4e1c-911d-ae9c57e78ac2 None admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:06.725685 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71173ac-e6d6-4e1c-911d-ae9c57e78ac2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:06.726000 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71173ac-e6d6-4e1c-911d-ae9c57e78ac2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:06.727624 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71173ac-e6d6-4e1c-911d-ae9c57e78ac2 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:06.742948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 261/538] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:06.744019 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14683f4-2ba1-48d0-a362-0a761d6fadab None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:06.744404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14683f4-2ba1-48d0-a362-0a761d6fadab None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:06.744693 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14683f4-2ba1-48d0-a362-0a761d6fadab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:06.758870 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:06.767537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-a14683f4-2ba1-48d0-a362-0a761d6fadab None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:06.769152 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a14683f4-2ba1-48d0-a362-0a761d6fadab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:06.769354 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:06.812249 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0f1e7-31c0-49f5-96b9-b4d6fa745b88 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:06.859176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc373bd-2ec9-43b6-9d85-7079b61b1a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:06.859808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc373bd-2ec9-43b6-9d85-7079b61b1a16 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:06.860085 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc373bd-2ec9-43b6-9d85-7079b61b1a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:06.860407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc373bd-2ec9-43b6-9d85-7079b61b1a16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:06.866176 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 262/539] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:06.866176 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14683f4-2ba1-48d0-a362-0a761d6fadab None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:06.879155 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc373bd-2ec9-43b6-9d85-7079b61b1a16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:06.880681 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc373bd-2ec9-43b6-9d85-7079b61b1a16 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:06.902727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-6fc373bd-2ec9-43b6-9d85-7079b61b1a16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:06.902727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:06.902727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:06.902727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:06.902727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:06.902727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:06.902727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:06.902727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:06.902727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:06.902727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:06.902727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:06.902727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:06.902727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:06.902727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:06.902727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:06.903640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:06.903640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:06.903640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:06.903640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:06.903640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:06.903640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:06.903640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:06.903640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:06.903640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:06.903640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:06.903640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:06.903640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:06.903640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:06.903640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:06.903640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:06.903640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:06.903640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:06.904541 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:06.904541 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:06.904541 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:06.904541 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:06.904541 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:06.904541 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:06.904541 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:06.904541 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:06.910291 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 278/540] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:06.911305 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc373bd-2ec9-43b6-9d85-7079b61b1a16 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:07.085108 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14683f4-2ba1-48d0-a362-0a761d6fadab None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:07.087947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc373bd-2ec9-43b6-9d85-7079b61b1a16 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:07.130576 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23a614-8fa7-4e80-ac53-8552087b7acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:07.131834 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23a614-8fa7-4e80-ac53-8552087b7acd None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:07.132347 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23a614-8fa7-4e80-ac53-8552087b7acd None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:07.132826 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23a614-8fa7-4e80-ac53-8552087b7acd None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:07.133709 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23a614-8fa7-4e80-ac53-8552087b7acd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:07.134261 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23a614-8fa7-4e80-ac53-8552087b7acd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:07.135890 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23a614-8fa7-4e80-ac53-8552087b7acd None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:07.138776 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:07.154889 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 279/541] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:07.161027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23a614-8fa7-4e80-ac53-8552087b7acd None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:07.173642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1aafca-5cae-41af-9479-d8cbbfb3a91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:07.174397 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aafca-5cae-41af-9479-d8cbbfb3a91f None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:07.174685 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aafca-5cae-41af-9479-d8cbbfb3a91f None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:07.174954 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aafca-5cae-41af-9479-d8cbbfb3a91f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:07.175694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1aafca-5cae-41af-9479-d8cbbfb3a91f None admin] RBAC: Adding query filter params (role.id=3766508ffa094bb5bbec6d9209745261, scope.project.id=a302406c548c43c983625c0d66da47cc, user.id=ad05a52c8aec4744a41639f2343eb54f) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:07.176013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1aafca-5cae-41af-9479-d8cbbfb3a91f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:07.177503 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1aafca-5cae-41af-9479-d8cbbfb3a91f None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:07.181532 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:07.191470 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 263/542] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:26:06 2022] GET /identity/v3/role_assignments?user.id=ad05a52c8aec4744a41639f2343eb54f&scope.project.id=a302406c548c43c983625c0d66da47cc&role.id=3766508ffa094bb5bbec6d9209745261 => generated 259 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:07.192571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1aafca-5cae-41af-9479-d8cbbfb3a91f None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:07.363066 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1aafca-5cae-41af-9479-d8cbbfb3a91f None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:07.374996 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23a614-8fa7-4e80-ac53-8552087b7acd None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:07.419315 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b6c16-2fef-46a1-9caa-6bfc1a501a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:07.420113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b6c16-2fef-46a1-9caa-6bfc1a501a83 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:07.420648 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b6c16-2fef-46a1-9caa-6bfc1a501a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:07.420877 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b6c16-2fef-46a1-9caa-6bfc1a501a83 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:07.427719 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f0852-11ff-4b7a-b19d-cde11a656e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:07.429228 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f0852-11ff-4b7a-b19d-cde11a656e52 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:07.430057 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f0852-11ff-4b7a-b19d-cde11a656e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:07.430760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f0852-11ff-4b7a-b19d-cde11a656e52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:07.432390 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f0852-11ff-4b7a-b19d-cde11a656e52 None admin] RBAC: Adding query filter params (role.id=3766508ffa094bb5bbec6d9209745261, scope.project.id=a302406c548c43c983625c0d66da47cc, user.id=dfa16ba58c0040f8bdfa5e46f2681395) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:07.433148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f0852-11ff-4b7a-b19d-cde11a656e52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:07.433332 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b6c16-2fef-46a1-9caa-6bfc1a501a83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:07.436315 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f0852-11ff-4b7a-b19d-cde11a656e52 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:07.438992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-5b9b6c16-2fef-46a1-9caa-6bfc1a501a83 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:07.438992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:07.438992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:07.438992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:07.438992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:07.438992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:07.438992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:07.438992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:07.438992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:07.438992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:07.438992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:07.438992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:07.438992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:07.438992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:07.438992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:07.438992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:07.440951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:07.440951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:07.440951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:07.440951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:07.440951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:07.440951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:07.440951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:07.440951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:07.440951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:07.440951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:07.440951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:07.440951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:07.440951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:07.440951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:07.440951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:07.440951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:07.442791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:07.442791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:07.442791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:07.442791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:07.442791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:07.442791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:07.442791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:07.442791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:07.442791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:07.442791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:07.442791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:07.442791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:07.442791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 264/543] 10.222.0.69 () {56 vars in 1102 bytes} [Mon Aug 29 21:26:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:07.444854 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556d644-96e9-43e8-9300-5e655711e5f7 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:07.445307 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556d644-96e9-43e8-9300-5e655711e5f7 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:07.445876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556d644-96e9-43e8-9300-5e655711e5f7 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:07.454385 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 265/544] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:07.454385 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556d644-96e9-43e8-9300-5e655711e5f7 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:07.462911 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 280/545] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:26:07 2022] GET /identity/v3/role_assignments?user.id=dfa16ba58c0040f8bdfa5e46f2681395&scope.project.id=a302406c548c43c983625c0d66da47cc&role.id=3766508ffa094bb5bbec6d9209745261 => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:07.465510 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbfc29-dc5c-44f6-a0b4-183539c00779 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:07.466253 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbfc29-dc5c-44f6-a0b4-183539c00779 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:07.467018 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbfc29-dc5c-44f6-a0b4-183539c00779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:07.501142 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-90fbfc29-dc5c-44f6-a0b4-183539c00779 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:07.503581 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-90fbfc29-dc5c-44f6-a0b4-183539c00779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:07.569017 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:07.621431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:07.648411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 281/546] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:07.677069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556d644-96e9-43e8-9300-5e655711e5f7 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:07.721775 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4dc37-68c5-4f35-b25d-f42e80bef2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:07.722724 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4dc37-68c5-4f35-b25d-f42e80bef2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:07.723031 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4dc37-68c5-4f35-b25d-f42e80bef2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:07.723380 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4dc37-68c5-4f35-b25d-f42e80bef2e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:07.724052 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4dc37-68c5-4f35-b25d-f42e80bef2e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:07.724382 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4dc37-68c5-4f35-b25d-f42e80bef2e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:07.725770 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4dc37-68c5-4f35-b25d-f42e80bef2e6 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:07.736754 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 266/547] 10.222.0.69 () {56 vars in 1103 bytes} [Mon Aug 29 21:26:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:07.742192 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fbfc29-dc5c-44f6-a0b4-183539c00779 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:07.883884 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fbfc29-dc5c-44f6-a0b4-183539c00779 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:07.921754 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e85145-5e04-4085-b105-cd5a54977e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:07.922415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e85145-5e04-4085-b105-cd5a54977e6e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:07.922693 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e85145-5e04-4085-b105-cd5a54977e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:07.922961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e85145-5e04-4085-b105-cd5a54977e6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:07.936647 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e85145-5e04-4085-b105-cd5a54977e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:07.938673 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e85145-5e04-4085-b105-cd5a54977e6e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:07.955489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-04e85145-5e04-4085-b105-cd5a54977e6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:07.955489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:07.955489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:07.955489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:07.955489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:07.955489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:07.955489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:07.955489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:07.955489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:07.955489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:07.955489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:07.955489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:07.955489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:07.955489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:07.955489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:07.955489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:07.956485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:07.956485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:07.956485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:07.956485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:07.956485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:07.956485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:07.956485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:07.956485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:07.956485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:07.956485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:07.956485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:07.956485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:07.956485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:07.956485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:07.956485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:07.956485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:07.956485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:07.957327 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:07.957327 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:07.957327 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:07.957327 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 282/548] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:07.963192 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4dc37-68c5-4f35-b25d-f42e80bef2e6 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:08.003960 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e85145-5e04-4085-b105-cd5a54977e6e None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:08.084209 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:08.148313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e85145-5e04-4085-b105-cd5a54977e6e None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:08.186060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9efa1-4426-4c8c-9432-8b11c1343d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:08.186692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9efa1-4426-4c8c-9432-8b11c1343d71 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:08.186973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9efa1-4426-4c8c-9432-8b11c1343d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:08.187245 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9efa1-4426-4c8c-9432-8b11c1343d71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:08.188601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4dc37-68c5-4f35-b25d-f42e80bef2e6 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:08.198676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9efa1-4426-4c8c-9432-8b11c1343d71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:08.209609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-57c9efa1-4426-4c8c-9432-8b11c1343d71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:08.209609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:08.209609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:08.209609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:08.209609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:08.209609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:08.209609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:08.209609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:08.209609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:08.209609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:08.209609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:08.209609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:08.209609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:08.209609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:08.209609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:08.209609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:08.211119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:08.211119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:08.211119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:08.211119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:08.211119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:08.211119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:08.211119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:08.211119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:08.211119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:08.211119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:08.211119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:08.211119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:08.211119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:08.211119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:08.211119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:08.211119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:08.212144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:08.212144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:08.212144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:08.212144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:08.212144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:08.212144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:08.212144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:08.212144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:08.212144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:08.212144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:08.212144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:08.212144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:08.212144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 283/549] 10.222.0.69 () {56 vars in 1102 bytes} [Mon Aug 29 21:26:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:26:08.216876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9efa1-4426-4c8c-9432-8b11c1343d71 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:08.238607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:08.275443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dba7a2-a99f-4c0f-bb76-0ad352f6fb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:08.276128 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dba7a2-a99f-4c0f-bb76-0ad352f6fb7d None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:08.276489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dba7a2-a99f-4c0f-bb76-0ad352f6fb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:08.276769 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dba7a2-a99f-4c0f-bb76-0ad352f6fb7d None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:08.277425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dba7a2-a99f-4c0f-bb76-0ad352f6fb7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:08.277765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dba7a2-a99f-4c0f-bb76-0ad352f6fb7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:08.279206 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dba7a2-a99f-4c0f-bb76-0ad352f6fb7d None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:08.308586 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 267/550] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:08.312643 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dba7a2-a99f-4c0f-bb76-0ad352f6fb7d None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:08.414875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:08.419348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9efa1-4426-4c8c-9432-8b11c1343d71 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:08.496326 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dba7a2-a99f-4c0f-bb76-0ad352f6fb7d None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:08.504898 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62617889-daa6-481d-95e9-b865d61cbf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:08.505532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62617889-daa6-481d-95e9-b865d61cbf36 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:08.505815 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62617889-daa6-481d-95e9-b865d61cbf36 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:08.506089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62617889-daa6-481d-95e9-b865d61cbf36 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:08.506931 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62617889-daa6-481d-95e9-b865d61cbf36 None admin] RBAC: Adding query filter params (name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:08.507358 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62617889-daa6-481d-95e9-b865d61cbf36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:08.508799 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62617889-daa6-481d-95e9-b865d61cbf36 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:08.535310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b4bfe-ad4d-487e-b276-c40f4a9f4ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:08.535993 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b4bfe-ad4d-487e-b276-c40f4a9f4ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:08.536310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b4bfe-ad4d-487e-b276-c40f4a9f4ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:08.536578 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b4bfe-ad4d-487e-b276-c40f4a9f4ff0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:08.538383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 284/551] 10.222.0.69 () {56 vars in 1103 bytes} [Mon Aug 29 21:26:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:08.549235 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62617889-daa6-481d-95e9-b865d61cbf36 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:08.549525 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b4bfe-ad4d-487e-b276-c40f4a9f4ff0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:08.550984 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b4bfe-ad4d-487e-b276-c40f4a9f4ff0 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:08.573005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-c38b4bfe-ad4d-487e-b276-c40f4a9f4ff0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:26:08.573005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:08.573005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:08.573005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:08.573005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:08.573005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:08.573005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:08.573005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:08.573005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:08.573005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:08.573005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:08.573005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:08.573005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:08.573005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:08.573005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:08.573005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:08.574123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:08.574123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:08.574123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:08.574123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:08.574123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:08.574123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:08.574123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:08.574123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:08.574123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:08.574123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:08.574123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:08.574123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:08.574123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:08.574123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:08.574123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:08.574123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:08.574123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:08.574123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:08.575057 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:08.575057 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:08.575057 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:08.575057 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:08.575057 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:08.575057 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:08.575057 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:08.575057 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:08.575057 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:26:08.575057 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:08.577364 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 268/552] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:26:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:08.583843 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b4bfe-ad4d-487e-b276-c40f4a9f4ff0 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:08.641245 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:08.708758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b4bfe-ad4d-487e-b276-c40f4a9f4ff0 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:08.711119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62617889-daa6-481d-95e9-b865d61cbf36 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:08.755735 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c322e6-4e25-484c-9f50-276114d5641f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:08.756409 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c322e6-4e25-484c-9f50-276114d5641f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:08.756690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c322e6-4e25-484c-9f50-276114d5641f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:08.756959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c322e6-4e25-484c-9f50-276114d5641f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:08.772253 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c322e6-4e25-484c-9f50-276114d5641f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:08.773821 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c322e6-4e25-484c-9f50-276114d5641f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:08.789687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-61c322e6-4e25-484c-9f50-276114d5641f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:08.789687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:08.789687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:08.789687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:08.789687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:08.789687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:08.789687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:08.789687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:08.789687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:08.789687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:08.789687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:08.789687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:08.789687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:08.789687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:08.789687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:08.789687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:08.791317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:08.791317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:08.791317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:08.791317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:08.791317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:08.791317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:08.791317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:08.791317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:08.791317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:08.791317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:08.791317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:08.791317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:08.791317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:08.791317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:08.791317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:08.791317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:08.791317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:08.792238 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:08.792238 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:08.792238 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:08.792238 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 285/553] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:08.794593 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6186a-f002-4353-9970-ad316717593b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:08.795455 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6186a-f002-4353-9970-ad316717593b None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:08.795933 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6186a-f002-4353-9970-ad316717593b None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:08.796448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6186a-f002-4353-9970-ad316717593b None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:08.797125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c322e6-4e25-484c-9f50-276114d5641f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:08.797633 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6186a-f002-4353-9970-ad316717593b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:08.798227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6186a-f002-4353-9970-ad316717593b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:08.799882 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6186a-f002-4353-9970-ad316717593b None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:08.830568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:08.832314 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 269/554] 10.222.0.69 () {56 vars in 1135 bytes} [Mon Aug 29 21:26:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:08.840958 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6186a-f002-4353-9970-ad316717593b None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:08.948573 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c322e6-4e25-484c-9f50-276114d5641f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:08.976899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:08.983261 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6186a-f002-4353-9970-ad316717593b None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:08.991368 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6adc4-bbc8-4e64-b4e7-5e824bf74e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:08.992066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6adc4-bbc8-4e64-b4e7-5e824bf74e1a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:08.992458 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6adc4-bbc8-4e64-b4e7-5e824bf74e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:08.992808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6adc4-bbc8-4e64-b4e7-5e824bf74e1a None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:08.993590 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6adc4-bbc8-4e64-b4e7-5e824bf74e1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:08.993961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6adc4-bbc8-4e64-b4e7-5e824bf74e1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:08.995541 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6adc4-bbc8-4e64-b4e7-5e824bf74e1a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:09.016831 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 286/555] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:09.018671 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a36a64-6332-407d-adbb-154f9245ffb1 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:09.019229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a36a64-6332-407d-adbb-154f9245ffb1 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:09.019810 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a36a64-6332-407d-adbb-154f9245ffb1 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:09.028799 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 287/556] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:09.030121 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a36a64-6332-407d-adbb-154f9245ffb1 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:09.036323 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2a1f8-ad4b-4e65-97cf-1fad1232293c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:09.037043 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2a1f8-ad4b-4e65-97cf-1fad1232293c None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:09.037401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2a1f8-ad4b-4e65-97cf-1fad1232293c None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:09.037672 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2a1f8-ad4b-4e65-97cf-1fad1232293c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:09.111198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2a1f8-ad4b-4e65-97cf-1fad1232293c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:09.112995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2a1f8-ad4b-4e65-97cf-1fad1232293c None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:09.122731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:09.156248 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a36a64-6332-407d-adbb-154f9245ffb1 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:09.198377 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa93f62-2c45-497a-93de-e5a4ec8a7525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:09.199539 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa93f62-2c45-497a-93de-e5a4ec8a7525 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:09.200038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa93f62-2c45-497a-93de-e5a4ec8a7525 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:09.200635 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa93f62-2c45-497a-93de-e5a4ec8a7525 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:09.210570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa93f62-2c45-497a-93de-e5a4ec8a7525 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:09.213045 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa93f62-2c45-497a-93de-e5a4ec8a7525 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:09.217918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:09.226420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 270/557] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:26:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 21:26:09.226420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7231376-5ff6-405d-9cd3-fa9659b1a97f None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:09.226420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7231376-5ff6-405d-9cd3-fa9659b1a97f None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:09.226420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7231376-5ff6-405d-9cd3-fa9659b1a97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:09.236657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-afa93f62-2c45-497a-93de-e5a4ec8a7525 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:26:09.236657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:09.236657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:09.236657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:09.236657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:09.236657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:09.236657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:09.236657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:09.236657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:09.236657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:09.236657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:09.236657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:09.236657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:09.236657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:09.236657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:09.236657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:09.237677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:09.237677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:09.237677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:09.237677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:09.237677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:09.237677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:09.237677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:09.237677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:09.237677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:09.237677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:09.237677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:09.237677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:09.237677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:09.237677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:09.237677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:09.237677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:09.237677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:09.237677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:09.238648 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:09.238648 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:09.238648 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:09.238648 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:09.238648 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:09.238648 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:09.238648 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:09.238648 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:09.238648 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:26:09.238648 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:09.241698 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 288/558] 10.222.0.69 () {56 vars in 1093 bytes} [Mon Aug 29 21:26:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:09.242906 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa93f62-2c45-497a-93de-e5a4ec8a7525 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:09.244673 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-d7231376-5ff6-405d-9cd3-fa9659b1a97f None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:09.245869 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-d7231376-5ff6-405d-9cd3-fa9659b1a97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:09.334610 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 271/559] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:09.334610 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7231376-5ff6-405d-9cd3-fa9659b1a97f None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:09.397200 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa93f62-2c45-497a-93de-e5a4ec8a7525 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:09.471065 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeea36a-ad48-4f06-987a-2a9b71abac57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:09.471711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeea36a-ad48-4f06-987a-2a9b71abac57 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:09.471995 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeea36a-ad48-4f06-987a-2a9b71abac57 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:09.472363 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeea36a-ad48-4f06-987a-2a9b71abac57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:09.477131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:09.495602 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeea36a-ad48-4f06-987a-2a9b71abac57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:09.497006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeea36a-ad48-4f06-987a-2a9b71abac57 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:09.500693 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7231376-5ff6-405d-9cd3-fa9659b1a97f None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:09.526919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-4eeea36a-ad48-4f06-987a-2a9b71abac57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:09.526919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:09.526919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:09.526919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:09.526919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:09.526919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:09.526919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:09.526919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:09.526919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:09.526919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:09.526919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:09.526919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:09.526919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:09.526919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:09.526919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:09.526919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:09.527971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:09.527971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:09.527971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:09.527971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:09.527971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:09.527971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:09.527971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:09.527971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:09.527971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:09.527971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:09.527971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:09.527971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:09.527971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:09.527971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:09.527971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:09.527971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:09.527971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:09.528920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:09.528920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:09.528920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:09.537251 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 289/560] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:09.538181 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeea36a-ad48-4f06-987a-2a9b71abac57 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:09.561498 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:09.573705 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436b0f6-468a-44ed-ad87-fc5e6dd71eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:09.574333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436b0f6-468a-44ed-ad87-fc5e6dd71eeb None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:09.574611 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436b0f6-468a-44ed-ad87-fc5e6dd71eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:09.574879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436b0f6-468a-44ed-ad87-fc5e6dd71eeb None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:09.577134 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436b0f6-468a-44ed-ad87-fc5e6dd71eeb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:09.577444 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436b0f6-468a-44ed-ad87-fc5e6dd71eeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:09.578899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436b0f6-468a-44ed-ad87-fc5e6dd71eeb None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:09.611915 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 272/561] 10.222.0.69 () {56 vars in 1133 bytes} [Mon Aug 29 21:26:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:09.617403 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436b0f6-468a-44ed-ad87-fc5e6dd71eeb None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:09.744357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeea36a-ad48-4f06-987a-2a9b71abac57 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:09.766202 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436b0f6-468a-44ed-ad87-fc5e6dd71eeb None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:09.783116 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686437a4-2d4f-4b62-804a-0cda1577c552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:09.783817 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686437a4-2d4f-4b62-804a-0cda1577c552 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:09.784099 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686437a4-2d4f-4b62-804a-0cda1577c552 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:09.784408 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686437a4-2d4f-4b62-804a-0cda1577c552 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:09.785044 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686437a4-2d4f-4b62-804a-0cda1577c552 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:09.785349 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686437a4-2d4f-4b62-804a-0cda1577c552 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:09.786719 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686437a4-2d4f-4b62-804a-0cda1577c552 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:09.799629 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 290/562] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:09.800508 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686437a4-2d4f-4b62-804a-0cda1577c552 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:09.810853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf66ad7-eafb-4141-9dee-db2d3ca1a4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:09.811494 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf66ad7-eafb-4141-9dee-db2d3ca1a4d8 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:09.812139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf66ad7-eafb-4141-9dee-db2d3ca1a4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:09.812449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf66ad7-eafb-4141-9dee-db2d3ca1a4d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:09.823683 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf66ad7-eafb-4141-9dee-db2d3ca1a4d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:09.825186 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf66ad7-eafb-4141-9dee-db2d3ca1a4d8 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:09.840547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-fbf66ad7-eafb-4141-9dee-db2d3ca1a4d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:09.840547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:09.840547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:09.840547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:09.840547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:09.840547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:09.840547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:09.840547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:09.840547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:09.840547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:09.840547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:09.840547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:09.840547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:09.840547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:09.840547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:09.840547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:09.841607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:09.841607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:09.841607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:09.841607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:09.841607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:09.841607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:09.841607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:09.841607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:09.841607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:09.841607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:09.841607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:09.841607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:09.841607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:09.841607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:09.841607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:09.841607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:09.841607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:09.842503 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:09.842503 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:09.842503 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:09.842503 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 273/563] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:09.842893 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49d320-f84a-4782-8e24-f8a5c9f701eb None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:09.843160 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49d320-f84a-4782-8e24-f8a5c9f701eb None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:09.843404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49d320-f84a-4782-8e24-f8a5c9f701eb None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:09.844678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 274/564] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:09.845701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15b64f-b052-4d70-981a-2f743fbd9414 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:09.845976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15b64f-b052-4d70-981a-2f743fbd9414 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:09.846246 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15b64f-b052-4d70-981a-2f743fbd9414 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:09.847441 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 275/565] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:09.848145 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15b64f-b052-4d70-981a-2f743fbd9414 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:09.855058 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:09.902291 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:09.915648 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686437a4-2d4f-4b62-804a-0cda1577c552 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:09.954008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5995c-1d15-485f-9101-121ebb25c8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:09.954669 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5995c-1d15-485f-9101-121ebb25c8a0 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:09.954913 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5995c-1d15-485f-9101-121ebb25c8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:09.955187 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5995c-1d15-485f-9101-121ebb25c8a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:09.966701 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5995c-1d15-485f-9101-121ebb25c8a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:09.967710 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15b64f-b052-4d70-981a-2f743fbd9414 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:09.971556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-7af5995c-1d15-485f-9101-121ebb25c8a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:09.971556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:09.971556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:09.971556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:09.971556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:09.971556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:09.971556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:09.971556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:09.971556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:09.971556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:09.971556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:09.971556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:09.971556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:09.971556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:09.971556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:09.971556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:09.972705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:09.972705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:09.972705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:09.972705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:09.972705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:09.972705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:09.972705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:09.972705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:09.972705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:09.972705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:09.972705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:09.972705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:09.972705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:09.972705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:09.972705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:09.972705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:09.973691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:09.973691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:09.973691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:09.973691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:09.973691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:09.973691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:09.973691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:09.973691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:09.973691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:09.973691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:09.973691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:09.973691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:09.973691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 291/566] 10.222.0.69 () {56 vars in 1102 bytes} [Mon Aug 29 21:26:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:09.974504 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5995c-1d15-485f-9101-121ebb25c8a0 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:10.004705 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2d40e-0660-4e82-8852-d9489b9bfb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:10.005343 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2d40e-0660-4e82-8852-d9489b9bfb63 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:10.005620 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2d40e-0660-4e82-8852-d9489b9bfb63 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:10.005890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2d40e-0660-4e82-8852-d9489b9bfb63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:10.013721 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2d40e-0660-4e82-8852-d9489b9bfb63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:10.015202 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2d40e-0660-4e82-8852-d9489b9bfb63 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:10.031804 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-edd2d40e-0660-4e82-8852-d9489b9bfb63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:10.031804 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:10.031804 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:10.031804 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:10.031804 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:10.031804 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:10.031804 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:10.031804 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:10.031804 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:10.031804 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:10.031804 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:10.031804 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:10.031804 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:10.031804 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:10.031804 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:10.032876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:10.032876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:10.032876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:10.032876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:10.032876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:10.032876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:10.032876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:10.032876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:10.032876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:10.032876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:10.032876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:10.032876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:10.032876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:10.032876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:10.032876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:10.032876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:10.032876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:10.033802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:10.033802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:10.033802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:10.033802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:10.033802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:10.033802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:10.033802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:10.033802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:10.033802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 276/567] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:10.035664 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa958e-4348-4ae9-9ad2-439ac1dd49fd None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:10.035946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa958e-4348-4ae9-9ad2-439ac1dd49fd None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:10.036241 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa958e-4348-4ae9-9ad2-439ac1dd49fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:10.055094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-95aa958e-4348-4ae9-9ad2-439ac1dd49fd None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:10.056934 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-95aa958e-4348-4ae9-9ad2-439ac1dd49fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:10.087725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5995c-1d15-485f-9101-121ebb25c8a0 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:10.096202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:10.125351 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de669a6a-d5df-4b40-9dc2-4ee72cb2a579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:10.126000 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de669a6a-d5df-4b40-9dc2-4ee72cb2a579 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:10.126292 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de669a6a-d5df-4b40-9dc2-4ee72cb2a579 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:10.126566 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de669a6a-d5df-4b40-9dc2-4ee72cb2a579 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:10.126880 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 277/568] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:10.127223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de669a6a-d5df-4b40-9dc2-4ee72cb2a579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:10.127530 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de669a6a-d5df-4b40-9dc2-4ee72cb2a579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:10.128149 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a385df-fe50-4be8-b586-6cdf8dc2c117 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:10.128570 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a385df-fe50-4be8-b586-6cdf8dc2c117 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:10.128746 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a385df-fe50-4be8-b586-6cdf8dc2c117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:10.129013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de669a6a-d5df-4b40-9dc2-4ee72cb2a579 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:10.152098 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 292/569] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:10.152805 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de669a6a-d5df-4b40-9dc2-4ee72cb2a579 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:10.158354 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-53a385df-fe50-4be8-b586-6cdf8dc2c117 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:10.159555 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-53a385df-fe50-4be8-b586-6cdf8dc2c117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:10.186234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:10.233859 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 278/570] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:10.241167 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a385df-fe50-4be8-b586-6cdf8dc2c117 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:10.272507 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de669a6a-d5df-4b40-9dc2-4ee72cb2a579 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:10.311874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1c682-7385-43e1-8726-487cdd84952c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:10.312558 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1c682-7385-43e1-8726-487cdd84952c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:10.312912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1c682-7385-43e1-8726-487cdd84952c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:10.313262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1c682-7385-43e1-8726-487cdd84952c None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:10.314002 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1c682-7385-43e1-8726-487cdd84952c None admin] RBAC: Adding query filter params (name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:10.314380 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1c682-7385-43e1-8726-487cdd84952c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:10.316031 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1c682-7385-43e1-8726-487cdd84952c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:10.330525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 293/571] 10.222.0.69 () {56 vars in 1103 bytes} [Mon Aug 29 21:26:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:10.330525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1c682-7385-43e1-8726-487cdd84952c None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:10.367779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:10.393601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a385df-fe50-4be8-b586-6cdf8dc2c117 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:10.433314 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcdc62-34ae-4535-8d2a-d4d4b5bc3c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:10.433932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcdc62-34ae-4535-8d2a-d4d4b5bc3c25 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:10.434213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcdc62-34ae-4535-8d2a-d4d4b5bc3c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:10.434485 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcdc62-34ae-4535-8d2a-d4d4b5bc3c25 None admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:10.435195 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dcdc62-34ae-4535-8d2a-d4d4b5bc3c25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:10.435535 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dcdc62-34ae-4535-8d2a-d4d4b5bc3c25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:10.437006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dcdc62-34ae-4535-8d2a-d4d4b5bc3c25 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:10.452596 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 279/572] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:10.453629 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcdc62-34ae-4535-8d2a-d4d4b5bc3c25 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:10.475151 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1c682-7385-43e1-8726-487cdd84952c None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:10.483919 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:10.515986 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c7b79-5fff-474a-b550-f3c94c7f2c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:10.516676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c7b79-5fff-474a-b550-f3c94c7f2c7a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:10.516959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c7b79-5fff-474a-b550-f3c94c7f2c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:10.517233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c7b79-5fff-474a-b550-f3c94c7f2c7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:10.524279 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c7b79-5fff-474a-b550-f3c94c7f2c7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:10.526589 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c7b79-5fff-474a-b550-f3c94c7f2c7a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:10.538189 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-701c7b79-5fff-474a-b550-f3c94c7f2c7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:10.538189 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:10.538189 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:10.538189 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:10.538189 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:10.538189 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:10.538189 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:10.538189 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:10.538189 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:10.538189 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:10.538189 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:10.538189 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:10.538189 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:10.538189 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:10.538189 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:10.539513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:10.539513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:10.539513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:10.539513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:10.539513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:10.539513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:10.539513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:10.539513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:10.539513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:10.539513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:10.539513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:10.539513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:10.539513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:10.539513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:10.539513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:10.539513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:10.539513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:10.540694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:10.540694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:10.540694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:10.540694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:10.540694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:10.540694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:10.540694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:10.540694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:10.540694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 294/573] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:10.540694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c7b79-5fff-474a-b550-f3c94c7f2c7a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:10.569366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcdc62-34ae-4535-8d2a-d4d4b5bc3c25 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:10.607344 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6660f-652e-45d2-bfd7-70ac1358fb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:10.607977 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6660f-652e-45d2-bfd7-70ac1358fb31 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:10.608307 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6660f-652e-45d2-bfd7-70ac1358fb31 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:10.608581 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6660f-652e-45d2-bfd7-70ac1358fb31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:10.619207 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6660f-652e-45d2-bfd7-70ac1358fb31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:10.620697 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6660f-652e-45d2-bfd7-70ac1358fb31 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:10.635576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-b3a6660f-652e-45d2-bfd7-70ac1358fb31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:10.635576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:10.635576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:10.635576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:10.635576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:10.635576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:10.635576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:10.635576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:10.635576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:10.635576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:10.635576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:10.635576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:10.635576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:10.635576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:10.635576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:10.635576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:10.636765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:10.636765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:10.636765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:10.636765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:10.636765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:10.636765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:10.636765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:10.636765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:10.636765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:10.636765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:10.636765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:10.636765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:10.636765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:10.636765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:10.636765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:10.636765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:10.636765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:10.637672 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:10.637672 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:10.637672 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:10.637672 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 280/574] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:10.637672 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6660f-652e-45d2-bfd7-70ac1358fb31 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:10.638361 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:10.652494 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c7b79-5fff-474a-b550-f3c94c7f2c7a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:10.691791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ecec9-7668-4960-94f4-a6e89e34526a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:10.692553 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ecec9-7668-4960-94f4-a6e89e34526a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:10.692810 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ecec9-7668-4960-94f4-a6e89e34526a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:10.693084 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ecec9-7668-4960-94f4-a6e89e34526a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:10.707203 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ecec9-7668-4960-94f4-a6e89e34526a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:10.712415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-558ecec9-7668-4960-94f4-a6e89e34526a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:10.712415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:10.712415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:10.712415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:10.712415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:10.712415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:10.712415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:10.712415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:10.712415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:10.712415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:10.712415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:10.712415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:10.712415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:10.712415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:10.712415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:10.712415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:10.713513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:10.713513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:10.713513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:10.713513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:10.713513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:10.713513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:10.713513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:10.713513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:10.713513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:10.713513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:10.713513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:10.713513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:10.713513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:10.713513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:10.713513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:10.713513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:10.714488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:10.714488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:10.714488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:10.714488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:10.714488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:10.714488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:10.714488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:10.714488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:10.714488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:10.714488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:10.714488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:10.714488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:10.714488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 295/575] 10.222.0.69 () {56 vars in 1102 bytes} [Mon Aug 29 21:26:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:10.714488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ecec9-7668-4960-94f4-a6e89e34526a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:10.720475 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:10.754113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6660f-652e-45d2-bfd7-70ac1358fb31 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:10.789325 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7de2be-6b7c-443b-a433-a535e6647abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:10.790019 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7de2be-6b7c-443b-a433-a535e6647abf None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:10.790202 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7de2be-6b7c-443b-a433-a535e6647abf None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:10.790570 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7de2be-6b7c-443b-a433-a535e6647abf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:10.791307 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7de2be-6b7c-443b-a433-a535e6647abf None admin] RBAC: Adding query filter params (role.id=3766508ffa094bb5bbec6d9209745261, scope.project.id=a302406c548c43c983625c0d66da47cc, user.id=714a2ba019144211931dbe853f1960aa) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:10.791609 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7de2be-6b7c-443b-a433-a535e6647abf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:10.793083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7de2be-6b7c-443b-a433-a535e6647abf None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:10.798724 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 281/576] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:26:10 2022] GET /identity/v3/role_assignments?user.id=714a2ba019144211931dbe853f1960aa&scope.project.id=a302406c548c43c983625c0d66da47cc&role.id=3766508ffa094bb5bbec6d9209745261 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:10.799531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7de2be-6b7c-443b-a433-a535e6647abf None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:10.838519 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ecec9-7668-4960-94f4-a6e89e34526a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:10.887977 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13393506-58b1-4554-8efb-d87bdd4486ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:10.888681 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13393506-58b1-4554-8efb-d87bdd4486ee None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:10.888959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13393506-58b1-4554-8efb-d87bdd4486ee None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:10.889226 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13393506-58b1-4554-8efb-d87bdd4486ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:10.905031 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13393506-58b1-4554-8efb-d87bdd4486ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:10.911043 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-13393506-58b1-4554-8efb-d87bdd4486ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:10.911043 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:10.911043 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:10.911043 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:10.911043 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:10.911043 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:10.911043 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:10.911043 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:10.911043 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:10.911043 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:10.911043 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:10.911043 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:10.911043 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:10.911043 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:10.911043 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:10.911043 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:10.912334 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:10.912334 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:10.912334 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:10.912334 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:10.912334 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:10.912334 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:10.912334 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:10.912334 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:10.912334 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:10.912334 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:10.912334 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:10.912334 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:10.912334 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:10.912334 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:10.912334 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:10.912334 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:10.913183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:10.913183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:10.913183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:10.913183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:10.913183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:10.913183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:10.913183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:10.913183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:10.913183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:10.913183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:10.913183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:10.913183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:10.913183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 296/577] 10.222.0.69 () {56 vars in 1102 bytes} [Mon Aug 29 21:26:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:10.913875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13393506-58b1-4554-8efb-d87bdd4486ee None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:10.929955 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:10.934269 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7de2be-6b7c-443b-a433-a535e6647abf None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:10.972885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed674d-1f46-41e6-98d2-d0b5abd8aa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:10.973501 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed674d-1f46-41e6-98d2-d0b5abd8aa0e None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:10.973782 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed674d-1f46-41e6-98d2-d0b5abd8aa0e None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:10.974057 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed674d-1f46-41e6-98d2-d0b5abd8aa0e None admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:10.974753 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed674d-1f46-41e6-98d2-d0b5abd8aa0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:10.975088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed674d-1f46-41e6-98d2-d0b5abd8aa0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:10.976654 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed674d-1f46-41e6-98d2-d0b5abd8aa0e None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:10.979466 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:10.991318 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 282/578] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:10.992168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed674d-1f46-41e6-98d2-d0b5abd8aa0e None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:11.042061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13393506-58b1-4554-8efb-d87bdd4486ee None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:11.088904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8c198-03ac-488d-81e4-b734b05cdfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:11.089436 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8c198-03ac-488d-81e4-b734b05cdfd4 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:11.089712 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8c198-03ac-488d-81e4-b734b05cdfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:11.089993 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8c198-03ac-488d-81e4-b734b05cdfd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:11.090682 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8c198-03ac-488d-81e4-b734b05cdfd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:11.091119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8c198-03ac-488d-81e4-b734b05cdfd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:11.092396 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8c198-03ac-488d-81e4-b734b05cdfd4 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:11.106626 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 297/579] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:11.107466 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8c198-03ac-488d-81e4-b734b05cdfd4 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:11.135083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed674d-1f46-41e6-98d2-d0b5abd8aa0e None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:11.177144 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8c10e-b3ce-483c-94a7-feb86322e73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:11.177821 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8c10e-b3ce-483c-94a7-feb86322e73c None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:11.178101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8c10e-b3ce-483c-94a7-feb86322e73c None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:11.178544 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8c10e-b3ce-483c-94a7-feb86322e73c None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:11.179134 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8c10e-b3ce-483c-94a7-feb86322e73c None admin] RBAC: Adding query filter params (name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:11.179443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8c10e-b3ce-483c-94a7-feb86322e73c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:11.180870 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8c10e-b3ce-483c-94a7-feb86322e73c None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:11.195375 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 283/580] 10.222.0.69 () {56 vars in 1103 bytes} [Mon Aug 29 21:26:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:11.195375 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8c10e-b3ce-483c-94a7-feb86322e73c None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:11.198358 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:11.240842 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8c198-03ac-488d-81e4-b734b05cdfd4 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:11.274382 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:11.283733 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a041b9-577a-4aba-bb85-1760b5a2c5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:11.284894 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a041b9-577a-4aba-bb85-1760b5a2c5d4 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:11.285285 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a041b9-577a-4aba-bb85-1760b5a2c5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:11.285768 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a041b9-577a-4aba-bb85-1760b5a2c5d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:11.286455 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a041b9-577a-4aba-bb85-1760b5a2c5d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:11.286900 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a041b9-577a-4aba-bb85-1760b5a2c5d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:11.288798 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a041b9-577a-4aba-bb85-1760b5a2c5d4 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:11.298310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 298/581] 10.222.0.69 () {56 vars in 1103 bytes} [Mon Aug 29 21:26:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:11.299372 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a041b9-577a-4aba-bb85-1760b5a2c5d4 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:11.326748 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8c10e-b3ce-483c-94a7-feb86322e73c None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:11.368708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae7f50-004f-4eff-ad38-5802d26f8c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:11.369500 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae7f50-004f-4eff-ad38-5802d26f8c30 None admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:11.369911 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae7f50-004f-4eff-ad38-5802d26f8c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:11.370190 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae7f50-004f-4eff-ad38-5802d26f8c30 None admin] PATH_INFO: `/v3/projects/a302406c548c43c983625c0d66da47cc/users/96c35c544cae4ad187f1a1be723e0d21/roles/3766508ffa094bb5bbec6d9209745261` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:11.386898 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae7f50-004f-4eff-ad38-5802d26f8c30 None admin] RBAC: Authorizing `identity:create_grant(project_id=a302406c548c43c983625c0d66da47cc, user_id=96c35c544cae4ad187f1a1be723e0d21, role_id=3766508ffa094bb5bbec6d9209745261)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:11.388468 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae7f50-004f-4eff-ad38-5802d26f8c30 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:11.405881 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 284/582] 10.222.0.69 () {58 vars in 1439 bytes} [Mon Aug 29 21:26:11 2022] PUT /identity/v3/projects/a302406c548c43c983625c0d66da47cc/users/96c35c544cae4ad187f1a1be723e0d21/roles/3766508ffa094bb5bbec6d9209745261 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:26:11.406415 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae7f50-004f-4eff-ad38-5802d26f8c30 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:11.435905 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a041b9-577a-4aba-bb85-1760b5a2c5d4 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:11.481183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:11.491428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7088e-0f91-4a3a-ac4b-75df989b9409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:11.492731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7088e-0f91-4a3a-ac4b-75df989b9409 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:11.493230 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7088e-0f91-4a3a-ac4b-75df989b9409 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:11.494479 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7088e-0f91-4a3a-ac4b-75df989b9409 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:11.506898 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7088e-0f91-4a3a-ac4b-75df989b9409 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:11.508366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7088e-0f91-4a3a-ac4b-75df989b9409 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:11.521868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-faf7088e-0f91-4a3a-ac4b-75df989b9409 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 21:26:11.521868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:11.521868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:11.521868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:11.521868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:11.521868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:11.521868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:11.521868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:11.521868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:11.521868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:11.521868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:11.521868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:11.521868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:11.521868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:11.521868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:11.521868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:11.522949 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:11.522949 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:11.522949 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:11.522949 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:11.522949 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:11.522949 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:11.522949 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:11.522949 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:11.522949 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:11.522949 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:11.522949 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:11.522949 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:11.522949 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:11.522949 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:11.522949 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:11.522949 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:11.522949 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:11.522949 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:11.523935 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:11.523935 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:11.523935 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:11.523935 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:11.523935 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:11.523935 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:11.523935 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:11.523935 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:11.523935 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 21:26:11.523935 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:11.523935 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 299/583] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:26:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:11.524619 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7088e-0f91-4a3a-ac4b-75df989b9409 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:11.547163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae7f50-004f-4eff-ad38-5802d26f8c30 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:11.560615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:11.596127 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276bf0f-cd02-47fa-b6cb-511b69ac9ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:11.597144 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276bf0f-cd02-47fa-b6cb-511b69ac9ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:11.597614 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276bf0f-cd02-47fa-b6cb-511b69ac9ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:11.598081 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276bf0f-cd02-47fa-b6cb-511b69ac9ee8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:11.611442 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276bf0f-cd02-47fa-b6cb-511b69ac9ee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:11.613229 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276bf0f-cd02-47fa-b6cb-511b69ac9ee8 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:11.629712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-a276bf0f-cd02-47fa-b6cb-511b69ac9ee8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:11.629712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:11.629712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:11.629712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:11.629712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:11.629712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:11.629712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:11.629712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:11.629712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:11.629712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:11.629712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:11.629712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:11.629712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:11.629712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:11.629712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:11.629712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:11.630725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:11.630725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:11.630725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:11.630725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:11.630725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:11.630725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:11.630725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:11.630725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:11.630725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:11.630725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:11.630725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:11.630725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:11.630725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:11.630725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:11.630725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:11.630725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:11.630725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:11.631670 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:11.631670 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:11.631670 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:11.631670 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 285/584] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:11.632068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276bf0f-cd02-47fa-b6cb-511b69ac9ee8 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:11.646731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7088e-0f91-4a3a-ac4b-75df989b9409 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:11.689934 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe502b-d5fa-4670-afcb-78ba43ec6548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:11.690820 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe502b-d5fa-4670-afcb-78ba43ec6548 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:11.691329 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe502b-d5fa-4670-afcb-78ba43ec6548 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:11.691758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe502b-d5fa-4670-afcb-78ba43ec6548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:11.709436 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe502b-d5fa-4670-afcb-78ba43ec6548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:11.710922 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe502b-d5fa-4670-afcb-78ba43ec6548 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:11.731709 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-edbe502b-d5fa-4670-afcb-78ba43ec6548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:11.731709 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:11.731709 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:11.731709 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:11.731709 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:11.731709 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:11.731709 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:11.731709 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:11.731709 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:11.731709 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:11.731709 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:11.731709 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:11.731709 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:11.731709 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:11.731709 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:11.731709 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:11.732738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:11.732738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:11.732738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:11.732738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:11.732738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:11.732738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:11.732738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:11.732738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:11.732738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:11.732738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:11.732738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:11.732738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:11.732738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:11.732738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:11.732738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:11.732738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:11.732738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:11.733644 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:11.733644 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:11.733644 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:11.733823 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 300/585] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:11.734548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe502b-d5fa-4670-afcb-78ba43ec6548 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:11.794866 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:11.801241 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276bf0f-cd02-47fa-b6cb-511b69ac9ee8 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:11.839096 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ec775-945b-4727-aada-dc0c7d954623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:11.839541 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ec775-945b-4727-aada-dc0c7d954623 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:11.839826 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ec775-945b-4727-aada-dc0c7d954623 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:11.840102 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ec775-945b-4727-aada-dc0c7d954623 None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:11.840988 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ec775-945b-4727-aada-dc0c7d954623 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:11.841283 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ec775-945b-4727-aada-dc0c7d954623 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:11.842720 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ec775-945b-4727-aada-dc0c7d954623 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:11.861717 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 286/586] 10.222.0.69 () {56 vars in 1137 bytes} [Mon Aug 29 21:26:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:11.862595 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ec775-945b-4727-aada-dc0c7d954623 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:11.867348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe502b-d5fa-4670-afcb-78ba43ec6548 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:11.885074 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:11.911650 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff7718-f123-4dac-aac8-45d01a8a0eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:11.912804 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff7718-f123-4dac-aac8-45d01a8a0eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:11.913311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff7718-f123-4dac-aac8-45d01a8a0eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:11.913905 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff7718-f123-4dac-aac8-45d01a8a0eb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:11.914791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff7718-f123-4dac-aac8-45d01a8a0eb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:11.915847 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff7718-f123-4dac-aac8-45d01a8a0eb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:11.917672 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff7718-f123-4dac-aac8-45d01a8a0eb3 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:11.937140 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 301/587] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:11.938471 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff7718-f123-4dac-aac8-45d01a8a0eb3 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:11.979886 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ec775-945b-4727-aada-dc0c7d954623 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:12.016822 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8536f03-03ca-49cc-9222-75f85eb8ae78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:12.018099 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8536f03-03ca-49cc-9222-75f85eb8ae78 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:12.018099 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8536f03-03ca-49cc-9222-75f85eb8ae78 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:12.018099 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8536f03-03ca-49cc-9222-75f85eb8ae78 None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:12.018727 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8536f03-03ca-49cc-9222-75f85eb8ae78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:12.019032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8536f03-03ca-49cc-9222-75f85eb8ae78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:12.020553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8536f03-03ca-49cc-9222-75f85eb8ae78 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:12.033583 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 287/588] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:12.034592 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8536f03-03ca-49cc-9222-75f85eb8ae78 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:12.067744 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff7718-f123-4dac-aac8-45d01a8a0eb3 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:12.070331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:12.119180 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a647ca-881b-4504-bfd3-4b096cb3d0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:12.120231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a647ca-881b-4504-bfd3-4b096cb3d0ed None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:12.120711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a647ca-881b-4504-bfd3-4b096cb3d0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:12.121221 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a647ca-881b-4504-bfd3-4b096cb3d0ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:12.139730 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a647ca-881b-4504-bfd3-4b096cb3d0ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:12.142677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a647ca-881b-4504-bfd3-4b096cb3d0ed None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:12.156595 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:12.169273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-65a647ca-881b-4504-bfd3-4b096cb3d0ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:12.169273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:12.169273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:12.169273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:12.169273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:12.169273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:12.169273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:12.169273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:12.169273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:12.169273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:12.169273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:12.169273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:12.169273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:12.169273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:12.169273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:12.169273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:12.170289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:12.170289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:12.170289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:12.170289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:12.170289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:12.170289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:12.170289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:12.170289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:12.170289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:12.170289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:12.170289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:12.170289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:12.170289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:12.170289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:12.170289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:12.170289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:12.170289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:12.171180 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:12.171180 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:12.171180 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:12.173333 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 302/589] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:12.174700 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a647ca-881b-4504-bfd3-4b096cb3d0ed None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:12.188587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8536f03-03ca-49cc-9222-75f85eb8ae78 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:12.229984 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91280b25-332f-4505-a796-26a918621d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:12.231290 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91280b25-332f-4505-a796-26a918621d23 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:12.231290 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91280b25-332f-4505-a796-26a918621d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:12.231719 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91280b25-332f-4505-a796-26a918621d23 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:12.239789 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91280b25-332f-4505-a796-26a918621d23 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:12.241539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91280b25-332f-4505-a796-26a918621d23 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:12.254539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-91280b25-332f-4505-a796-26a918621d23 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 21:26:12.254539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:12.254539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:12.254539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:12.254539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:12.254539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:12.254539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:12.254539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:12.254539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:12.254539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:12.254539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:12.254539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:12.254539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:12.254539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:12.254539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:12.254539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:12.255827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:12.255827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:12.255827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:12.255827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:12.255827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:12.255827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:12.255827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:12.255827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:12.255827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:12.255827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:12.255827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:12.255827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:12.255827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:12.255827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:12.255827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:12.255827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:12.255827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:12.255827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:12.257067 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:12.257067 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:12.257067 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:12.257067 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:12.257067 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:12.257067 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:12.257067 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:12.257067 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:12.257067 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 21:26:12.257067 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:12.262559 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 288/590] 10.222.0.69 () {56 vars in 1102 bytes} [Mon Aug 29 21:26:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:12.262559 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91280b25-332f-4505-a796-26a918621d23 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:12.309032 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a647ca-881b-4504-bfd3-4b096cb3d0ed None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:12.347352 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e8cb7-74d2-4738-bd14-1c53fd1ce7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:12.348401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e8cb7-74d2-4738-bd14-1c53fd1ce7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:12.348904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e8cb7-74d2-4738-bd14-1c53fd1ce7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:12.349333 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e8cb7-74d2-4738-bd14-1c53fd1ce7a5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:12.359734 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e8cb7-74d2-4738-bd14-1c53fd1ce7a5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:12.361569 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e8cb7-74d2-4738-bd14-1c53fd1ce7a5 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:12.369373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91280b25-332f-4505-a796-26a918621d23 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:12.375183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-041e8cb7-74d2-4738-bd14-1c53fd1ce7a5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 21:26:12.375183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:12.375183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:12.375183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:12.375183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:12.375183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:12.375183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:12.375183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:12.375183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:12.375183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:12.375183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:12.375183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:12.375183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:12.375183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:12.375183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:12.375183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:12.376382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:12.376382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:12.376382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:12.376382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:12.376382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:12.376382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:12.376382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:12.376382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:12.376382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:12.376382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:12.376382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:12.376382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:12.376382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:12.376382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:12.376382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:12.376382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:12.376382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:12.376382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:12.377475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:12.377475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:12.377475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:12.377475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:12.377475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:12.377475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:12.377475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:12.377475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:12.377475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 21:26:12.377475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:12.379837 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 303/591] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:26:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:12.381082 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e8cb7-74d2-4738-bd14-1c53fd1ce7a5 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:12.399417 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:12.407085 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140f5ed-441f-4c37-8ce4-fcb63c0b2049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:12.407781 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140f5ed-441f-4c37-8ce4-fcb63c0b2049 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:12.408060 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140f5ed-441f-4c37-8ce4-fcb63c0b2049 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:12.408357 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140f5ed-441f-4c37-8ce4-fcb63c0b2049 None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:12.409012 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140f5ed-441f-4c37-8ce4-fcb63c0b2049 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:12.409315 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140f5ed-441f-4c37-8ce4-fcb63c0b2049 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:12.410781 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140f5ed-441f-4c37-8ce4-fcb63c0b2049 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:12.419042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:12.425054 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 289/592] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:12.431817 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140f5ed-441f-4c37-8ce4-fcb63c0b2049 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:12.506806 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e8cb7-74d2-4738-bd14-1c53fd1ce7a5 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:12.538055 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140f5ed-441f-4c37-8ce4-fcb63c0b2049 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:12.546103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6df7e4-8476-485f-bf6e-047723cdd5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:12.546969 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6df7e4-8476-485f-bf6e-047723cdd5cb None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:12.547407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6df7e4-8476-485f-bf6e-047723cdd5cb None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:12.547945 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6df7e4-8476-485f-bf6e-047723cdd5cb None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:12.548931 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6df7e4-8476-485f-bf6e-047723cdd5cb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:12.549444 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6df7e4-8476-485f-bf6e-047723cdd5cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:12.551207 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6df7e4-8476-485f-bf6e-047723cdd5cb None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:12.576874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 304/593] 10.222.0.69 () {56 vars in 1139 bytes} [Mon Aug 29 21:26:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:12.578252 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6df7e4-8476-485f-bf6e-047723cdd5cb None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:12.579434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332b660-bf22-4caa-bf30-73b525197e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:12.580070 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332b660-bf22-4caa-bf30-73b525197e41 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:12.580376 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332b660-bf22-4caa-bf30-73b525197e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:12.580655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332b660-bf22-4caa-bf30-73b525197e41 None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:12.581450 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332b660-bf22-4caa-bf30-73b525197e41 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:12.581764 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332b660-bf22-4caa-bf30-73b525197e41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:12.583213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332b660-bf22-4caa-bf30-73b525197e41 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:12.604058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 290/594] 10.222.0.69 () {56 vars in 1137 bytes} [Mon Aug 29 21:26:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:12.605063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332b660-bf22-4caa-bf30-73b525197e41 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:12.662939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:12.667151 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:12.701872 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6df7e4-8476-485f-bf6e-047723cdd5cb None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:12.717675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332b660-bf22-4caa-bf30-73b525197e41 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:12.743168 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4264e-7038-4a00-a61e-48ac9975c103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:12.744317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4264e-7038-4a00-a61e-48ac9975c103 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:12.744823 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4264e-7038-4a00-a61e-48ac9975c103 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:12.745513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4264e-7038-4a00-a61e-48ac9975c103 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:12.753658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4264e-7038-4a00-a61e-48ac9975c103 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:12.755917 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4264e-7038-4a00-a61e-48ac9975c103 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:12.756985 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4054c-9d54-422e-aa7a-8316072ed8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:12.757642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4054c-9d54-422e-aa7a-8316072ed8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:12.757924 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4054c-9d54-422e-aa7a-8316072ed8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:12.758198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4054c-9d54-422e-aa7a-8316072ed8e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:12.769931 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4054c-9d54-422e-aa7a-8316072ed8e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:12.771023 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-38c4264e-7038-4a00-a61e-48ac9975c103 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:12.771023 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:12.771023 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:12.771023 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:12.771023 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:12.771023 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:12.771023 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:12.771023 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:12.771023 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:12.771023 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:12.771023 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:12.771023 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:12.771023 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:12.771023 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:12.771023 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:12.771920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:12.771920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:12.771920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:12.771920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:12.771920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:12.771920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:12.771920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:12.771920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:12.771920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:12.771920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:12.771920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:12.771920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:12.771920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:12.771920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:12.771920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:12.771920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:12.771920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:12.772873 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:12.772873 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:12.772873 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:12.772873 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:12.772873 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:12.772873 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:12.772873 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:12.772873 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:12.773315 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4054c-9d54-422e-aa7a-8316072ed8e8 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:12.780742 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 305/595] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:12.782088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4264e-7038-4a00-a61e-48ac9975c103 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:12.788463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-edd4054c-9d54-422e-aa7a-8316072ed8e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:12.788463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:12.788463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:12.788463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:12.788463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:12.788463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:12.788463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:12.788463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:12.788463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:12.788463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:12.788463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:12.788463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:12.788463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:12.788463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:12.788463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:12.788463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:12.789632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:12.789632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:12.789632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:12.789632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:12.789632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:12.789632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:12.789632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:12.789632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:12.789632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:12.789632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:12.789632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:12.789632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:12.789632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:12.789632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:12.789632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:12.789632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:12.789632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:12.791249 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:12.791249 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:12.791249 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:12.794352 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 291/596] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:12.795226 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4054c-9d54-422e-aa7a-8316072ed8e8 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:12.908106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4264e-7038-4a00-a61e-48ac9975c103 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:12.908695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4054c-9d54-422e-aa7a-8316072ed8e8 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:12.918585 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:12.943766 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:12.947462 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548c6ae-8daf-4755-ab7a-2f60211f5427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:12.948109 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548c6ae-8daf-4755-ab7a-2f60211f5427 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:12.948491 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548c6ae-8daf-4755-ab7a-2f60211f5427 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:12.948866 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548c6ae-8daf-4755-ab7a-2f60211f5427 None admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:12.949560 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548c6ae-8daf-4755-ab7a-2f60211f5427 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:12.949865 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548c6ae-8daf-4755-ab7a-2f60211f5427 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:12.949964 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a6580-7ad9-4509-9965-04ddd8332ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:12.950562 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a6580-7ad9-4509-9965-04ddd8332ffb None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:12.950848 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a6580-7ad9-4509-9965-04ddd8332ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:12.951119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a6580-7ad9-4509-9965-04ddd8332ffb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:12.951299 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548c6ae-8daf-4755-ab7a-2f60211f5427 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:12.964245 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a6580-7ad9-4509-9965-04ddd8332ffb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:12.964767 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 292/597] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:12.965648 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548c6ae-8daf-4755-ab7a-2f60211f5427 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:12.969581 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a6580-7ad9-4509-9965-04ddd8332ffb None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:12.988008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-fe3a6580-7ad9-4509-9965-04ddd8332ffb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:12.988008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:12.988008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:12.988008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:12.988008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:12.988008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:12.988008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:12.988008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:12.988008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:12.988008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:12.988008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:12.988008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:12.988008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:12.988008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:12.988008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:12.988008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:12.989075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:12.989075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:12.989075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:12.989075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:12.989075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:12.989075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:12.989075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:12.989075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:12.989075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:12.989075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:12.989075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:12.989075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:12.989075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:12.989075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:12.989075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:12.989075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:12.989075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:12.989983 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:12.989983 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:12.989983 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:12.989983 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 306/598] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:12.991034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89849dbf-3417-4969-953b-15de6cb35645 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:12.991034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89849dbf-3417-4969-953b-15de6cb35645 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:12.991034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89849dbf-3417-4969-953b-15de6cb35645 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:12.996583 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 307/599] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:12.996583 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89849dbf-3417-4969-953b-15de6cb35645 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:13.090395 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548c6ae-8daf-4755-ab7a-2f60211f5427 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:13.108275 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89849dbf-3417-4969-953b-15de6cb35645 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:13.131571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380daa9-5186-4fc2-a8ab-3fcdf69f8c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:13.132271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380daa9-5186-4fc2-a8ab-3fcdf69f8c72 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:13.132492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380daa9-5186-4fc2-a8ab-3fcdf69f8c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:13.132819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380daa9-5186-4fc2-a8ab-3fcdf69f8c72 None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:13.133469 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380daa9-5186-4fc2-a8ab-3fcdf69f8c72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:13.133774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380daa9-5186-4fc2-a8ab-3fcdf69f8c72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:13.135306 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380daa9-5186-4fc2-a8ab-3fcdf69f8c72 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:13.145851 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efd314-2c33-4f75-9a17-430e2502264b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:13.146517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efd314-2c33-4f75-9a17-430e2502264b None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:13.146800 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efd314-2c33-4f75-9a17-430e2502264b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:13.147068 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efd314-2c33-4f75-9a17-430e2502264b None admin] PATH_INFO: `/v3/projects/a302406c548c43c983625c0d66da47cc/users/df18e704834948c4bb480691fa8d0824/roles/3766508ffa094bb5bbec6d9209745261` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:13.152915 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 293/600] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:13.152915 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380daa9-5186-4fc2-a8ab-3fcdf69f8c72 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:13.174873 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efd314-2c33-4f75-9a17-430e2502264b None admin] RBAC: Authorizing `identity:create_grant(project_id=a302406c548c43c983625c0d66da47cc, user_id=df18e704834948c4bb480691fa8d0824, role_id=3766508ffa094bb5bbec6d9209745261)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:13.176432 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efd314-2c33-4f75-9a17-430e2502264b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:13.187359 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:13.191108 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 308/601] 10.222.0.69 () {58 vars in 1439 bytes} [Mon Aug 29 21:26:12 2022] PUT /identity/v3/projects/a302406c548c43c983625c0d66da47cc/users/df18e704834948c4bb480691fa8d0824/roles/3766508ffa094bb5bbec6d9209745261 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:26:13.192353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23f1ad-1d8b-4528-9c66-3d67aa3adb34 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:13.192588 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23f1ad-1d8b-4528-9c66-3d67aa3adb34 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:13.192856 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23f1ad-1d8b-4528-9c66-3d67aa3adb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:13.212805 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-cf23f1ad-1d8b-4528-9c66-3d67aa3adb34 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:13.214492 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cf23f1ad-1d8b-4528-9c66-3d67aa3adb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:13.296579 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:13.299627 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380daa9-5186-4fc2-a8ab-3fcdf69f8c72 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:13.300206 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 309/602] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:13.302805 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23f1ad-1d8b-4528-9c66-3d67aa3adb34 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:13.359901 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314cf1f-9826-41a2-b920-36fafacf970b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:13.360128 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314cf1f-9826-41a2-b920-36fafacf970b None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:13.360349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314cf1f-9826-41a2-b920-36fafacf970b None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:13.360606 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314cf1f-9826-41a2-b920-36fafacf970b None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:13.361267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314cf1f-9826-41a2-b920-36fafacf970b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:13.361569 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314cf1f-9826-41a2-b920-36fafacf970b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:13.363191 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314cf1f-9826-41a2-b920-36fafacf970b None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:13.379812 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 294/603] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:13.386863 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314cf1f-9826-41a2-b920-36fafacf970b None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:13.468713 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23f1ad-1d8b-4528-9c66-3d67aa3adb34 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:13.510300 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:13.521426 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bcdb4c-7445-409d-a4ed-105db906a07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:13.522080 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcdb4c-7445-409d-a4ed-105db906a07b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:13.522672 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcdb4c-7445-409d-a4ed-105db906a07b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:13.522837 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcdb4c-7445-409d-a4ed-105db906a07b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:13.535495 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314cf1f-9826-41a2-b920-36fafacf970b None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:13.536157 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bcdb4c-7445-409d-a4ed-105db906a07b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:13.537898 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bcdb4c-7445-409d-a4ed-105db906a07b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:13.555560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-d3bcdb4c-7445-409d-a4ed-105db906a07b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:13.555560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:13.555560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:13.555560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:13.555560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:13.555560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:13.555560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:13.555560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:13.555560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:13.555560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:13.555560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:13.555560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:13.555560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:13.555560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:13.555560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:13.557936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:13.557936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:13.557936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:13.557936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:13.557936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:13.557936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:13.557936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:13.557936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:13.557936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:13.557936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:13.557936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:13.557936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:13.557936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:13.557936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:13.557936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:13.557936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:13.557936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:13.559650 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:13.559650 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:13.559650 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:13.559650 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:13.559650 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:13.559650 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:13.559650 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:13.559650 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:13.559650 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 310/604] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:13.559650 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472b4e6-55a7-4bcd-a722-ef15b24dc17c None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:13.559650 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472b4e6-55a7-4bcd-a722-ef15b24dc17c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:13.564328 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472b4e6-55a7-4bcd-a722-ef15b24dc17c None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:13.565756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 311/605] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:13.572418 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472b4e6-55a7-4bcd-a722-ef15b24dc17c None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:13.597887 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038954b4-70d5-4c71-a646-ccc86464c858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:13.598675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038954b4-70d5-4c71-a646-ccc86464c858 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:13.598952 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038954b4-70d5-4c71-a646-ccc86464c858 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:13.599122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038954b4-70d5-4c71-a646-ccc86464c858 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:13.607999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:13.610706 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038954b4-70d5-4c71-a646-ccc86464c858 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:13.612372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038954b4-70d5-4c71-a646-ccc86464c858 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:13.625750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-038954b4-70d5-4c71-a646-ccc86464c858 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:13.625750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:13.625750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:13.625750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:13.625750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:13.625750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:13.625750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:13.625750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:13.625750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:13.625750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:13.625750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:13.625750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:13.625750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:13.625750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:13.625750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:13.626853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:13.626853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:13.626853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:13.626853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:13.626853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:13.626853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:13.626853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:13.626853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:13.626853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:13.626853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:13.626853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:13.626853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:13.626853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:13.626853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:13.626853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:13.626853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:13.626853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:13.628474 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:13.628474 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:13.628474 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:13.628474 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:13.628474 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:13.628474 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:13.628474 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:13.628474 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:13.632063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 295/606] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:26:13.633646 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e875ba-0549-4249-a7f5-1e52bf9fedd3 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:13.633762 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e875ba-0549-4249-a7f5-1e52bf9fedd3 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:13.635038 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e875ba-0549-4249-a7f5-1e52bf9fedd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:13.658732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-80e875ba-0549-4249-a7f5-1e52bf9fedd3 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:13.660401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-80e875ba-0549-4249-a7f5-1e52bf9fedd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:13.715705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472b4e6-55a7-4bcd-a722-ef15b24dc17c None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:13.755172 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 296/607] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:13.756217 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e875ba-0549-4249-a7f5-1e52bf9fedd3 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:13.774129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4553d-45a1-4fe4-bb57-23ea6d65a204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:13.775765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4553d-45a1-4fe4-bb57-23ea6d65a204 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:13.776671 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4553d-45a1-4fe4-bb57-23ea6d65a204 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:13.777165 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4553d-45a1-4fe4-bb57-23ea6d65a204 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:13.778335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc4553d-45a1-4fe4-bb57-23ea6d65a204 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:13.778900 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc4553d-45a1-4fe4-bb57-23ea6d65a204 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:13.781055 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc4553d-45a1-4fe4-bb57-23ea6d65a204 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:13.802446 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 312/608] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:13.807989 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4553d-45a1-4fe4-bb57-23ea6d65a204 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:13.859827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:13.886714 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e875ba-0549-4249-a7f5-1e52bf9fedd3 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:13.927080 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:13.929680 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef5abb-f276-42a3-b5e1-a6f0039dbe20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:13.930598 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef5abb-f276-42a3-b5e1-a6f0039dbe20 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:13.931057 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef5abb-f276-42a3-b5e1-a6f0039dbe20 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:13.931433 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef5abb-f276-42a3-b5e1-a6f0039dbe20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:13.946017 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef5abb-f276-42a3-b5e1-a6f0039dbe20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:13.948808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4553d-45a1-4fe4-bb57-23ea6d65a204 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:13.952394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-2bef5abb-f276-42a3-b5e1-a6f0039dbe20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:13.952394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:13.952394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:13.952394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:13.952394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:13.952394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:13.952394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:13.952394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:13.952394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:13.952394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:13.952394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:13.952394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:13.952394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:13.952394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:13.952394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:13.952394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:13.953364 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:13.953364 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:13.953364 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:13.953364 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:13.953364 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:13.953364 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:13.953364 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:13.953364 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:13.953364 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:13.953364 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:13.953364 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:13.953364 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:13.953364 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:13.953364 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:13.953364 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:13.953364 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:13.954377 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:13.954377 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:13.954377 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:13.954377 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:13.954377 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:13.954377 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:13.954377 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:13.954377 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:13.954377 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:13.954377 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:13.954377 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:13.954377 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:13.959434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 297/609] 10.222.0.69 () {56 vars in 1102 bytes} [Mon Aug 29 21:26:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:13.961024 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef5abb-f276-42a3-b5e1-a6f0039dbe20 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:13.994019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77485ae-4e3f-4dc1-9914-67cb7f7e1c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:13.994999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77485ae-4e3f-4dc1-9914-67cb7f7e1c4e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:13.995543 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77485ae-4e3f-4dc1-9914-67cb7f7e1c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:13.996129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77485ae-4e3f-4dc1-9914-67cb7f7e1c4e None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:13.997187 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77485ae-4e3f-4dc1-9914-67cb7f7e1c4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:13.997708 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77485ae-4e3f-4dc1-9914-67cb7f7e1c4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:13.999562 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77485ae-4e3f-4dc1-9914-67cb7f7e1c4e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:14.015927 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 313/610] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:14.017230 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77485ae-4e3f-4dc1-9914-67cb7f7e1c4e None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:14.117267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef5abb-f276-42a3-b5e1-a6f0039dbe20 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:14.149952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77485ae-4e3f-4dc1-9914-67cb7f7e1c4e None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:14.168869 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a8248-2874-42c7-9307-b9575f290aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:14.170102 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a8248-2874-42c7-9307-b9575f290aae None admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:14.170533 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a8248-2874-42c7-9307-b9575f290aae None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:14.171025 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a8248-2874-42c7-9307-b9575f290aae None admin] PATH_INFO: `/v3/projects/a302406c548c43c983625c0d66da47cc/users/dfa16ba58c0040f8bdfa5e46f2681395/roles/3766508ffa094bb5bbec6d9209745261` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:14.189065 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:14.195160 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3dee2-cad0-468a-9368-99da3f9e0a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:14.195789 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3dee2-cad0-468a-9368-99da3f9e0a48 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:14.196505 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3dee2-cad0-468a-9368-99da3f9e0a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:14.196812 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3dee2-cad0-468a-9368-99da3f9e0a48 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:14.197482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3dee2-cad0-468a-9368-99da3f9e0a48 None admin] RBAC: Adding query filter params (name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:14.197789 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3dee2-cad0-468a-9368-99da3f9e0a48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:14.199445 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3dee2-cad0-468a-9368-99da3f9e0a48 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:14.201458 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a8248-2874-42c7-9307-b9575f290aae None admin] RBAC: Authorizing `identity:create_grant(project_id=a302406c548c43c983625c0d66da47cc, user_id=dfa16ba58c0040f8bdfa5e46f2681395, role_id=3766508ffa094bb5bbec6d9209745261)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:14.205169 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a8248-2874-42c7-9307-b9575f290aae None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:14.214577 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 314/611] 10.222.0.69 () {56 vars in 1103 bytes} [Mon Aug 29 21:26:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:14.214577 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3dee2-cad0-468a-9368-99da3f9e0a48 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:14.223750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:14.230636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 298/612] 10.222.0.69 () {58 vars in 1439 bytes} [Mon Aug 29 21:26:13 2022] PUT /identity/v3/projects/a302406c548c43c983625c0d66da47cc/users/dfa16ba58c0040f8bdfa5e46f2681395/roles/3766508ffa094bb5bbec6d9209745261 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:26:14.232396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a8248-2874-42c7-9307-b9575f290aae None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:14.344504 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3dee2-cad0-468a-9368-99da3f9e0a48 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:14.391335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac3b96-1753-4576-84e1-3da75ca03fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:14.392027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac3b96-1753-4576-84e1-3da75ca03fbc None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:14.392340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac3b96-1753-4576-84e1-3da75ca03fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:14.392614 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac3b96-1753-4576-84e1-3da75ca03fbc None admin] PATH_INFO: `/v3/projects/a302406c548c43c983625c0d66da47cc/users/ad05a52c8aec4744a41639f2343eb54f/roles/3766508ffa094bb5bbec6d9209745261` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:14.416152 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac3b96-1753-4576-84e1-3da75ca03fbc None admin] RBAC: Authorizing `identity:create_grant(project_id=a302406c548c43c983625c0d66da47cc, user_id=ad05a52c8aec4744a41639f2343eb54f, role_id=3766508ffa094bb5bbec6d9209745261)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:14.417693 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac3b96-1753-4576-84e1-3da75ca03fbc None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:14.432243 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a8248-2874-42c7-9307-b9575f290aae None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:14.437872 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 315/613] 10.222.0.69 () {58 vars in 1439 bytes} [Mon Aug 29 21:26:14 2022] PUT /identity/v3/projects/a302406c548c43c983625c0d66da47cc/users/ad05a52c8aec4744a41639f2343eb54f/roles/3766508ffa094bb5bbec6d9209745261 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:26:14.438763 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac3b96-1753-4576-84e1-3da75ca03fbc None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:14.492579 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a95ea-aeb0-4afa-ba05-a3bdce8c1f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:14.493689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a95ea-aeb0-4afa-ba05-a3bdce8c1f6e None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:14.494382 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a95ea-aeb0-4afa-ba05-a3bdce8c1f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:14.496362 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a95ea-aeb0-4afa-ba05-a3bdce8c1f6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:14.515412 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a95ea-aeb0-4afa-ba05-a3bdce8c1f6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:14.521420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-9b3a95ea-aeb0-4afa-ba05-a3bdce8c1f6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:14.521420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:14.521420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:14.521420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:14.521420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:14.521420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:14.521420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:14.521420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:14.521420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:14.521420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:14.521420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:14.521420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:14.521420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:14.521420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:14.521420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:14.521420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:14.522460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:14.522460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:14.522460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:14.522460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:14.522460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:14.522460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:14.522460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:14.522460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:14.522460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:14.522460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:14.522460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:14.522460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:14.522460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:14.522460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:14.522460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:14.522460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:14.523372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:14.523372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:14.523372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:14.523372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:14.523372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:14.523372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:14.523372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:14.523372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:14.523372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:14.523372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:14.523372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:14.523372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:14.526559 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 299/614] 10.222.0.69 () {56 vars in 1102 bytes} [Mon Aug 29 21:26:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:14.533072 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a95ea-aeb0-4afa-ba05-a3bdce8c1f6e None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:14.575484 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:14.604133 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:14.669856 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a95ea-aeb0-4afa-ba05-a3bdce8c1f6e None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:14.715157 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac3b96-1753-4576-84e1-3da75ca03fbc None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:14.722649 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6ae2d-ddfb-439f-b0e0-b7738d18e63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:14.723650 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6ae2d-ddfb-439f-b0e0-b7738d18e63e None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:14.724138 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6ae2d-ddfb-439f-b0e0-b7738d18e63e None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:14.724813 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6ae2d-ddfb-439f-b0e0-b7738d18e63e None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:14.725816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6ae2d-ddfb-439f-b0e0-b7738d18e63e None admin] RBAC: Adding query filter params (name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:14.726327 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6ae2d-ddfb-439f-b0e0-b7738d18e63e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:14.728079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6ae2d-ddfb-439f-b0e0-b7738d18e63e None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:14.740152 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 300/615] 10.222.0.69 () {56 vars in 1103 bytes} [Mon Aug 29 21:26:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:14.745283 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6ae2d-ddfb-439f-b0e0-b7738d18e63e None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:14.790979 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a70029-58a8-4cb3-80a8-3d1072cc0606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:14.791464 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a70029-58a8-4cb3-80a8-3d1072cc0606 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:14.791751 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a70029-58a8-4cb3-80a8-3d1072cc0606 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:14.791908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a70029-58a8-4cb3-80a8-3d1072cc0606 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:14.806907 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a70029-58a8-4cb3-80a8-3d1072cc0606 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:14.808444 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a70029-58a8-4cb3-80a8-3d1072cc0606 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:14.826908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-47a70029-58a8-4cb3-80a8-3d1072cc0606 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:14.826908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:14.826908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:14.826908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:14.826908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:14.826908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:14.826908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:14.826908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:14.826908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:14.826908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:14.826908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:14.826908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:14.826908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:14.826908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:14.826908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:14.826908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:14.832651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:14.832651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:14.832651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:14.832651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:14.832651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:14.832651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:14.832651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:14.832651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:14.832651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:14.832651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:14.832651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:14.832651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:14.832651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:14.832651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:14.832651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:14.832651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:14.832651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:14.833692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:14.833692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:14.833692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:14.833692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 316/616] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:14.841281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a70029-58a8-4cb3-80a8-3d1072cc0606 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:14.952807 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6ae2d-ddfb-439f-b0e0-b7738d18e63e None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:14.967016 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:15.018310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841e7f0-f70e-41fd-9c51-ba3a3c8f6f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:15.019340 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841e7f0-f70e-41fd-9c51-ba3a3c8f6f02 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:15.019844 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841e7f0-f70e-41fd-9c51-ba3a3c8f6f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:15.020361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841e7f0-f70e-41fd-9c51-ba3a3c8f6f02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:15.047369 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841e7f0-f70e-41fd-9c51-ba3a3c8f6f02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:15.049223 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841e7f0-f70e-41fd-9c51-ba3a3c8f6f02 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:15.079978 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-b841e7f0-f70e-41fd-9c51-ba3a3c8f6f02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:15.079978 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:15.079978 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:15.079978 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:15.079978 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:15.079978 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:15.079978 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:15.079978 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:15.079978 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:15.079978 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:15.079978 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:15.079978 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:15.079978 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:15.079978 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:15.079978 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:15.079978 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:15.081874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:15.081874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:15.081874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:15.081874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:15.081874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:15.081874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:15.081874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:15.081874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:15.081874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:15.081874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:15.081874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:15.081874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:15.081874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:15.081874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:15.081874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:15.081874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:15.081874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:15.083357 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:15.083357 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:15.083357 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:15.092262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 301/617] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:26:15.092262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841e7f0-f70e-41fd-9c51-ba3a3c8f6f02 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:15.107475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a70029-58a8-4cb3-80a8-3d1072cc0606 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:15.137338 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:15.197601 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdd9bf-0519-49ba-9f65-4be04bba9fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:15.198281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdd9bf-0519-49ba-9f65-4be04bba9fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:15.198588 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdd9bf-0519-49ba-9f65-4be04bba9fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:15.198866 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdd9bf-0519-49ba-9f65-4be04bba9fb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:15.199538 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cdd9bf-0519-49ba-9f65-4be04bba9fb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:15.199842 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cdd9bf-0519-49ba-9f65-4be04bba9fb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:15.201249 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cdd9bf-0519-49ba-9f65-4be04bba9fb3 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:15.222572 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841e7f0-f70e-41fd-9c51-ba3a3c8f6f02 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:15.236867 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 317/618] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:15.244458 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdd9bf-0519-49ba-9f65-4be04bba9fb3 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:15.301544 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369330db-6773-41cf-b89d-4a76fdc3a7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:15.303004 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369330db-6773-41cf-b89d-4a76fdc3a7c7 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:15.304198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369330db-6773-41cf-b89d-4a76fdc3a7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:15.306691 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369330db-6773-41cf-b89d-4a76fdc3a7c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:15.307698 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369330db-6773-41cf-b89d-4a76fdc3a7c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:15.309137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369330db-6773-41cf-b89d-4a76fdc3a7c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:15.310931 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369330db-6773-41cf-b89d-4a76fdc3a7c7 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:15.331283 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 302/619] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:15.347246 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369330db-6773-41cf-b89d-4a76fdc3a7c7 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:15.400411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:15.486465 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdd9bf-0519-49ba-9f65-4be04bba9fb3 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:15.565898 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6efda-c545-407c-a56e-9cec908b3e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:15.566700 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6efda-c545-407c-a56e-9cec908b3e9a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:15.567181 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6efda-c545-407c-a56e-9cec908b3e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:15.567669 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6efda-c545-407c-a56e-9cec908b3e9a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:15.576779 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369330db-6773-41cf-b89d-4a76fdc3a7c7 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:15.581921 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6efda-c545-407c-a56e-9cec908b3e9a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:15.583947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6efda-c545-407c-a56e-9cec908b3e9a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:15.599159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-23b6efda-c545-407c-a56e-9cec908b3e9a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:26:15.599159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:15.599159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:15.599159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:15.599159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:15.599159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:15.599159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:15.599159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:15.599159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:15.599159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:15.599159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:15.599159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:15.599159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:15.599159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:15.599159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:15.599159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:15.601013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:15.601013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:15.601013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:15.601013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:15.601013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:15.601013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:15.601013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:15.601013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:15.601013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:15.601013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:15.601013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:15.601013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:15.601013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:15.601013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:15.601013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:15.601013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:15.601013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:15.601013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:15.602022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:15.602022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:15.602022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:15.602022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:15.602022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:15.602022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:15.602022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:15.602022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:15.602022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:26:15.602022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:15.602022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 318/620] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:26:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:15.603486 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30783a3-e760-4067-a926-59c8172f5da5 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:15.603723 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30783a3-e760-4067-a926-59c8172f5da5 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:15.604062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30783a3-e760-4067-a926-59c8172f5da5 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:15.605579 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 319/621] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:15.611514 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30783a3-e760-4067-a926-59c8172f5da5 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:15.644208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f25fd8-71df-414e-ae89-226d510967eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:15.645534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f25fd8-71df-414e-ae89-226d510967eb None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:15.646124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f25fd8-71df-414e-ae89-226d510967eb None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:15.647314 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f25fd8-71df-414e-ae89-226d510967eb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:15.651888 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:15.660820 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f25fd8-71df-414e-ae89-226d510967eb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:15.662634 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f25fd8-71df-414e-ae89-226d510967eb None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:15.682587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-96f25fd8-71df-414e-ae89-226d510967eb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:26:15.682587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:15.682587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:15.682587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:15.682587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:15.682587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:15.682587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:15.682587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:15.682587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:15.682587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:15.682587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:15.682587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:15.682587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:15.682587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:15.682587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:15.682587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:15.683904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:15.683904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:15.683904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:15.683904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:15.683904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:15.683904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:15.683904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:15.683904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:15.683904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:15.683904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:15.683904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:15.683904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:15.683904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:15.683904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:15.683904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:15.683904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:15.683904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:15.683904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:15.684923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:15.684923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:15.684923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:15.684923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:15.684923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:15.684923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:15.684923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:15.684923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:15.684923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:26:15.684923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:15.696316 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 303/622] 10.222.0.69 () {56 vars in 1093 bytes} [Mon Aug 29 21:26:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:26:15.696316 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f2703-c36a-41b0-a339-d3661a06c8ad None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:15.696316 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f2703-c36a-41b0-a339-d3661a06c8ad None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:15.696316 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f2703-c36a-41b0-a339-d3661a06c8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:15.721405 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-056f2703-c36a-41b0-a339-d3661a06c8ad None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:15.722635 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-056f2703-c36a-41b0-a339-d3661a06c8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:15.778329 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30783a3-e760-4067-a926-59c8172f5da5 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:15.812217 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 304/623] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:15.812217 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f2703-c36a-41b0-a339-d3661a06c8ad None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:15.849655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:15.855272 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693b8d9-5869-41ba-bc4a-db06037f6981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:15.856818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693b8d9-5869-41ba-bc4a-db06037f6981 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:15.858412 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693b8d9-5869-41ba-bc4a-db06037f6981 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:15.860460 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693b8d9-5869-41ba-bc4a-db06037f6981 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:15.861598 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693b8d9-5869-41ba-bc4a-db06037f6981 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:15.862951 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693b8d9-5869-41ba-bc4a-db06037f6981 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:15.865138 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693b8d9-5869-41ba-bc4a-db06037f6981 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:15.924609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 320/624] 10.222.0.69 () {56 vars in 1135 bytes} [Mon Aug 29 21:26:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:15.931724 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693b8d9-5869-41ba-bc4a-db06037f6981 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:16.007621 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f2703-c36a-41b0-a339-d3661a06c8ad None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:16.087090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e45ef-f819-42b9-adb7-ce53201aa804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:16.088292 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e45ef-f819-42b9-adb7-ce53201aa804 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:16.088616 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e45ef-f819-42b9-adb7-ce53201aa804 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:16.088894 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e45ef-f819-42b9-adb7-ce53201aa804 None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:16.089641 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e45ef-f819-42b9-adb7-ce53201aa804 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:16.089946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e45ef-f819-42b9-adb7-ce53201aa804 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:16.091525 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e45ef-f819-42b9-adb7-ce53201aa804 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:16.115929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:16.125579 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 305/625] 10.222.0.69 () {56 vars in 1133 bytes} [Mon Aug 29 21:26:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:16.138047 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e45ef-f819-42b9-adb7-ce53201aa804 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:16.159349 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693b8d9-5869-41ba-bc4a-db06037f6981 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:16.219603 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f5c2a-ea15-4860-81e7-f9f87ac0e753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:16.220983 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f5c2a-ea15-4860-81e7-f9f87ac0e753 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:16.221264 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f5c2a-ea15-4860-81e7-f9f87ac0e753 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:16.221535 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f5c2a-ea15-4860-81e7-f9f87ac0e753 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:16.240049 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f5c2a-ea15-4860-81e7-f9f87ac0e753 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:16.243555 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f5c2a-ea15-4860-81e7-f9f87ac0e753 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:16.266618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-dc3f5c2a-ea15-4860-81e7-f9f87ac0e753 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:16.266618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:16.266618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:16.266618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:16.266618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:16.266618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:16.266618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:16.266618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:16.266618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:16.266618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:16.266618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:16.266618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:16.266618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:16.266618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:16.266618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:16.266618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:16.267777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:16.267777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:16.267777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:16.267777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:16.267777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:16.267777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:16.267777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:16.267777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:16.267777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:16.267777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:16.267777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:16.267777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:16.267777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:16.267777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:16.267777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:16.267777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:16.267777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:16.269576 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:16.269576 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:16.269576 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:16.269576 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 321/626] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:16.274508 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f5c2a-ea15-4860-81e7-f9f87ac0e753 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:16.288268 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:16.337317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e45ef-f819-42b9-adb7-ce53201aa804 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:16.388451 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93753a04-5b06-44ce-af6b-ee04f0c8dc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:16.389068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93753a04-5b06-44ce-af6b-ee04f0c8dc29 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:16.389351 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93753a04-5b06-44ce-af6b-ee04f0c8dc29 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:16.391125 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93753a04-5b06-44ce-af6b-ee04f0c8dc29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:16.428609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f5c2a-ea15-4860-81e7-f9f87ac0e753 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:16.473933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6cf8e-8aab-4e1c-b118-537e517cac78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:16.474500 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6cf8e-8aab-4e1c-b118-537e517cac78 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:16.474786 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6cf8e-8aab-4e1c-b118-537e517cac78 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:16.475204 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6cf8e-8aab-4e1c-b118-537e517cac78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:16.484436 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:16.490317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93753a04-5b06-44ce-af6b-ee04f0c8dc29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:16.490711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6cf8e-8aab-4e1c-b118-537e517cac78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:16.492407 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93753a04-5b06-44ce-af6b-ee04f0c8dc29 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:16.497920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-a4c6cf8e-8aab-4e1c-b118-537e517cac78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:16.497920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:16.497920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:16.497920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:16.497920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:16.497920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:16.497920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:16.497920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:16.497920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:16.497920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:16.497920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:16.497920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:16.497920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:16.497920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:16.497920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:16.497920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:16.498895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:16.498895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:16.498895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:16.498895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:16.498895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:16.498895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:16.498895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:16.498895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:16.498895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:16.498895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:16.498895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:16.498895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:16.498895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:16.498895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:16.498895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:16.498895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:16.500287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:16.500287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:16.500287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:16.500287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:16.500287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:16.500287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:16.500287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:16.500287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:16.500287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:16.500287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:16.500287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:16.500287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:16.500287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 322/627] 10.222.0.69 () {56 vars in 1102 bytes} [Mon Aug 29 21:26:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:16.501230 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6cf8e-8aab-4e1c-b118-537e517cac78 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:16.588532 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:16.634806 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 306/628] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:26:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:16.635660 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93753a04-5b06-44ce-af6b-ee04f0c8dc29 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:16.649152 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6cf8e-8aab-4e1c-b118-537e517cac78 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:16.695827 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b9795-c2ff-44bd-ad66-a6cd769e43d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:16.697499 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b9795-c2ff-44bd-ad66-a6cd769e43d5 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:16.697968 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b9795-c2ff-44bd-ad66-a6cd769e43d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:16.698435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b9795-c2ff-44bd-ad66-a6cd769e43d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:16.699694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b9795-c2ff-44bd-ad66-a6cd769e43d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:16.700172 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b9795-c2ff-44bd-ad66-a6cd769e43d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:16.701746 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b9795-c2ff-44bd-ad66-a6cd769e43d5 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:16.720908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 323/629] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:16.723365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e95d8c-8fdf-4290-a182-e0dfb092bf8a None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:16.723812 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e95d8c-8fdf-4290-a182-e0dfb092bf8a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:16.724248 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e95d8c-8fdf-4290-a182-e0dfb092bf8a None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:16.726091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 324/630] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:16.727175 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e95d8c-8fdf-4290-a182-e0dfb092bf8a None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:16.759834 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93753a04-5b06-44ce-af6b-ee04f0c8dc29 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:16.806620 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79131a2-fe9e-4619-96c2-3e5fb5c8e4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:16.807843 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79131a2-fe9e-4619-96c2-3e5fb5c8e4ca None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:16.808301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79131a2-fe9e-4619-96c2-3e5fb5c8e4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:16.808701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79131a2-fe9e-4619-96c2-3e5fb5c8e4ca None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:16.809638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79131a2-fe9e-4619-96c2-3e5fb5c8e4ca None admin] RBAC: Adding query filter params (name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:16.810160 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79131a2-fe9e-4619-96c2-3e5fb5c8e4ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:16.811643 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:16.812166 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79131a2-fe9e-4619-96c2-3e5fb5c8e4ca None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:16.824669 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 307/631] 10.222.0.69 () {56 vars in 1103 bytes} [Mon Aug 29 21:26:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:16.825537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79131a2-fe9e-4619-96c2-3e5fb5c8e4ca None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:16.867032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:16.869824 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e95d8c-8fdf-4290-a182-e0dfb092bf8a None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:16.907270 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7600b-6184-4309-bb69-f3c03661961e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:16.907906 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7600b-6184-4309-bb69-f3c03661961e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:16.908291 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7600b-6184-4309-bb69-f3c03661961e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:16.908493 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7600b-6184-4309-bb69-f3c03661961e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:16.926339 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7600b-6184-4309-bb69-f3c03661961e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:16.927845 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7600b-6184-4309-bb69-f3c03661961e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:16.943933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-5bf7600b-6184-4309-bb69-f3c03661961e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:16.943933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:16.943933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:16.943933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:16.943933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:16.943933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:16.943933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:16.943933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:16.943933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:16.943933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:16.943933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:16.943933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:16.943933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:16.943933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:16.943933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:16.943933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:16.945270 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:16.945270 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:16.945270 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:16.945270 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:16.945270 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:16.945270 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:16.945270 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:16.945270 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:16.945270 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:16.945270 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:16.945270 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:16.945270 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:16.945270 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:16.945270 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:16.945270 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:16.945270 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:16.945270 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:16.946293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:16.946293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:16.946293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:16.946293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 325/632] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:16.946793 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8523d12-d27d-4c9b-b47d-dc00c785a4a2 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:16.947076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8523d12-d27d-4c9b-b47d-dc00c785a4a2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:16.947351 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8523d12-d27d-4c9b-b47d-dc00c785a4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:16.952397 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79131a2-fe9e-4619-96c2-3e5fb5c8e4ca None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:16.967029 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d8523d12-d27d-4c9b-b47d-dc00c785a4a2 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:16.968365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d8523d12-d27d-4c9b-b47d-dc00c785a4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:16.997830 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc49d0-9e56-4b98-bc3d-7793e8bd7914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:16.998462 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc49d0-9e56-4b98-bc3d-7793e8bd7914 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:16.998738 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc49d0-9e56-4b98-bc3d-7793e8bd7914 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:16.999011 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc49d0-9e56-4b98-bc3d-7793e8bd7914 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:17.006087 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc49d0-9e56-4b98-bc3d-7793e8bd7914 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:17.007515 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc49d0-9e56-4b98-bc3d-7793e8bd7914 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:17.019626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-2abc49d0-9e56-4b98-bc3d-7793e8bd7914 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:17.019626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:17.019626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:17.019626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:17.019626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:17.019626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:17.019626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:17.019626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:17.019626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:17.019626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:17.019626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:17.019626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:17.019626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:17.019626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:17.019626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:17.021522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:17.021522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:17.021522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:17.021522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:17.021522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:17.021522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:17.021522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:17.021522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:17.021522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:17.021522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:17.021522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:17.021522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:17.021522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:17.021522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:17.021522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:17.021522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:17.021522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:17.022585 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:17.022585 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:17.022585 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:17.022585 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:17.022585 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:17.022585 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:17.022585 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:17.022585 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:17.022585 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 308/633] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:17.022585 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc49d0-9e56-4b98-bc3d-7793e8bd7914 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:17.047069 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 326/634] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:17.048880 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e1ea8-d072-42c6-946e-5fd392e84442 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:17.049316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e1ea8-d072-42c6-946e-5fd392e84442 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:17.049743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e1ea8-d072-42c6-946e-5fd392e84442 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:17.055171 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 327/635] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:17.055171 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e1ea8-d072-42c6-946e-5fd392e84442 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:17.118900 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:17.139871 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:17.156952 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc49d0-9e56-4b98-bc3d-7793e8bd7914 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:17.198423 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e1ea8-d072-42c6-946e-5fd392e84442 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:17.203813 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55196243-059c-48c6-b498-aa1029e285e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:17.204550 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55196243-059c-48c6-b498-aa1029e285e7 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:17.204782 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55196243-059c-48c6-b498-aa1029e285e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:17.205052 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55196243-059c-48c6-b498-aa1029e285e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:17.217808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55196243-059c-48c6-b498-aa1029e285e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:17.219277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55196243-059c-48c6-b498-aa1029e285e7 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:17.243366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-55196243-059c-48c6-b498-aa1029e285e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:17.243366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:17.243366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:17.243366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:17.243366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:17.243366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:17.243366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:17.243366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:17.243366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:17.243366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:17.243366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:17.243366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:17.243366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:17.243366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:17.243366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:17.243366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:17.245014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:17.245014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:17.245014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:17.245014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:17.245014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:17.245014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:17.245014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:17.245014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:17.245014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:17.245014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:17.245014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:17.245014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:17.245014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:17.245014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:17.245014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:17.245014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:17.245014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:17.246528 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:17.246528 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:17.246528 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:17.246528 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 309/636] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:17.248309 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55196243-059c-48c6-b498-aa1029e285e7 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:17.262714 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0931237-d9ce-479f-abfb-34b7d790e74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:17.263816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0931237-d9ce-479f-abfb-34b7d790e74e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:17.264166 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0931237-d9ce-479f-abfb-34b7d790e74e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:17.264610 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0931237-d9ce-479f-abfb-34b7d790e74e None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:17.265159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0931237-d9ce-479f-abfb-34b7d790e74e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:17.265464 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0931237-d9ce-479f-abfb-34b7d790e74e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:17.267713 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0931237-d9ce-479f-abfb-34b7d790e74e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:17.287047 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 328/637] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:17.287047 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cb87c-30db-495e-8915-a1da52d47c9f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:17.287047 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cb87c-30db-495e-8915-a1da52d47c9f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:17.287047 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cb87c-30db-495e-8915-a1da52d47c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:17.304502 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-759cb87c-30db-495e-8915-a1da52d47c9f None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:17.305737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-759cb87c-30db-495e-8915-a1da52d47c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:17.374070 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55196243-059c-48c6-b498-aa1029e285e7 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:17.380364 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 329/638] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:17.381242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cb87c-30db-495e-8915-a1da52d47c9f None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:17.417523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870190a-f31a-472c-964a-65c2793e1e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:17.418262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870190a-f31a-472c-964a-65c2793e1e00 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:17.418566 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870190a-f31a-472c-964a-65c2793e1e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:17.418871 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870190a-f31a-472c-964a-65c2793e1e00 None admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:17.419659 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870190a-f31a-472c-964a-65c2793e1e00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:17.419906 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:17.420029 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870190a-f31a-472c-964a-65c2793e1e00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:17.421935 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870190a-f31a-472c-964a-65c2793e1e00 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:17.446324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 310/639] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:17.446324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870190a-f31a-472c-964a-65c2793e1e00 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:17.451027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:17.527087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cb87c-30db-495e-8915-a1da52d47c9f None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:17.564841 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8cd5b-ae98-4c9c-b9b1-121775e97bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:17.565460 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8cd5b-ae98-4c9c-b9b1-121775e97bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:17.565745 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8cd5b-ae98-4c9c-b9b1-121775e97bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:17.566024 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8cd5b-ae98-4c9c-b9b1-121775e97bb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:17.566669 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8cd5b-ae98-4c9c-b9b1-121775e97bb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:17.566969 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8cd5b-ae98-4c9c-b9b1-121775e97bb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:17.568441 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8cd5b-ae98-4c9c-b9b1-121775e97bb2 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:17.569161 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870190a-f31a-472c-964a-65c2793e1e00 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:17.585220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 330/640] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:17.585220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8cd5b-ae98-4c9c-b9b1-121775e97bb2 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:17.618676 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac7373-1e86-4a0b-8e29-e8502658bf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:17.619360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac7373-1e86-4a0b-8e29-e8502658bf93 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:17.619640 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac7373-1e86-4a0b-8e29-e8502658bf93 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:17.619920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac7373-1e86-4a0b-8e29-e8502658bf93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:17.627349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac7373-1e86-4a0b-8e29-e8502658bf93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:17.629244 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac7373-1e86-4a0b-8e29-e8502658bf93 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:17.641137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-89ac7373-1e86-4a0b-8e29-e8502658bf93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:17.641137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:17.641137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:17.641137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:17.641137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:17.641137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:17.641137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:17.641137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:17.641137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:17.641137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:17.641137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:17.641137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:17.641137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:17.641137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:17.641137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:17.642101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:17.642101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:17.642101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:17.642101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:17.642101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:17.642101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:17.642101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:17.642101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:17.642101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:17.642101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:17.642101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:17.642101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:17.642101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:17.642101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:17.642101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:17.642101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:17.642101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:17.642995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:17.642995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:17.642995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:17.642995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:17.642995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:17.642995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:17.642995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:17.642995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:17.642995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 311/641] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:17.642995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac7373-1e86-4a0b-8e29-e8502658bf93 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:17.694708 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:17.705103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8cd5b-ae98-4c9c-b9b1-121775e97bb2 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:17.716792 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:17.742678 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a12449-b845-46e3-bf4c-0aacdb7c8aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:17.743324 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a12449-b845-46e3-bf4c-0aacdb7c8aab None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:17.743626 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a12449-b845-46e3-bf4c-0aacdb7c8aab None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:17.743907 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a12449-b845-46e3-bf4c-0aacdb7c8aab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:17.755426 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a12449-b845-46e3-bf4c-0aacdb7c8aab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:17.756233 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac7373-1e86-4a0b-8e29-e8502658bf93 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:17.761391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-02a12449-b845-46e3-bf4c-0aacdb7c8aab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:17.761391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:17.761391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:17.761391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:17.761391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:17.761391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:17.761391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:17.761391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:17.761391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:17.761391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:17.761391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:17.761391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:17.761391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:17.761391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:17.761391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:17.761391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:17.762451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:17.762451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:17.762451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:17.762451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:17.762451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:17.762451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:17.762451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:17.762451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:17.762451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:17.762451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:17.762451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:17.762451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:17.762451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:17.762451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:17.762451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:17.762451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:17.763313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:17.763313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:17.763313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:17.763313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:17.763313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:17.763313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:17.763313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:17.763313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:17.763313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:17.763313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:17.763313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:17.763313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:17.763313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 331/642] 10.222.0.69 () {56 vars in 1102 bytes} [Mon Aug 29 21:26:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:17.763313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a12449-b845-46e3-bf4c-0aacdb7c8aab None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:17.792917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a91f0-a1c1-4990-95f5-9bc171609eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:17.793576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a91f0-a1c1-4990-95f5-9bc171609eda None admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:17.793851 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a91f0-a1c1-4990-95f5-9bc171609eda None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:17.794122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a91f0-a1c1-4990-95f5-9bc171609eda None admin] PATH_INFO: `/v3/projects/a302406c548c43c983625c0d66da47cc/users/714a2ba019144211931dbe853f1960aa/roles/3766508ffa094bb5bbec6d9209745261` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:17.809806 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a91f0-a1c1-4990-95f5-9bc171609eda None admin] RBAC: Authorizing `identity:create_grant(project_id=a302406c548c43c983625c0d66da47cc, user_id=714a2ba019144211931dbe853f1960aa, role_id=3766508ffa094bb5bbec6d9209745261)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:17.811313 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a91f0-a1c1-4990-95f5-9bc171609eda None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:17.825772 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 312/643] 10.222.0.69 () {58 vars in 1439 bytes} [Mon Aug 29 21:26:17 2022] PUT /identity/v3/projects/a302406c548c43c983625c0d66da47cc/users/714a2ba019144211931dbe853f1960aa/roles/3766508ffa094bb5bbec6d9209745261 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:26:17.826606 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a91f0-a1c1-4990-95f5-9bc171609eda None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:17.887991 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a12449-b845-46e3-bf4c-0aacdb7c8aab None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:17.930506 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c83fb-d7ff-4388-8813-b51463e54672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:17.931900 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c83fb-d7ff-4388-8813-b51463e54672 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:17.932354 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c83fb-d7ff-4388-8813-b51463e54672 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:17.932762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c83fb-d7ff-4388-8813-b51463e54672 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:17.945876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c83fb-d7ff-4388-8813-b51463e54672 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:17.947468 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c83fb-d7ff-4388-8813-b51463e54672 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:17.960353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-8a1c83fb-d7ff-4388-8813-b51463e54672 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 21:26:17.960353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:17.960353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:17.960353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:17.960353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:17.960353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:17.960353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:17.960353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:17.960353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:17.960353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:17.960353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:17.960353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:17.960353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:17.960353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:17.960353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:17.960353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:17.961609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:17.961609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:17.961609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:17.961609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:17.961609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:17.961609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:17.961609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:17.961609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:17.961609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:17.961609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:17.961609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:17.961609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:17.961609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:17.961609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:17.961609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:17.961609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:17.961609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:17.961609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:17.962941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:17.962941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:17.962941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:17.962941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:17.962941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:17.962941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:17.962941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:17.962941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:17.962941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 21:26:17.962941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:17.966452 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 332/644] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:26:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:17.967407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c83fb-d7ff-4388-8813-b51463e54672 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:17.971250 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a91f0-a1c1-4990-95f5-9bc171609eda None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:17.985599 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:17.991972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:18.022814 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24a3f6-adc8-450a-a0c5-ce59efcbfeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:18.024475 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24a3f6-adc8-450a-a0c5-ce59efcbfeff None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:18.025128 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24a3f6-adc8-450a-a0c5-ce59efcbfeff None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:18.025657 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24a3f6-adc8-450a-a0c5-ce59efcbfeff None admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:18.026521 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24a3f6-adc8-450a-a0c5-ce59efcbfeff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:18.027127 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24a3f6-adc8-450a-a0c5-ce59efcbfeff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:18.029448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24a3f6-adc8-450a-a0c5-ce59efcbfeff None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:18.046452 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 313/645] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:18.047690 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24a3f6-adc8-450a-a0c5-ce59efcbfeff None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:18.090892 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c83fb-d7ff-4388-8813-b51463e54672 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:18.131582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3c04f-fd88-49bb-88bf-2d1284a08a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:18.132455 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3c04f-fd88-49bb-88bf-2d1284a08a80 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:18.132737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3c04f-fd88-49bb-88bf-2d1284a08a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:18.133171 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3c04f-fd88-49bb-88bf-2d1284a08a80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:18.146569 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3c04f-fd88-49bb-88bf-2d1284a08a80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:18.152750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-39e3c04f-fd88-49bb-88bf-2d1284a08a80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:18.152750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:18.152750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:18.152750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:18.152750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:18.152750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:18.152750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:18.152750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:18.152750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:18.152750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:18.152750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:18.152750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:18.152750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:18.152750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:18.152750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:18.152750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:18.153835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:18.153835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:18.153835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:18.153835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:18.153835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:18.153835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:18.153835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:18.153835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:18.153835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:18.153835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:18.153835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:18.153835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:18.153835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:18.153835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:18.153835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:18.153835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:18.154731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:18.154731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:18.154731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:18.154731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:18.154731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:18.154731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:18.154731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:18.154731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:18.154731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:18.154731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:18.154731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:18.154731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:18.154731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 333/646] 10.222.0.69 () {56 vars in 1102 bytes} [Mon Aug 29 21:26:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:18.154731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3c04f-fd88-49bb-88bf-2d1284a08a80 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:18.182486 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24a3f6-adc8-450a-a0c5-ce59efcbfeff None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:18.227042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fb3c5-4810-40cd-92ee-8396b9e5ff6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:18.228120 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fb3c5-4810-40cd-92ee-8396b9e5ff6e None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:18.228673 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fb3c5-4810-40cd-92ee-8396b9e5ff6e None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:18.229161 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fb3c5-4810-40cd-92ee-8396b9e5ff6e None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:18.230077 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37fb3c5-4810-40cd-92ee-8396b9e5ff6e None admin] RBAC: Adding query filter params (name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:18.230666 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37fb3c5-4810-40cd-92ee-8396b9e5ff6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:18.233556 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37fb3c5-4810-40cd-92ee-8396b9e5ff6e None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:18.245149 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 314/647] 10.222.0.69 () {56 vars in 1103 bytes} [Mon Aug 29 21:26:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:18.245760 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fb3c5-4810-40cd-92ee-8396b9e5ff6e None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:18.272702 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:18.289547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:18.320909 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3c04f-fd88-49bb-88bf-2d1284a08a80 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:18.364069 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a35a19-4a0b-4926-b92d-3e57556650f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:18.364990 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a35a19-4a0b-4926-b92d-3e57556650f3 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:18.365458 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a35a19-4a0b-4926-b92d-3e57556650f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:18.365735 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a35a19-4a0b-4926-b92d-3e57556650f3 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:18.366490 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a35a19-4a0b-4926-b92d-3e57556650f3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:18.366768 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a35a19-4a0b-4926-b92d-3e57556650f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:18.368273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a35a19-4a0b-4926-b92d-3e57556650f3 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:18.368426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fb3c5-4810-40cd-92ee-8396b9e5ff6e None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:18.395179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 334/648] 10.222.0.69 () {56 vars in 1137 bytes} [Mon Aug 29 21:26:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:18.396377 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a35a19-4a0b-4926-b92d-3e57556650f3 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:18.414672 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536b3e1-f957-43df-80fd-c7171202c979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:18.415166 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536b3e1-f957-43df-80fd-c7171202c979 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:18.415458 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536b3e1-f957-43df-80fd-c7171202c979 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:18.415829 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536b3e1-f957-43df-80fd-c7171202c979 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:18.416648 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536b3e1-f957-43df-80fd-c7171202c979 None admin] RBAC: Adding query filter params (role.id=3766508ffa094bb5bbec6d9209745261, scope.project.id=a302406c548c43c983625c0d66da47cc, user.id=96c35c544cae4ad187f1a1be723e0d21) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:18.416953 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536b3e1-f957-43df-80fd-c7171202c979 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:18.418386 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536b3e1-f957-43df-80fd-c7171202c979 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:18.425354 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 315/649] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:26:18 2022] GET /identity/v3/role_assignments?user.id=96c35c544cae4ad187f1a1be723e0d21&scope.project.id=a302406c548c43c983625c0d66da47cc&role.id=3766508ffa094bb5bbec6d9209745261 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:18.426509 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536b3e1-f957-43df-80fd-c7171202c979 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:18.554027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a35a19-4a0b-4926-b92d-3e57556650f3 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:18.563552 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536b3e1-f957-43df-80fd-c7171202c979 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:18.572628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:18.600594 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:18.615824 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74093c-eb17-49be-9837-01da06191899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:18.616780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74093c-eb17-49be-9837-01da06191899 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:18.616909 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74093c-eb17-49be-9837-01da06191899 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:18.617085 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74093c-eb17-49be-9837-01da06191899 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:18.622599 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd68a0-c79f-4e3a-9e91-3f41b9ad9ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:18.623660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd68a0-c79f-4e3a-9e91-3f41b9ad9ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:18.624295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd68a0-c79f-4e3a-9e91-3f41b9ad9ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:18.624803 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd68a0-c79f-4e3a-9e91-3f41b9ad9ac1 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:18.625597 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd68a0-c79f-4e3a-9e91-3f41b9ad9ac1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:18.625907 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd68a0-c79f-4e3a-9e91-3f41b9ad9ac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:18.627407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd68a0-c79f-4e3a-9e91-3f41b9ad9ac1 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:18.631829 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74093c-eb17-49be-9837-01da06191899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:18.633402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74093c-eb17-49be-9837-01da06191899 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:18.637333 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 335/650] 10.222.0.69 () {56 vars in 1103 bytes} [Mon Aug 29 21:26:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:18.638424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd68a0-c79f-4e3a-9e91-3f41b9ad9ac1 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:18.658213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-fc74093c-eb17-49be-9837-01da06191899 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:18.658213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:18.658213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:18.658213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:18.658213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:18.658213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:18.658213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:18.658213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:18.658213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:18.658213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:18.658213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:18.658213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:18.658213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:18.658213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:18.658213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:18.658213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:18.659234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:18.659234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:18.659234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:18.659234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:18.659234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:18.659234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:18.659234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:18.659234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:18.659234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:18.659234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:18.659234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:18.659234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:18.659234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:18.659234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:18.659234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:18.659234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:18.659234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:18.660141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:18.660141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:18.660141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:18.660141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 316/651] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:18.660422 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74093c-eb17-49be-9837-01da06191899 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:18.776091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd68a0-c79f-4e3a-9e91-3f41b9ad9ac1 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:18.790212 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74093c-eb17-49be-9837-01da06191899 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:18.824409 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694bd7a3-7b8d-48bf-9b8b-63e1cfde8937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:18.825196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bd7a3-7b8d-48bf-9b8b-63e1cfde8937 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:18.825576 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bd7a3-7b8d-48bf-9b8b-63e1cfde8937 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:18.825948 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bd7a3-7b8d-48bf-9b8b-63e1cfde8937 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:18.828640 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d2fad-3790-486b-a167-e5b1104c6689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:18.829445 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d2fad-3790-486b-a167-e5b1104c6689 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:18.829871 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d2fad-3790-486b-a167-e5b1104c6689 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:18.830384 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d2fad-3790-486b-a167-e5b1104c6689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:18.841871 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d2fad-3790-486b-a167-e5b1104c6689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:18.843858 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d2fad-3790-486b-a167-e5b1104c6689 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:18.861492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-436d2fad-3790-486b-a167-e5b1104c6689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:18.861492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:18.861492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:18.861492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:18.861492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:18.861492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:18.861492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:18.861492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:18.861492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:18.861492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:18.861492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:18.861492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:18.861492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:18.861492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:18.861492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:18.861492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:18.862523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:18.862523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:18.862523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:18.862523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:18.862523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:18.862523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:18.862523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:18.862523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:18.862523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:18.862523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:18.862523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:18.862523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:18.862523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:18.862523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:18.862523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:18.862523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:18.862523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:18.863416 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:18.863416 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:18.863416 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:18.865635 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 317/652] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:18.866958 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d2fad-3790-486b-a167-e5b1104c6689 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:18.889607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:18.906679 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:18.924168 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694bd7a3-7b8d-48bf-9b8b-63e1cfde8937 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:18.925714 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694bd7a3-7b8d-48bf-9b8b-63e1cfde8937 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:19.008403 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d2fad-3790-486b-a167-e5b1104c6689 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:19.058645 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880acc7-a691-451a-8275-618f14581b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:19.058645 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880acc7-a691-451a-8275-618f14581b7b None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:19.058645 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880acc7-a691-451a-8275-618f14581b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:19.058645 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880acc7-a691-451a-8275-618f14581b7b None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:19.059461 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880acc7-a691-451a-8275-618f14581b7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:19.059461 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880acc7-a691-451a-8275-618f14581b7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:19.059461 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880acc7-a691-451a-8275-618f14581b7b None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:19.059976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 336/653] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:26:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:19.061153 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694bd7a3-7b8d-48bf-9b8b-63e1cfde8937 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:19.072950 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 318/654] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:19.074283 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880acc7-a691-451a-8275-618f14581b7b None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:19.154105 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:19.208625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:19.218006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880acc7-a691-451a-8275-618f14581b7b None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:19.223778 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694bd7a3-7b8d-48bf-9b8b-63e1cfde8937 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:19.264451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132f394-b49a-4321-bf96-d2bb3762f9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:19.265148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132f394-b49a-4321-bf96-d2bb3762f9e5 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:19.265426 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132f394-b49a-4321-bf96-d2bb3762f9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:19.265710 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132f394-b49a-4321-bf96-d2bb3762f9e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:19.266372 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132f394-b49a-4321-bf96-d2bb3762f9e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:19.266659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132f394-b49a-4321-bf96-d2bb3762f9e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:19.268280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132f394-b49a-4321-bf96-d2bb3762f9e5 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:19.272666 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866884d8-238a-4556-9a33-eb4b0975a210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:19.273631 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866884d8-238a-4556-9a33-eb4b0975a210 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:19.274116 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866884d8-238a-4556-9a33-eb4b0975a210 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:19.274590 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866884d8-238a-4556-9a33-eb4b0975a210 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:19.286320 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 337/655] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:19.286320 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132f394-b49a-4321-bf96-d2bb3762f9e5 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:19.296656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866884d8-238a-4556-9a33-eb4b0975a210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:19.298174 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866884d8-238a-4556-9a33-eb4b0975a210 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:19.322496 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-866884d8-238a-4556-9a33-eb4b0975a210 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:19.322496 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:19.322496 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:19.322496 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:19.322496 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:19.322496 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:19.322496 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:19.322496 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:19.322496 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:19.322496 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:19.322496 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:19.322496 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:19.322496 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:19.322496 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:19.322496 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:19.322496 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:19.323701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:19.323701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:19.323701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:19.323701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:19.323701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:19.323701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:19.323701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:19.323701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:19.323701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:19.323701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:19.323701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:19.323701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:19.323701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:19.323701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:19.323701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:19.323701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:19.323701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:19.324832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:19.324832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:19.324832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:19.327245 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 319/656] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:19.329047 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866884d8-238a-4556-9a33-eb4b0975a210 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:19.433742 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132f394-b49a-4321-bf96-d2bb3762f9e5 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:19.463532 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866884d8-238a-4556-9a33-eb4b0975a210 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:19.485941 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:19.502175 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3b7fd-e96c-4f8e-b6a4-29bf5fc4d1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:19.503492 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3b7fd-e96c-4f8e-b6a4-29bf5fc4d1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:19.504478 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3b7fd-e96c-4f8e-b6a4-29bf5fc4d1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:19.505600 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3b7fd-e96c-4f8e-b6a4-29bf5fc4d1b1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:19.510246 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610a101-48d7-423f-96f1-fdee86665ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:19.511782 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610a101-48d7-423f-96f1-fdee86665ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:19.512247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610a101-48d7-423f-96f1-fdee86665ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:19.512672 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610a101-48d7-423f-96f1-fdee86665ac6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:19.521629 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3b7fd-e96c-4f8e-b6a4-29bf5fc4d1b1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:19.523635 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3b7fd-e96c-4f8e-b6a4-29bf5fc4d1b1 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:19.523974 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610a101-48d7-423f-96f1-fdee86665ac6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:19.525770 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610a101-48d7-423f-96f1-fdee86665ac6 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:19.537781 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-21b3b7fd-e96c-4f8e-b6a4-29bf5fc4d1b1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 21:26:19.537781 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:19.537781 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:19.537781 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:19.537781 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:19.537781 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:19.537781 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:19.537781 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:19.537781 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:19.537781 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:19.537781 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:19.537781 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:19.537781 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:19.537781 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:19.537781 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:19.537781 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:19.539001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:19.539001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:19.539001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:19.539001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:19.539001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:19.539001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:19.539001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:19.539001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:19.539001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:19.539001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:19.539001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:19.539001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:19.539001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:19.539001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:19.539001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:19.539001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:19.539001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:19.539001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:19.539981 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:19.539981 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:19.539981 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:19.539981 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:19.539981 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:19.539981 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:19.539981 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:19.539981 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:19.539981 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 21:26:19.539981 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:19.542298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-4610a101-48d7-423f-96f1-fdee86665ac6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 21:26:19.542298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:19.542298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:19.542298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:19.542298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:19.542298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:19.542298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:19.542298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:19.542298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:19.542298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:19.542298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:19.542298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:19.542298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:19.542298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:19.542298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:19.542298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:19.543238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:19.543238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:19.543238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:19.543238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:19.543238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:19.543238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:19.543238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:19.543238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:19.543238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:19.543238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:19.543238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:19.543238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:19.543238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:19.543238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:19.543238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:19.543238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:19.543238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:19.543238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:19.544224 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:19.544224 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:19.544224 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:19.544224 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:19.544224 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:19.544224 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:19.544224 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:19.544224 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:19.544224 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 21:26:19.544224 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:19.546472 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 338/657] 10.222.0.69 () {56 vars in 1102 bytes} [Mon Aug 29 21:26:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:19.551437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3b7fd-e96c-4f8e-b6a4-29bf5fc4d1b1 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:19.551631 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 320/658] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:26:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:19.551631 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610a101-48d7-423f-96f1-fdee86665ac6 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:19.566753 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:19.687260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610a101-48d7-423f-96f1-fdee86665ac6 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:19.689180 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3b7fd-e96c-4f8e-b6a4-29bf5fc4d1b1 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:19.725693 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47528823-87a7-4903-a3e5-1554f457d9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:19.726599 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47528823-87a7-4903-a3e5-1554f457d9ad None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:19.726880 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47528823-87a7-4903-a3e5-1554f457d9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:19.727157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47528823-87a7-4903-a3e5-1554f457d9ad None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:19.728690 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47528823-87a7-4903-a3e5-1554f457d9ad None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:19.729021 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47528823-87a7-4903-a3e5-1554f457d9ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:19.730899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47528823-87a7-4903-a3e5-1554f457d9ad None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:19.733702 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4056c8-ce39-4a51-81e2-1723a6a117d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:19.734326 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4056c8-ce39-4a51-81e2-1723a6a117d9 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:19.734611 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4056c8-ce39-4a51-81e2-1723a6a117d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:19.734882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4056c8-ce39-4a51-81e2-1723a6a117d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:19.735537 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4056c8-ce39-4a51-81e2-1723a6a117d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:19.735841 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4056c8-ce39-4a51-81e2-1723a6a117d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:19.737277 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4056c8-ce39-4a51-81e2-1723a6a117d9 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:19.755309 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 339/659] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:19.756275 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4056c8-ce39-4a51-81e2-1723a6a117d9 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:19.758705 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 321/660] 10.222.0.69 () {56 vars in 1139 bytes} [Mon Aug 29 21:26:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:19.759726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47528823-87a7-4903-a3e5-1554f457d9ad None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:19.829182 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:19.884687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:19.898207 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47528823-87a7-4903-a3e5-1554f457d9ad None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:19.935748 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4056c8-ce39-4a51-81e2-1723a6a117d9 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:19.955810 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdda3b-a3aa-4005-ae49-fc9f9aa7f231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:19.956783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdda3b-a3aa-4005-ae49-fc9f9aa7f231 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:19.957282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdda3b-a3aa-4005-ae49-fc9f9aa7f231 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:19.957782 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdda3b-a3aa-4005-ae49-fc9f9aa7f231 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:19.968964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccdda3b-a3aa-4005-ae49-fc9f9aa7f231 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:19.970612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccdda3b-a3aa-4005-ae49-fc9f9aa7f231 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:19.979202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b59e71-079b-4f78-b7ee-ae066eadefd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:19.980173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b59e71-079b-4f78-b7ee-ae066eadefd0 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:19.980645 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b59e71-079b-4f78-b7ee-ae066eadefd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:19.981315 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b59e71-079b-4f78-b7ee-ae066eadefd0 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:19.982188 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b59e71-079b-4f78-b7ee-ae066eadefd0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:19.982640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b59e71-079b-4f78-b7ee-ae066eadefd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:19.984281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b59e71-079b-4f78-b7ee-ae066eadefd0 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:19.984419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-0ccdda3b-a3aa-4005-ae49-fc9f9aa7f231 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:19.984419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:19.984419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:19.984419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:19.984419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:19.984419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:19.984419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:19.984419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:19.984419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:19.984419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:19.984419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:19.984419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:19.984419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:19.984419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:19.984419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:19.985434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:19.985434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:19.985434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:19.985434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:19.985434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:19.985434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:19.985434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:19.985434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:19.985434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:19.985434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:19.985434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:19.985434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:19.985434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:19.985434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:19.985434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:19.985434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:19.985434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:19.986500 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:19.986500 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:19.986500 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:19.986500 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:19.986500 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:19.986500 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:19.986500 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:19.986500 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:19.991410 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 322/661] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:19.992357 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdda3b-a3aa-4005-ae49-fc9f9aa7f231 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:20.014965 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 340/662] 10.222.0.69 () {56 vars in 1137 bytes} [Mon Aug 29 21:26:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:20.014965 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fffa3-c236-4e7d-af00-8e2d56d6dc3f None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:20.014965 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fffa3-c236-4e7d-af00-8e2d56d6dc3f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:20.014965 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fffa3-c236-4e7d-af00-8e2d56d6dc3f None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:20.014965 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 341/663] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:20.014965 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fffa3-c236-4e7d-af00-8e2d56d6dc3f None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:20.111315 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:20.120221 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdda3b-a3aa-4005-ae49-fc9f9aa7f231 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:20.163715 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fffa3-c236-4e7d-af00-8e2d56d6dc3f None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:20.170770 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46943e-a425-4c23-a524-0dd12edd3041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:20.170770 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46943e-a425-4c23-a524-0dd12edd3041 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:20.170770 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46943e-a425-4c23-a524-0dd12edd3041 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:20.170770 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46943e-a425-4c23-a524-0dd12edd3041 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:20.202487 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:20.213591 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a0c75-a4f3-4b69-8cec-51653569cc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:20.214266 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a0c75-a4f3-4b69-8cec-51653569cc37 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:20.214663 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a0c75-a4f3-4b69-8cec-51653569cc37 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:20.214925 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a0c75-a4f3-4b69-8cec-51653569cc37 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:20.215650 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a0c75-a4f3-4b69-8cec-51653569cc37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:20.215963 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a0c75-a4f3-4b69-8cec-51653569cc37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:20.217457 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a0c75-a4f3-4b69-8cec-51653569cc37 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:20.230744 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 342/664] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:20.231959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a0c75-a4f3-4b69-8cec-51653569cc37 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:20.269542 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46943e-a425-4c23-a524-0dd12edd3041 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:20.271018 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46943e-a425-4c23-a524-0dd12edd3041 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:20.362836 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a0c75-a4f3-4b69-8cec-51653569cc37 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:20.379149 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:20.389323 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 323/665] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:26:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:20.391267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac06c6-5f14-40cc-9e90-e03c8b3ce455 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:20.391718 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac06c6-5f14-40cc-9e90-e03c8b3ce455 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:20.392482 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac06c6-5f14-40cc-9e90-e03c8b3ce455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:20.405500 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78153558-d3fa-4a97-93cf-66a14d0c42d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:20.406375 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78153558-d3fa-4a97-93cf-66a14d0c42d7 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:20.406809 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78153558-d3fa-4a97-93cf-66a14d0c42d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:20.407255 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78153558-d3fa-4a97-93cf-66a14d0c42d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:20.413973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-8bac06c6-5f14-40cc-9e90-e03c8b3ce455 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:20.415195 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-8bac06c6-5f14-40cc-9e90-e03c8b3ce455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:20.482498 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:20.500196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78153558-d3fa-4a97-93cf-66a14d0c42d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:20.501663 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78153558-d3fa-4a97-93cf-66a14d0c42d7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:20.511340 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 324/666] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:20.512608 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac06c6-5f14-40cc-9e90-e03c8b3ce455 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:20.632802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac06c6-5f14-40cc-9e90-e03c8b3ce455 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:20.662077 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 343/667] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:26:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:20.662077 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78153558-d3fa-4a97-93cf-66a14d0c42d7 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:20.669097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:20.684364 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a65a8a-89be-4e8d-8eef-65156b32f76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:20.685598 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a65a8a-89be-4e8d-8eef-65156b32f76d None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:20.686503 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a65a8a-89be-4e8d-8eef-65156b32f76d None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:20.687006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a65a8a-89be-4e8d-8eef-65156b32f76d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:20.687985 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a65a8a-89be-4e8d-8eef-65156b32f76d None admin] RBAC: Adding query filter params (role.id=3766508ffa094bb5bbec6d9209745261, scope.project.id=a302406c548c43c983625c0d66da47cc, user.id=df18e704834948c4bb480691fa8d0824) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:20.688545 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a65a8a-89be-4e8d-8eef-65156b32f76d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:20.691078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a65a8a-89be-4e8d-8eef-65156b32f76d None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:20.699443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 325/668] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:26:20 2022] GET /identity/v3/role_assignments?user.id=df18e704834948c4bb480691fa8d0824&scope.project.id=a302406c548c43c983625c0d66da47cc&role.id=3766508ffa094bb5bbec6d9209745261 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:20.700724 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a65a8a-89be-4e8d-8eef-65156b32f76d None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:20.801235 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:20.817737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78153558-d3fa-4a97-93cf-66a14d0c42d7 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:20.830131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a65a8a-89be-4e8d-8eef-65156b32f76d None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:20.860115 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a57fe7-6f8d-4487-9622-69419cdc7e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:20.860842 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a57fe7-6f8d-4487-9622-69419cdc7e5e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:20.861123 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a57fe7-6f8d-4487-9622-69419cdc7e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:20.861497 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a57fe7-6f8d-4487-9622-69419cdc7e5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:20.871741 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156ca52-0fdd-4126-b5c3-4510a79b0b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:20.872416 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156ca52-0fdd-4126-b5c3-4510a79b0b84 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:20.872699 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156ca52-0fdd-4126-b5c3-4510a79b0b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:20.872971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156ca52-0fdd-4126-b5c3-4510a79b0b84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:20.875101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a57fe7-6f8d-4487-9622-69419cdc7e5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:20.877700 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a57fe7-6f8d-4487-9622-69419cdc7e5e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:20.885409 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156ca52-0fdd-4126-b5c3-4510a79b0b84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:20.887016 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156ca52-0fdd-4126-b5c3-4510a79b0b84 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:20.897378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-08a57fe7-6f8d-4487-9622-69419cdc7e5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:20.897378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:20.897378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:20.897378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:20.897378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:20.897378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:20.897378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:20.897378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:20.897378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:20.897378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:20.897378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:20.897378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:20.897378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:20.897378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:20.897378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:20.897378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:20.898383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:20.898383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:20.898383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:20.898383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:20.898383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:20.898383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:20.898383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:20.898383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:20.898383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:20.898383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:20.898383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:20.898383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:20.898383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:20.898383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:20.898383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:20.898383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:20.898383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:20.899285 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:20.899285 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:20.899285 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:20.901563 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 344/669] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:20.904247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-a156ca52-0fdd-4126-b5c3-4510a79b0b84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:20.904247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:20.904247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:20.904247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:20.904247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:20.904247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:20.904247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:20.904247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:20.904247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:20.904247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:20.904247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:20.904247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:20.904247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:20.904247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:20.904247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:20.904247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:20.905220 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:20.905220 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:20.905220 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:20.905220 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:20.905220 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:20.905220 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:20.905220 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:20.905220 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:20.905220 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:20.905220 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:20.905220 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:20.905220 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:20.905220 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:20.905220 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:20.905220 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:20.905220 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:20.905220 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:20.906116 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:20.906116 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:20.906116 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:20.907387 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7016c02-70ed-4c19-aa40-a175c581e1b0 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:20.907675 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7016c02-70ed-4c19-aa40-a175c581e1b0 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:20.907954 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7016c02-70ed-4c19-aa40-a175c581e1b0 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:20.909396 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 345/671] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:20.909651 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 326/671] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:20.910304 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7016c02-70ed-4c19-aa40-a175c581e1b0 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:20.911012 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156ca52-0fdd-4126-b5c3-4510a79b0b84 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:20.965727 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:21.031468 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7016c02-70ed-4c19-aa40-a175c581e1b0 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:21.034159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156ca52-0fdd-4126-b5c3-4510a79b0b84 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:21.070658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b52043-adc4-4a73-bff1-1a575a1f3d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:21.071217 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b52043-adc4-4a73-bff1-1a575a1f3d8f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:21.071503 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b52043-adc4-4a73-bff1-1a575a1f3d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:21.071672 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb65aff-f086-4112-8efe-896b3c7edf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:21.071833 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b52043-adc4-4a73-bff1-1a575a1f3d8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:21.072357 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb65aff-f086-4112-8efe-896b3c7edf33 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:21.072716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb65aff-f086-4112-8efe-896b3c7edf33 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:21.072947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb65aff-f086-4112-8efe-896b3c7edf33 None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:21.073561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb65aff-f086-4112-8efe-896b3c7edf33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:21.073863 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb65aff-f086-4112-8efe-896b3c7edf33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:21.075247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb65aff-f086-4112-8efe-896b3c7edf33 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:21.081451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:21.087096 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b52043-adc4-4a73-bff1-1a575a1f3d8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:21.093520 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 327/672] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:21.093520 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ec881-8ce7-47c0-b13f-2315b38af8e3 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:21.093520 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ec881-8ce7-47c0-b13f-2315b38af8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:21.093520 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ec881-8ce7-47c0-b13f-2315b38af8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:21.093908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-71b52043-adc4-4a73-bff1-1a575a1f3d8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:21.093908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:21.093908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:21.093908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:21.093908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:21.093908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:21.093908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:21.093908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:21.093908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:21.093908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:21.093908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:21.093908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:21.093908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:21.093908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:21.093908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:21.093908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:21.094807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:21.094807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:21.094807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:21.094807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:21.094807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:21.094807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:21.094807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:21.094807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:21.094807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:21.094807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:21.094807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:21.094807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:21.094807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:21.094807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:21.094807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:21.094807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:21.095756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:21.095756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:21.095756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:21.095756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:21.095756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:21.095756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:21.095756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:21.095756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:21.095756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:21.095756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:21.095756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:21.095756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:21.098205 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 346/673] 10.222.0.69 () {56 vars in 1102 bytes} [Mon Aug 29 21:26:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:21.099038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b52043-adc4-4a73-bff1-1a575a1f3d8f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:21.116576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-1e8ec881-8ce7-47c0-b13f-2315b38af8e3 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:21.116576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-1e8ec881-8ce7-47c0-b13f-2315b38af8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:21.195748 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 328/674] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:21.201607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ec881-8ce7-47c0-b13f-2315b38af8e3 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:21.247958 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:21.248350 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b52043-adc4-4a73-bff1-1a575a1f3d8f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:21.285454 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b249fbd-4383-4728-9959-d38c56b482ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:21.286292 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b249fbd-4383-4728-9959-d38c56b482ee None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:21.286602 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b249fbd-4383-4728-9959-d38c56b482ee None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:21.286897 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b249fbd-4383-4728-9959-d38c56b482ee None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:21.287549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b249fbd-4383-4728-9959-d38c56b482ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:21.287848 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b249fbd-4383-4728-9959-d38c56b482ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:21.289263 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b249fbd-4383-4728-9959-d38c56b482ee None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:21.302960 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 347/675] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:21.303894 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b249fbd-4383-4728-9959-d38c56b482ee None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:21.339878 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ec881-8ce7-47c0-b13f-2315b38af8e3 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:21.367505 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:21.389269 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69595c36-38a4-4e82-a5f5-50bd16b0af87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:21.390356 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69595c36-38a4-4e82-a5f5-50bd16b0af87 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:21.390864 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69595c36-38a4-4e82-a5f5-50bd16b0af87 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:21.391833 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69595c36-38a4-4e82-a5f5-50bd16b0af87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:21.403432 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69595c36-38a4-4e82-a5f5-50bd16b0af87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:21.404947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69595c36-38a4-4e82-a5f5-50bd16b0af87 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:21.418069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-69595c36-38a4-4e82-a5f5-50bd16b0af87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:21.418069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:21.418069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:21.418069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:21.418069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:21.418069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:21.418069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:21.418069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:21.418069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:21.418069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:21.418069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:21.418069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:21.418069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:21.418069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:21.418069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:21.419042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:21.419042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:21.419042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:21.419042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:21.419042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:21.419042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:21.419042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:21.419042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:21.419042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:21.419042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:21.419042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:21.419042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:21.419042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:21.419042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:21.419042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:21.419042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:21.419042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:21.420626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:21.420626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:21.420626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:21.420626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:21.420626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:21.420626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:21.420626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:21.420626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:21.420626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 329/676] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:21.420626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69595c36-38a4-4e82-a5f5-50bd16b0af87 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:21.428221 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b249fbd-4383-4728-9959-d38c56b482ee None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:21.482060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfb1e3-c58f-4c20-8941-8f97ff342b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:21.482752 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfb1e3-c58f-4c20-8941-8f97ff342b4e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:21.483038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfb1e3-c58f-4c20-8941-8f97ff342b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:21.483312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfb1e3-c58f-4c20-8941-8f97ff342b4e None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:21.483986 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfb1e3-c58f-4c20-8941-8f97ff342b4e None admin] RBAC: Adding query filter params (name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:21.484330 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfb1e3-c58f-4c20-8941-8f97ff342b4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:21.485742 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfb1e3-c58f-4c20-8941-8f97ff342b4e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:21.495784 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 348/677] 10.222.0.69 () {56 vars in 1103 bytes} [Mon Aug 29 21:26:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:21.497011 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfb1e3-c58f-4c20-8941-8f97ff342b4e None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:21.538927 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:21.552860 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69595c36-38a4-4e82-a5f5-50bd16b0af87 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:21.591821 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d81b3-8e3a-4df3-b7f0-f20c12e6a393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:21.592478 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d81b3-8e3a-4df3-b7f0-f20c12e6a393 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:21.592759 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d81b3-8e3a-4df3-b7f0-f20c12e6a393 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:21.593044 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d81b3-8e3a-4df3-b7f0-f20c12e6a393 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:21.599967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d81b3-8e3a-4df3-b7f0-f20c12e6a393 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:21.601443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d81b3-8e3a-4df3-b7f0-f20c12e6a393 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:21.613055 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-c03d81b3-8e3a-4df3-b7f0-f20c12e6a393 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:21.613055 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:21.613055 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:21.613055 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:21.613055 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:21.613055 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:21.613055 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:21.613055 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:21.613055 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:21.613055 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:21.613055 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:21.613055 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:21.613055 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:21.613055 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:21.613055 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:21.613981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:21.613981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:21.613981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:21.613981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:21.613981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:21.613981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:21.613981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:21.613981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:21.613981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:21.613981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:21.613981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:21.613981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:21.613981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:21.613981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:21.613981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:21.613981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:21.613981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:21.614946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:21.614946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:21.614946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:21.614946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:21.614946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:21.614946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:21.614946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:21.614946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:21.614946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 330/678] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:21.614946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d81b3-8e3a-4df3-b7f0-f20c12e6a393 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:21.623027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfb1e3-c58f-4c20-8941-8f97ff342b4e None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:21.648258 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:21.662463 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995fd4b-28a6-41cc-b1df-215c97759254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:21.663047 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995fd4b-28a6-41cc-b1df-215c97759254 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:21.663332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995fd4b-28a6-41cc-b1df-215c97759254 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:21.663869 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995fd4b-28a6-41cc-b1df-215c97759254 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:21.664345 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995fd4b-28a6-41cc-b1df-215c97759254 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:21.664657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995fd4b-28a6-41cc-b1df-215c97759254 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:21.666340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995fd4b-28a6-41cc-b1df-215c97759254 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:21.679293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 349/679] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:21.680135 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995fd4b-28a6-41cc-b1df-215c97759254 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:21.734039 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d81b3-8e3a-4df3-b7f0-f20c12e6a393 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:21.780202 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e573d47-df05-4640-ad24-e3ee3de2692c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:21.780859 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e573d47-df05-4640-ad24-e3ee3de2692c None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:21.781163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e573d47-df05-4640-ad24-e3ee3de2692c None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:21.781411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e573d47-df05-4640-ad24-e3ee3de2692c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:21.788830 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995fd4b-28a6-41cc-b1df-215c97759254 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:21.794342 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e573d47-df05-4640-ad24-e3ee3de2692c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:21.799744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-9e573d47-df05-4640-ad24-e3ee3de2692c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:26:21.799744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:21.799744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:21.799744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:21.799744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:21.799744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:21.799744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:21.799744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:21.799744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:21.799744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:21.799744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:21.799744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:21.799744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:21.799744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:21.799744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:21.799744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:21.800819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:21.800819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:21.800819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:21.800819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:21.800819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:21.800819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:21.800819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:21.800819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:21.800819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:21.800819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:21.800819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:21.800819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:21.800819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:21.800819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:21.800819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:21.800819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:21.801787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:21.801787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:21.801787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:21.801787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:21.801787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:21.801787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:21.801787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:21.801787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:21.801787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:21.801787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:21.801787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:26:21.801787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:21.801787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 331/680] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:26:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:21.801787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e573d47-df05-4640-ad24-e3ee3de2692c None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:21.814702 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:21.839156 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bcd03-6d29-4ba6-a435-91aa3701f615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:21.839819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bcd03-6d29-4ba6-a435-91aa3701f615 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:21.840103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bcd03-6d29-4ba6-a435-91aa3701f615 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:21.841158 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bcd03-6d29-4ba6-a435-91aa3701f615 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:21.851828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bcd03-6d29-4ba6-a435-91aa3701f615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:21.853383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bcd03-6d29-4ba6-a435-91aa3701f615 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:21.871797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-e93bcd03-6d29-4ba6-a435-91aa3701f615 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:21.871797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:21.871797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:21.871797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:21.871797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:21.871797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:21.871797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:21.871797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:21.871797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:21.871797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:21.871797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:21.871797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:21.871797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:21.871797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:21.871797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:21.871797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:21.872849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:21.872849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:21.872849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:21.872849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:21.872849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:21.872849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:21.872849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:21.872849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:21.872849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:21.872849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:21.872849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:21.872849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:21.872849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:21.872849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:21.872849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:21.872849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:21.872849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:21.873865 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:21.873865 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:21.873865 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:21.873865 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 350/681] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:21.873865 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bcd03-6d29-4ba6-a435-91aa3701f615 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:21.916008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:21.920759 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e573d47-df05-4640-ad24-e3ee3de2692c None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:21.957986 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b732a7-290f-4b9a-a943-a223b985aefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:21.958602 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b732a7-290f-4b9a-a943-a223b985aefc None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:21.958877 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b732a7-290f-4b9a-a943-a223b985aefc None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:21.959154 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b732a7-290f-4b9a-a943-a223b985aefc None admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:21.959841 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b732a7-290f-4b9a-a943-a223b985aefc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:21.960146 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b732a7-290f-4b9a-a943-a223b985aefc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:21.961802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b732a7-290f-4b9a-a943-a223b985aefc None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:21.976800 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 332/682] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:21.977636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b732a7-290f-4b9a-a943-a223b985aefc None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:21.992514 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bcd03-6d29-4ba6-a435-91aa3701f615 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:22.030671 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06083a61-2276-4b57-94c8-3665207a09df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:22.031286 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06083a61-2276-4b57-94c8-3665207a09df None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:22.031572 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06083a61-2276-4b57-94c8-3665207a09df None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:22.031851 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06083a61-2276-4b57-94c8-3665207a09df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:22.032625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06083a61-2276-4b57-94c8-3665207a09df None admin] RBAC: Adding query filter params (role.id=3766508ffa094bb5bbec6d9209745261, scope.project.id=a302406c548c43c983625c0d66da47cc, user.id=dfa16ba58c0040f8bdfa5e46f2681395) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:22.032940 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06083a61-2276-4b57-94c8-3665207a09df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:22.034381 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06083a61-2276-4b57-94c8-3665207a09df None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:22.041466 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 351/683] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:26:21 2022] GET /identity/v3/role_assignments?user.id=dfa16ba58c0040f8bdfa5e46f2681395&scope.project.id=a302406c548c43c983625c0d66da47cc&role.id=3766508ffa094bb5bbec6d9209745261 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:22.042327 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06083a61-2276-4b57-94c8-3665207a09df None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:22.084141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:22.112667 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b732a7-290f-4b9a-a943-a223b985aefc None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:22.157128 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fe450-cec7-4a1a-b59a-cc5b086f8573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:22.158559 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fe450-cec7-4a1a-b59a-cc5b086f8573 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:22.159014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fe450-cec7-4a1a-b59a-cc5b086f8573 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:22.159460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fe450-cec7-4a1a-b59a-cc5b086f8573 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:22.160337 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fe450-cec7-4a1a-b59a-cc5b086f8573 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:22.160845 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fe450-cec7-4a1a-b59a-cc5b086f8573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:22.162438 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fe450-cec7-4a1a-b59a-cc5b086f8573 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:22.176710 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 333/684] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:26:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:22.177918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fe450-cec7-4a1a-b59a-cc5b086f8573 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:22.210471 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:22.218370 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06083a61-2276-4b57-94c8-3665207a09df None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:22.279009 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203aef9b-c56e-4b13-81c9-5ec15ef2816e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:22.280386 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203aef9b-c56e-4b13-81c9-5ec15ef2816e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:22.280386 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203aef9b-c56e-4b13-81c9-5ec15ef2816e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:22.280386 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203aef9b-c56e-4b13-81c9-5ec15ef2816e None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:22.280971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203aef9b-c56e-4b13-81c9-5ec15ef2816e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:22.281368 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203aef9b-c56e-4b13-81c9-5ec15ef2816e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:22.282769 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203aef9b-c56e-4b13-81c9-5ec15ef2816e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:22.301831 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 352/685] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:22.304798 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203aef9b-c56e-4b13-81c9-5ec15ef2816e None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:22.345254 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fe450-cec7-4a1a-b59a-cc5b086f8573 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:22.390490 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:22.398189 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c08815-6766-48ed-ad5b-7da4defeeaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:22.400412 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c08815-6766-48ed-ad5b-7da4defeeaf3 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:22.401165 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c08815-6766-48ed-ad5b-7da4defeeaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:22.401850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c08815-6766-48ed-ad5b-7da4defeeaf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:22.403739 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c08815-6766-48ed-ad5b-7da4defeeaf3 None admin] RBAC: Adding query filter params (role.id=3766508ffa094bb5bbec6d9209745261, scope.project.id=a302406c548c43c983625c0d66da47cc, user.id=ad05a52c8aec4744a41639f2343eb54f) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:22.404751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c08815-6766-48ed-ad5b-7da4defeeaf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:22.407328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c08815-6766-48ed-ad5b-7da4defeeaf3 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:22.415279 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 334/686] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:26:22 2022] GET /identity/v3/role_assignments?user.id=ad05a52c8aec4744a41639f2343eb54f&scope.project.id=a302406c548c43c983625c0d66da47cc&role.id=3766508ffa094bb5bbec6d9209745261 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:22.421321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c08815-6766-48ed-ad5b-7da4defeeaf3 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:22.424626 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203aef9b-c56e-4b13-81c9-5ec15ef2816e None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:22.466973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afc004-cfb2-4f6d-9c25-76470585b37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:22.468093 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afc004-cfb2-4f6d-9c25-76470585b37b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:22.468604 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afc004-cfb2-4f6d-9c25-76470585b37b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:22.469391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afc004-cfb2-4f6d-9c25-76470585b37b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:22.483818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afc004-cfb2-4f6d-9c25-76470585b37b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:22.485850 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afc004-cfb2-4f6d-9c25-76470585b37b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:22.506103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-f5afc004-cfb2-4f6d-9c25-76470585b37b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:22.506103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:22.506103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:22.506103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:22.506103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:22.506103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:22.506103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:22.506103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:22.506103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:22.506103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:22.506103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:22.506103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:22.506103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:22.506103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:22.506103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:22.506103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:22.507195 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:22.507195 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:22.507195 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:22.507195 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:22.507195 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:22.507195 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:22.507195 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:22.507195 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:22.507195 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:22.507195 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:22.507195 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:22.507195 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:22.507195 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:22.507195 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:22.507195 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:22.507195 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:22.507195 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:22.508125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:22.508125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:22.508125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:22.510440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 353/687] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:22.516360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afc004-cfb2-4f6d-9c25-76470585b37b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:22.533594 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:22.626099 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c08815-6766-48ed-ad5b-7da4defeeaf3 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:22.653663 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afc004-cfb2-4f6d-9c25-76470585b37b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:22.694842 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fab5d-b9ae-462a-a175-a2d063377532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:22.695494 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fab5d-b9ae-462a-a175-a2d063377532 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:22.695774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fab5d-b9ae-462a-a175-a2d063377532 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:22.696051 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fab5d-b9ae-462a-a175-a2d063377532 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:22.713896 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fab5d-b9ae-462a-a175-a2d063377532 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:22.715390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fab5d-b9ae-462a-a175-a2d063377532 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:22.722578 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee81678-2dd8-4d62-843e-fda1cb57cee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:22.723214 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee81678-2dd8-4d62-843e-fda1cb57cee2 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:22.723549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee81678-2dd8-4d62-843e-fda1cb57cee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:22.723840 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee81678-2dd8-4d62-843e-fda1cb57cee2 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:22.725305 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee81678-2dd8-4d62-843e-fda1cb57cee2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:22.726007 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee81678-2dd8-4d62-843e-fda1cb57cee2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:22.727425 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee81678-2dd8-4d62-843e-fda1cb57cee2 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:22.735097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-cd3fab5d-b9ae-462a-a175-a2d063377532 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:26:22.735097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:22.735097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:22.735097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:22.735097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:22.735097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:22.735097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:22.735097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:22.735097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:22.735097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:22.735097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:22.735097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:22.735097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:22.735097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:22.735097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:22.735097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:22.736110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:22.736110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:22.736110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:22.736110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:22.736110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:22.736110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:22.736110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:22.736110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:22.736110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:22.736110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:22.736110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:22.736110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:22.736110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:22.736110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:22.736110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:22.736110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:22.736110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:22.736110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:22.737088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:22.737088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:22.737088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:22.737088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:22.737088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:22.737088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:22.737088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:22.737088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:22.737088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:26:22.737088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:22.737088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 335/688] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:26:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:22.743844 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fab5d-b9ae-462a-a175-a2d063377532 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:22.744120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 354/689] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:22.749712 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee81678-2dd8-4d62-843e-fda1cb57cee2 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:22.809180 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:22.838592 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:22.875172 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee81678-2dd8-4d62-843e-fda1cb57cee2 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:22.879454 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fab5d-b9ae-462a-a175-a2d063377532 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:22.916942 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6530cbc-9e39-4bfe-b72c-949f2172991e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:22.918196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6530cbc-9e39-4bfe-b72c-949f2172991e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:22.919103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6530cbc-9e39-4bfe-b72c-949f2172991e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:22.919725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6530cbc-9e39-4bfe-b72c-949f2172991e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:22.924204 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22ce50-ddbd-4277-88e1-a1433a95eeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:22.924939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22ce50-ddbd-4277-88e1-a1433a95eeb4 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:22.924939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22ce50-ddbd-4277-88e1-a1433a95eeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:22.924939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22ce50-ddbd-4277-88e1-a1433a95eeb4 None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:22.924939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22ce50-ddbd-4277-88e1-a1433a95eeb4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:22.924939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22ce50-ddbd-4277-88e1-a1433a95eeb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:22.928393 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22ce50-ddbd-4277-88e1-a1433a95eeb4 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:22.933395 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6530cbc-9e39-4bfe-b72c-949f2172991e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:22.935194 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6530cbc-9e39-4bfe-b72c-949f2172991e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:22.954889 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 336/690] 10.222.0.69 () {56 vars in 1135 bytes} [Mon Aug 29 21:26:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:22.954889 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f3350-eba1-472e-beb8-a254a32f8bdc None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:22.954889 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f3350-eba1-472e-beb8-a254a32f8bdc None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:22.954889 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f3350-eba1-472e-beb8-a254a32f8bdc None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:22.954889 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 337/691] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:22.956405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-a6530cbc-9e39-4bfe-b72c-949f2172991e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:26:22.956405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:22.956405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:22.956405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:22.956405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:22.956405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:22.956405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:22.956405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:22.956405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:22.956405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:22.956405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:22.956405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:22.956405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:22.956405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:22.956405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:22.956405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:22.957298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:22.957298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:22.957298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:22.957298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:22.957298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:22.957298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:22.957298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:22.957298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:22.957298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:22.957298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:22.957298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:22.957298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:22.957298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:22.957298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:22.957298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:22.957298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:22.957298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:22.957298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:22.958411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:22.958411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:22.958411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:22.958411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:22.958411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:22.958411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:22.958411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:22.958411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:22.958411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:26:22.958411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:22.959783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f3350-eba1-472e-beb8-a254a32f8bdc None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:22.960848 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 355/692] 10.222.0.69 () {56 vars in 1093 bytes} [Mon Aug 29 21:26:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:26:22.962215 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c4b28-3dd5-4a6c-9dc0-4d7b55693d6e None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:22.962677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c4b28-3dd5-4a6c-9dc0-4d7b55693d6e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:22.963385 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c4b28-3dd5-4a6c-9dc0-4d7b55693d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:22.988975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-864c4b28-3dd5-4a6c-9dc0-4d7b55693d6e None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:22.990733 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-864c4b28-3dd5-4a6c-9dc0-4d7b55693d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:23.078435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 356/693] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:23.079538 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c4b28-3dd5-4a6c-9dc0-4d7b55693d6e None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:23.113276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f3350-eba1-472e-beb8-a254a32f8bdc None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:23.145891 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:23.152772 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:23.190699 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91014e-f9c1-4189-ac22-919a9d4149f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:23.191386 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91014e-f9c1-4189-ac22-919a9d4149f1 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:23.191765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91014e-f9c1-4189-ac22-919a9d4149f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:23.192132 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91014e-f9c1-4189-ac22-919a9d4149f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:23.248099 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c4b28-3dd5-4a6c-9dc0-4d7b55693d6e None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:23.320531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91014e-f9c1-4189-ac22-919a9d4149f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:23.322820 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91014e-f9c1-4189-ac22-919a9d4149f1 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:23.365112 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d10b21-de2f-4738-b15d-b7217b20a677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:23.366143 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d10b21-de2f-4738-b15d-b7217b20a677 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:23.366669 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d10b21-de2f-4738-b15d-b7217b20a677 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:23.367166 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d10b21-de2f-4738-b15d-b7217b20a677 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:23.368147 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d10b21-de2f-4738-b15d-b7217b20a677 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:23.368682 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d10b21-de2f-4738-b15d-b7217b20a677 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:23.370410 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d10b21-de2f-4738-b15d-b7217b20a677 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:23.414678 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 357/694] 10.222.0.69 () {56 vars in 1133 bytes} [Mon Aug 29 21:26:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:23.433242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d10b21-de2f-4738-b15d-b7217b20a677 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:23.445430 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 338/695] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:26:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:23.451419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91014e-f9c1-4189-ac22-919a9d4149f1 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:23.471581 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:23.546571 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d10b21-de2f-4738-b15d-b7217b20a677 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:23.563092 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91014e-f9c1-4189-ac22-919a9d4149f1 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:23.565241 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:23.585847 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487cc99-af0b-4bf3-ab51-b8dcbb9d1de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:23.586492 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487cc99-af0b-4bf3-ab51-b8dcbb9d1de8 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:23.586775 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487cc99-af0b-4bf3-ab51-b8dcbb9d1de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:23.587049 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487cc99-af0b-4bf3-ab51-b8dcbb9d1de8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:23.602648 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b27feb-222e-4fa7-9865-0bcf5d22f76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:23.604253 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b27feb-222e-4fa7-9865-0bcf5d22f76e None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:23.604734 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b27feb-222e-4fa7-9865-0bcf5d22f76e None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:23.605199 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b27feb-222e-4fa7-9865-0bcf5d22f76e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:23.615963 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b27feb-222e-4fa7-9865-0bcf5d22f76e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:23.617717 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b27feb-222e-4fa7-9865-0bcf5d22f76e None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:23.633089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-45b27feb-222e-4fa7-9865-0bcf5d22f76e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:23.633089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:23.633089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:23.633089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:23.633089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:23.633089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:23.633089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:23.633089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:23.633089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:23.633089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:23.633089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:23.633089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:23.633089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:23.633089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:23.633089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:23.633089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:23.634078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:23.634078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:23.634078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:23.634078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:23.634078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:23.634078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:23.634078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:23.634078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:23.634078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:23.634078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:23.634078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:23.634078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:23.634078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:23.634078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:23.634078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:23.634078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:23.634078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:23.635045 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:23.635045 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:23.635045 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:23.641796 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 339/696] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:23.643001 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b27feb-222e-4fa7-9865-0bcf5d22f76e None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:23.670270 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487cc99-af0b-4bf3-ab51-b8dcbb9d1de8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:23.672472 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487cc99-af0b-4bf3-ab51-b8dcbb9d1de8 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:23.715309 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:23.764077 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b27feb-222e-4fa7-9865-0bcf5d22f76e None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:23.829342 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecbcef-bc9c-4339-8acf-f5a6aef84a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:23.830336 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecbcef-bc9c-4339-8acf-f5a6aef84a92 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:23.830802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecbcef-bc9c-4339-8acf-f5a6aef84a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:23.831272 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecbcef-bc9c-4339-8acf-f5a6aef84a92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:23.833294 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 358/697] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:26:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:23.835289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487cc99-af0b-4bf3-ab51-b8dcbb9d1de8 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:23.846549 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecbcef-bc9c-4339-8acf-f5a6aef84a92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:23.848014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecbcef-bc9c-4339-8acf-f5a6aef84a92 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:23.865644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-f3ecbcef-bc9c-4339-8acf-f5a6aef84a92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:23.865644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:23.865644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:23.865644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:23.865644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:23.865644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:23.865644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:23.865644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:23.865644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:23.865644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:23.865644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:23.865644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:23.865644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:23.865644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:23.865644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:23.865644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:23.867553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:23.867553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:23.867553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:23.867553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:23.867553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:23.867553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:23.867553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:23.867553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:23.867553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:23.867553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:23.867553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:23.867553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:23.867553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:23.867553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:23.867553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:23.867553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:23.867553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:23.869382 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:23.869382 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:23.869382 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:23.871603 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 340/698] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:23.872658 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecbcef-bc9c-4339-8acf-f5a6aef84a92 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:23.881933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:24.004141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487cc99-af0b-4bf3-ab51-b8dcbb9d1de8 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:24.013976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecbcef-bc9c-4339-8acf-f5a6aef84a92 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:24.032632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:24.052359 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61d87f-5ca0-4a35-9623-16f27a7dc836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:24.052990 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61d87f-5ca0-4a35-9623-16f27a7dc836 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:24.053271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61d87f-5ca0-4a35-9623-16f27a7dc836 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:24.053543 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61d87f-5ca0-4a35-9623-16f27a7dc836 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:24.054927 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2ce5a-5959-40f0-a289-82affee01b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:24.056050 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2ce5a-5959-40f0-a289-82affee01b31 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:24.057088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2ce5a-5959-40f0-a289-82affee01b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:24.057619 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2ce5a-5959-40f0-a289-82affee01b31 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:24.058472 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2ce5a-5959-40f0-a289-82affee01b31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:24.059009 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2ce5a-5959-40f0-a289-82affee01b31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:24.060623 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2ce5a-5959-40f0-a289-82affee01b31 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:24.065250 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61d87f-5ca0-4a35-9623-16f27a7dc836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:24.066903 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61d87f-5ca0-4a35-9623-16f27a7dc836 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:24.082660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 359/699] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:24.082973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-ed61d87f-5ca0-4a35-9623-16f27a7dc836 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:24.082973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:24.082973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:24.082973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:24.082973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:24.082973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:24.082973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:24.082973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:24.082973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:24.082973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:24.082973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:24.082973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:24.082973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:24.082973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:24.082973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:24.082973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:24.083879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:24.083879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:24.083879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:24.083879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:24.083879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:24.083879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:24.083879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:24.083879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:24.083879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:24.083879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:24.083879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:24.083879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:24.083879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:24.083879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:24.083879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:24.083879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:24.083879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:24.084811 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:24.084811 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:24.084811 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:24.086315 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2ce5a-5959-40f0-a289-82affee01b31 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:24.088457 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 341/700] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:24.089292 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61d87f-5ca0-4a35-9623-16f27a7dc836 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:24.188718 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:24.218133 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2ce5a-5959-40f0-a289-82affee01b31 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:24.238689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61d87f-5ca0-4a35-9623-16f27a7dc836 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:24.259970 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8806344-8ef9-4967-bebb-e21f8bc37aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:24.260704 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8806344-8ef9-4967-bebb-e21f8bc37aba None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:24.261066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8806344-8ef9-4967-bebb-e21f8bc37aba None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:24.261327 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8806344-8ef9-4967-bebb-e21f8bc37aba None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:24.262097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8806344-8ef9-4967-bebb-e21f8bc37aba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:24.262494 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8806344-8ef9-4967-bebb-e21f8bc37aba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:24.264370 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8806344-8ef9-4967-bebb-e21f8bc37aba None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:24.278663 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 360/701] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:24.279703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8806344-8ef9-4967-bebb-e21f8bc37aba None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:24.293160 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee4b66-2305-42f0-a8cb-c44a578acb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:24.293795 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee4b66-2305-42f0-a8cb-c44a578acb73 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:24.294071 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee4b66-2305-42f0-a8cb-c44a578acb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:24.294344 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee4b66-2305-42f0-a8cb-c44a578acb73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:24.303519 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee4b66-2305-42f0-a8cb-c44a578acb73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:24.305068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee4b66-2305-42f0-a8cb-c44a578acb73 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:24.316810 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-dbee4b66-2305-42f0-a8cb-c44a578acb73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:24.316810 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:24.316810 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:24.316810 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:24.316810 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:24.316810 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:24.316810 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:24.316810 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:24.316810 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:24.316810 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:24.316810 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:24.316810 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:24.316810 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:24.316810 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:24.316810 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:24.317738 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:24.317738 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:24.317738 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:24.317738 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:24.317738 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:24.317738 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:24.317738 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:24.317738 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:24.317738 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:24.317738 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:24.317738 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:24.317738 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:24.317738 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:24.317738 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:24.317738 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:24.317738 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:24.317738 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:24.325793 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:24.325793 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:24.325793 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:24.325793 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:24.325793 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:24.325793 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:24.325793 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:24.325793 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:24.325793 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 342/702] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:24.325793 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e8cd4-1f3b-4799-9726-43211e8d9777 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:24.325793 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e8cd4-1f3b-4799-9726-43211e8d9777 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:24.326868 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e8cd4-1f3b-4799-9726-43211e8d9777 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:24.326868 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 343/703] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:24.326868 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e8cd4-1f3b-4799-9726-43211e8d9777 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:24.361607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:24.417023 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8806344-8ef9-4967-bebb-e21f8bc37aba None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:24.448367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e8cd4-1f3b-4799-9726-43211e8d9777 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:24.453629 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4f06a-1e8d-407c-85cc-c53041e8f715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:24.454245 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4f06a-1e8d-407c-85cc-c53041e8f715 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:24.454527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4f06a-1e8d-407c-85cc-c53041e8f715 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:24.454810 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4f06a-1e8d-407c-85cc-c53041e8f715 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:24.455452 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4f06a-1e8d-407c-85cc-c53041e8f715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:24.455761 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4f06a-1e8d-407c-85cc-c53041e8f715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:24.457312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4f06a-1e8d-407c-85cc-c53041e8f715 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:24.464800 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:24.470969 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 361/704] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:24.472600 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4f06a-1e8d-407c-85cc-c53041e8f715 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:24.488603 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1706780-50b2-48ff-b374-06b755407e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:24.489213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1706780-50b2-48ff-b374-06b755407e74 None admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:24.489521 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1706780-50b2-48ff-b374-06b755407e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:24.489791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1706780-50b2-48ff-b374-06b755407e74 None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:24.490476 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1706780-50b2-48ff-b374-06b755407e74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:24.491870 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1706780-50b2-48ff-b374-06b755407e74 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:24.516695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 344/705] 10.222.0.69 () {60 vars in 1132 bytes} [Mon Aug 29 21:26:24 2022] POST /identity/v3/users => generated 254 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:26:24.517947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202142b-2fbf-4657-9d65-fdae20c0ab29 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:24.518242 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202142b-2fbf-4657-9d65-fdae20c0ab29 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:24.518518 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202142b-2fbf-4657-9d65-fdae20c0ab29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:24.538605 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-f202142b-2fbf-4657-9d65-fdae20c0ab29 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:24.539846 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f202142b-2fbf-4657-9d65-fdae20c0ab29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:24.622846 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4f06a-1e8d-407c-85cc-c53041e8f715 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:24.632665 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 345/706] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:24.633676 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202142b-2fbf-4657-9d65-fdae20c0ab29 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:24.666436 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90418b74-acd7-4ab6-a7ab-f7eff54670ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:24.667699 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90418b74-acd7-4ab6-a7ab-f7eff54670ca None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:24.668775 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90418b74-acd7-4ab6-a7ab-f7eff54670ca None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:24.669275 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90418b74-acd7-4ab6-a7ab-f7eff54670ca None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:24.670232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90418b74-acd7-4ab6-a7ab-f7eff54670ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:24.670797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90418b74-acd7-4ab6-a7ab-f7eff54670ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:24.672933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90418b74-acd7-4ab6-a7ab-f7eff54670ca None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:24.674687 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:24.699725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 362/707] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:24.699725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d3a1e-848a-47cf-a166-0f88ad893da8 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:24.699725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d3a1e-848a-47cf-a166-0f88ad893da8 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:24.699725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d3a1e-848a-47cf-a166-0f88ad893da8 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:24.699725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 363/708] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:24.699725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d3a1e-848a-47cf-a166-0f88ad893da8 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:24.781972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202142b-2fbf-4657-9d65-fdae20c0ab29 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:24.789681 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:24.824273 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5eb46-bfbd-44f1-9b90-e6796e1a6ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:24.825173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5eb46-bfbd-44f1-9b90-e6796e1a6ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:24.825611 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5eb46-bfbd-44f1-9b90-e6796e1a6ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:24.825884 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5eb46-bfbd-44f1-9b90-e6796e1a6ee3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:24.838638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5eb46-bfbd-44f1-9b90-e6796e1a6ee3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:24.840407 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5eb46-bfbd-44f1-9b90-e6796e1a6ee3 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:24.842466 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d3a1e-848a-47cf-a166-0f88ad893da8 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:24.855203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-18a5eb46-bfbd-44f1-9b90-e6796e1a6ee3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:24.855203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:24.855203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:24.855203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:24.855203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:24.855203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:24.855203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:24.855203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:24.855203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:24.855203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:24.855203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:24.855203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:24.855203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:24.855203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:24.855203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:24.856157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:24.856157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:24.856157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:24.856157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:24.856157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:24.856157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:24.856157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:24.856157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:24.856157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:24.856157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:24.856157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:24.856157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:24.856157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:24.856157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:24.856157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:24.856157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:24.856157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:24.857459 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:24.857459 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:24.857459 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:24.857459 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:24.857459 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:24.857459 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:24.857459 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:24.857459 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:24.857459 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 346/709] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:24.860549 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142cd39-e515-452b-b619-61c85f2acd8c None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:24.860836 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142cd39-e515-452b-b619-61c85f2acd8c None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:24.861134 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142cd39-e515-452b-b619-61c85f2acd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:24.884440 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-d142cd39-e515-452b-b619-61c85f2acd8c None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:24.885621 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-d142cd39-e515-452b-b619-61c85f2acd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:24.891853 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5521e45-4a55-49d6-ac3f-c53e022b59fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:24.892552 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5521e45-4a55-49d6-ac3f-c53e022b59fe None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:24.892837 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5521e45-4a55-49d6-ac3f-c53e022b59fe None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:24.893109 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5521e45-4a55-49d6-ac3f-c53e022b59fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:24.893964 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5521e45-4a55-49d6-ac3f-c53e022b59fe None admin] RBAC: Adding query filter params (role.id=3766508ffa094bb5bbec6d9209745261, scope.project.id=a302406c548c43c983625c0d66da47cc, user.id=714a2ba019144211931dbe853f1960aa) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:24.894281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5521e45-4a55-49d6-ac3f-c53e022b59fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:24.895910 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5521e45-4a55-49d6-ac3f-c53e022b59fe None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:24.904050 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 364/710] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:26:24 2022] GET /identity/v3/role_assignments?user.id=714a2ba019144211931dbe853f1960aa&scope.project.id=a302406c548c43c983625c0d66da47cc&role.id=3766508ffa094bb5bbec6d9209745261 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:24.905101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5521e45-4a55-49d6-ac3f-c53e022b59fe None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:24.961476 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 347/711] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:25.014921 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142cd39-e515-452b-b619-61c85f2acd8c None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:25.024206 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:25.026373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5521e45-4a55-49d6-ac3f-c53e022b59fe None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:25.055354 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:25.070434 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8a81c-a8f3-4429-ba5c-d335a54af80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:25.071071 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8a81c-a8f3-4429-ba5c-d335a54af80a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:25.071357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8a81c-a8f3-4429-ba5c-d335a54af80a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:25.071634 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8a81c-a8f3-4429-ba5c-d335a54af80a None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:25.072518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8a81c-a8f3-4429-ba5c-d335a54af80a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:25.072831 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8a81c-a8f3-4429-ba5c-d335a54af80a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:25.074396 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8a81c-a8f3-4429-ba5c-d335a54af80a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:25.089428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 365/712] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:25.095578 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8a81c-a8f3-4429-ba5c-d335a54af80a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:25.197369 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142cd39-e515-452b-b619-61c85f2acd8c None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:25.222727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8a81c-a8f3-4429-ba5c-d335a54af80a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:25.250346 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f209f-a33e-4edd-a6a1-c3bf4e85f62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:25.251362 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f209f-a33e-4edd-a6a1-c3bf4e85f62b None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:25.251646 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f209f-a33e-4edd-a6a1-c3bf4e85f62b None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:25.251919 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f209f-a33e-4edd-a6a1-c3bf4e85f62b None admin] PATH_INFO: `/v3/services/network` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:25.252816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f209f-a33e-4edd-a6a1-c3bf4e85f62b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:25.254900 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f209f-a33e-4edd-a6a1-c3bf4e85f62b None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:25.268401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677f2fd-239a-484e-b472-31509471986c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:25.269038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677f2fd-239a-484e-b472-31509471986c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:25.269523 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677f2fd-239a-484e-b472-31509471986c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:25.270009 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677f2fd-239a-484e-b472-31509471986c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:25.270805 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-1c2f209f-a33e-4edd-a6a1-c3bf4e85f62b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:26:25.270805 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:25.270805 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:26:25.270805 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:26:25.270805 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:26:25.270805 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:26:25.270805 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:26:25.270805 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:25.270805 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:26:25.270805 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:25.270805 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:26:25.270805 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:25.270805 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:25.270805 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:25.270805 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:25.270805 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:25.270805 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:25.273448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:25.273448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:25.273448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:25.273448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:25.273448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:25.273448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:25.273448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:26:25.273448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:26:25.273448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:26:25.273448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:26:25.273448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:25.273448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:25.273448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:25.273448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:25.273448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:25.273448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:25.275929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:25.275929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:25.275929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:25.275929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:25.275929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:25.275929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:25.275929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:25.275929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:25.275929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:25.275929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:25.275929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:26:25.275929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:25.275929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:26:25.275929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:25.277004 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677f2fd-239a-484e-b472-31509471986c None admin] RBAC: Adding query filter params (role.id=69369872661e4179bb51cd1ca76e28c3, scope.project.id=a302406c548c43c983625c0d66da47cc, user.id=96c35c544cae4ad187f1a1be723e0d21) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:25.277004 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677f2fd-239a-484e-b472-31509471986c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:25.277163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 348/713] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:25 2022] GET /identity/v3/services/network => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:26:25.277297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677f2fd-239a-484e-b472-31509471986c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:25.282640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 366/714] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:26:25 2022] GET /identity/v3/role_assignments?user.id=96c35c544cae4ad187f1a1be723e0d21&scope.project.id=a302406c548c43c983625c0d66da47cc&role.id=69369872661e4179bb51cd1ca76e28c3 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:25.285730 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f209f-a33e-4edd-a6a1-c3bf4e85f62b None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:25.329680 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677f2fd-239a-484e-b472-31509471986c None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:25.403417 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:25.406037 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:25.442945 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f209f-a33e-4edd-a6a1-c3bf4e85f62b None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:25.468661 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677f2fd-239a-484e-b472-31509471986c None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:25.492959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3175f-f95a-4bfa-aaa3-d9b149c8dab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:25.493644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3175f-f95a-4bfa-aaa3-d9b149c8dab5 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:25.494522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3175f-f95a-4bfa-aaa3-d9b149c8dab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:25.494798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3175f-f95a-4bfa-aaa3-d9b149c8dab5 None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:25.495428 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3175f-f95a-4bfa-aaa3-d9b149c8dab5 None admin] RBAC: Adding query filter params (name=network) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:25.495728 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3175f-f95a-4bfa-aaa3-d9b149c8dab5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:25.497215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3175f-f95a-4bfa-aaa3-d9b149c8dab5 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:25.502456 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 349/715] 10.222.0.69 () {56 vars in 1112 bytes} [Mon Aug 29 21:26:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:25.507857 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3175f-f95a-4bfa-aaa3-d9b149c8dab5 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:25.511224 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c3c36-fdec-415f-900b-8101aeb45094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:25.512044 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c3c36-fdec-415f-900b-8101aeb45094 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:25.512589 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c3c36-fdec-415f-900b-8101aeb45094 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:25.513087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c3c36-fdec-415f-900b-8101aeb45094 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:25.513875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c3c36-fdec-415f-900b-8101aeb45094 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:25.515439 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c3c36-fdec-415f-900b-8101aeb45094 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:25.529034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-4c6c3c36-fdec-415f-900b-8101aeb45094 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:26:25.529034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:25.529034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:26:25.529034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:26:25.529034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:26:25.529034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:26:25.529034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:26:25.529034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:25.529034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:26:25.529034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:25.529034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:26:25.529034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:25.529034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:25.529034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:25.529034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:25.529034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:25.529034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:25.530076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:25.530076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:25.530076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:25.530076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:25.530076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:25.530076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:25.530076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:26:25.530076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:26:25.530076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:26:25.530076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:26:25.530076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:25.530076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:25.530076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:25.530076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:25.530076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:25.530076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:25.530919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:25.530919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:25.530919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:25.530919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:25.530919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:25.530919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:25.530919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:25.530919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:25.530919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:25.530919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:25.530919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:26:25.530919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:25.530919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:26:25.530919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:25.533729 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 367/716] 10.222.0.69 () {56 vars in 1129 bytes} [Mon Aug 29 21:26:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:26:25.541350 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c3c36-fdec-415f-900b-8101aeb45094 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:25.678762 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3175f-f95a-4bfa-aaa3-d9b149c8dab5 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:25.727829 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c3c36-fdec-415f-900b-8101aeb45094 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:25.730973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6d40d-78c0-4d07-8b81-b65ddfef1d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:25.732121 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6d40d-78c0-4d07-8b81-b65ddfef1d98 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:25.732630 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6d40d-78c0-4d07-8b81-b65ddfef1d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:25.733105 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6d40d-78c0-4d07-8b81-b65ddfef1d98 None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:25.733964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6d40d-78c0-4d07-8b81-b65ddfef1d98 None admin] RBAC: Adding query filter params (type=network) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:25.734539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6d40d-78c0-4d07-8b81-b65ddfef1d98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:25.736130 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6d40d-78c0-4d07-8b81-b65ddfef1d98 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:25.747076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:25.747267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:25.751314 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 350/717] 10.222.0.69 () {56 vars in 1112 bytes} [Mon Aug 29 21:26:25 2022] GET /identity/v3/services?type=network => generated 124 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:25.766630 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f29dce-eba8-4d80-8cca-bc6fd0371ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:25.767241 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f29dce-eba8-4d80-8cca-bc6fd0371ddb None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:25.767520 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f29dce-eba8-4d80-8cca-bc6fd0371ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:25.767794 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f29dce-eba8-4d80-8cca-bc6fd0371ddb None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:25.768464 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f29dce-eba8-4d80-8cca-bc6fd0371ddb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:25.768769 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f29dce-eba8-4d80-8cca-bc6fd0371ddb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:25.770139 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f29dce-eba8-4d80-8cca-bc6fd0371ddb None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:25.775989 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 368/718] 10.222.0.69 () {56 vars in 1124 bytes} [Mon Aug 29 21:26:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:25.782103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6d40d-78c0-4d07-8b81-b65ddfef1d98 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:25.937623 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6d40d-78c0-4d07-8b81-b65ddfef1d98 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:25.975070 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338bd31-0965-4a49-bb0b-ed0c0eac4b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:25.975766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338bd31-0965-4a49-bb0b-ed0c0eac4b67 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:25.976049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338bd31-0965-4a49-bb0b-ed0c0eac4b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:25.976353 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338bd31-0965-4a49-bb0b-ed0c0eac4b67 None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:25.976985 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338bd31-0965-4a49-bb0b-ed0c0eac4b67 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:25.977288 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338bd31-0965-4a49-bb0b-ed0c0eac4b67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:25.979298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338bd31-0965-4a49-bb0b-ed0c0eac4b67 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:25.985447 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 351/719] 10.222.0.69 () {56 vars in 1124 bytes} [Mon Aug 29 21:26:25 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:26.948409 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a62996-4720-4aec-b673-b1d9cea2fe37 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:26.948989 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a62996-4720-4aec-b673-b1d9cea2fe37 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:26.948989 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a62996-4720-4aec-b673-b1d9cea2fe37 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:26.950566 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 369/720] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:26.955709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb702f6-e9a3-4ef7-841d-fcddface167f None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:26.956224 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb702f6-e9a3-4ef7-841d-fcddface167f None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:26.956333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb702f6-e9a3-4ef7-841d-fcddface167f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:26.988753 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-7cb702f6-e9a3-4ef7-841d-fcddface167f None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:26.989982 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-7cb702f6-e9a3-4ef7-841d-fcddface167f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:27.088946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:27.102589 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 352/721] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:27.549633 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a62996-4720-4aec-b673-b1d9cea2fe37 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:27.683084 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a62996-4720-4aec-b673-b1d9cea2fe37 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:27.734055 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf9a02-fe7e-4a6e-bf44-c9ae092fa2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:27.735118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf9a02-fe7e-4a6e-bf44-c9ae092fa2ba None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:27.735604 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf9a02-fe7e-4a6e-bf44-c9ae092fa2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:27.736095 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf9a02-fe7e-4a6e-bf44-c9ae092fa2ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:27.738045 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459ca5e-3526-4d85-bef9-cda41bfaab51 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:27.738530 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459ca5e-3526-4d85-bef9-cda41bfaab51 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:27.739051 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459ca5e-3526-4d85-bef9-cda41bfaab51 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:27.741122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 353/722] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:27.746075 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4486efa-00f5-4fdf-b9c0-34547be9f6a2 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:27.746361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4486efa-00f5-4fdf-b9c0-34547be9f6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:27.746636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4486efa-00f5-4fdf-b9c0-34547be9f6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:27.757851 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf9a02-fe7e-4a6e-bf44-c9ae092fa2ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:27.763779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-7cbf9a02-fe7e-4a6e-bf44-c9ae092fa2ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:27.763779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:27.763779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:27.763779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:27.763779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:27.763779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:27.763779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:27.763779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:27.763779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:27.763779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:27.763779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:27.763779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:27.763779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:27.763779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:27.763779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:27.763779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:27.764765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:27.764765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:27.764765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:27.764765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:27.764765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:27.764765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:27.764765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:27.764765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:27.764765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:27.764765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:27.764765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:27.764765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:27.764765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:27.764765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:27.764765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:27.764765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:27.765608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:27.765608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:27.765608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:27.765608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:27.765608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:27.765608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:27.765608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:27.765608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:27.765608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:27.765608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:27.765608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:27.765608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:27.766738 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-d4486efa-00f5-4fdf-b9c0-34547be9f6a2 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:27.767949 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-d4486efa-00f5-4fdf-b9c0-34547be9f6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:27.768589 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 370/723] 10.222.0.69 () {56 vars in 1102 bytes} [Mon Aug 29 21:26:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:27.770170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f9492-d2d3-4945-bc04-b70367c2ddee None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:27.770670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f9492-d2d3-4945-bc04-b70367c2ddee None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:27.771792 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f9492-d2d3-4945-bc04-b70367c2ddee None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:27.776211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 371/724] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:27.776211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f9492-d2d3-4945-bc04-b70367c2ddee None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:27.815309 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:27.860204 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 354/725] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:27.860204 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58e460-a1e4-40d5-8f35-74ebe8897e8d None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:27.860204 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58e460-a1e4-40d5-8f35-74ebe8897e8d None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:27.860204 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58e460-a1e4-40d5-8f35-74ebe8897e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:27.875469 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-8b58e460-a1e4-40d5-8f35-74ebe8897e8d None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:27.877770 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-8b58e460-a1e4-40d5-8f35-74ebe8897e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:27.925482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f9492-d2d3-4945-bc04-b70367c2ddee None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:27.965021 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 355/726] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:27.979708 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d870a82-efab-450d-b09b-2a8c46cb3c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:27.980379 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d870a82-efab-450d-b09b-2a8c46cb3c3f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:27.980638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d870a82-efab-450d-b09b-2a8c46cb3c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:27.980909 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d870a82-efab-450d-b09b-2a8c46cb3c3f None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:27.981887 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d870a82-efab-450d-b09b-2a8c46cb3c3f None admin] RBAC: Adding query filter params (name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:27.982187 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d870a82-efab-450d-b09b-2a8c46cb3c3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:27.983548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d870a82-efab-450d-b09b-2a8c46cb3c3f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:27.993746 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 372/727] 10.222.0.69 () {56 vars in 1103 bytes} [Mon Aug 29 21:26:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:28.001300 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58e460-a1e4-40d5-8f35-74ebe8897e8d None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:28.070007 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:28.129212 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58e460-a1e4-40d5-8f35-74ebe8897e8d None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:28.183374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87798ec6-9894-4891-a14e-5c55a5505bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:28.184022 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87798ec6-9894-4891-a14e-5c55a5505bed None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:28.184342 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87798ec6-9894-4891-a14e-5c55a5505bed None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:28.184617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87798ec6-9894-4891-a14e-5c55a5505bed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:28.195763 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87798ec6-9894-4891-a14e-5c55a5505bed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:28.197401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87798ec6-9894-4891-a14e-5c55a5505bed None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:28.214350 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d870a82-efab-450d-b09b-2a8c46cb3c3f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:28.216731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-87798ec6-9894-4891-a14e-5c55a5505bed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:28.216731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:28.216731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:28.216731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:28.216731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:28.216731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:28.216731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:28.216731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:28.216731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:28.216731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:28.216731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:28.216731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:28.216731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:28.216731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:28.216731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:28.216731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:28.217666 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:28.217666 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:28.217666 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:28.217666 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:28.217666 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:28.217666 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:28.217666 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:28.217666 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:28.217666 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:28.217666 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:28.217666 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:28.217666 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:28.217666 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:28.217666 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:28.217666 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:28.217666 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:28.217666 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:28.218577 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:28.218577 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:28.218577 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:28.218577 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 356/728] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:28.225292 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87798ec6-9894-4891-a14e-5c55a5505bed None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:28.350365 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87798ec6-9894-4891-a14e-5c55a5505bed None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:28.354063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:28.363586 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:28.372423 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d870a82-efab-450d-b09b-2a8c46cb3c3f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:28.399659 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619eba1c-7c6c-4fba-8a2b-ddd2bf2d88e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:28.401205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619eba1c-7c6c-4fba-8a2b-ddd2bf2d88e0 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:28.401698 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619eba1c-7c6c-4fba-8a2b-ddd2bf2d88e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:28.402399 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619eba1c-7c6c-4fba-8a2b-ddd2bf2d88e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:28.403407 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619eba1c-7c6c-4fba-8a2b-ddd2bf2d88e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:28.404194 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619eba1c-7c6c-4fba-8a2b-ddd2bf2d88e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:28.406059 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619eba1c-7c6c-4fba-8a2b-ddd2bf2d88e0 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:28.408892 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a23e6-5744-404b-8e68-8720f49a1971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:28.409532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a23e6-5744-404b-8e68-8720f49a1971 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:28.409813 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a23e6-5744-404b-8e68-8720f49a1971 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:28.410087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a23e6-5744-404b-8e68-8720f49a1971 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:28.422001 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 357/729] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:28.422228 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a23e6-5744-404b-8e68-8720f49a1971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:28.423295 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619eba1c-7c6c-4fba-8a2b-ddd2bf2d88e0 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:28.427808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-852a23e6-5744-404b-8e68-8720f49a1971 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:26:28.427808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:28.427808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:28.427808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:28.427808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:28.427808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:28.427808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:28.427808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:28.427808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:28.427808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:28.427808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:28.427808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:28.427808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:28.427808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:28.427808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:28.427808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:28.429028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:28.429028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:28.429028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:28.429028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:28.429028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:28.429028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:28.429028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:28.429028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:28.429028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:28.429028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:28.429028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:28.429028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:28.429028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:28.429028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:28.429028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:28.429028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:28.435440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:28.435440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:28.435440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:28.435440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:28.435440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:28.435440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:28.435440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:28.435440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:28.435440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:28.435440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:28.435440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:26:28.435440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:28.435440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 373/730] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:26:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:26:28.435440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a73f62-44a4-4f56-88ad-3c8e499dbbe8 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:28.436251 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a73f62-44a4-4f56-88ad-3c8e499dbbe8 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:28.436251 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a73f62-44a4-4f56-88ad-3c8e499dbbe8 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:28.437090 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 374/731] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:28.437961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a73f62-44a4-4f56-88ad-3c8e499dbbe8 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:28.543024 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619eba1c-7c6c-4fba-8a2b-ddd2bf2d88e0 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:28.554878 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a73f62-44a4-4f56-88ad-3c8e499dbbe8 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:28.580052 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68804c1-7871-4f37-85ca-12795da6c8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:28.580732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68804c1-7871-4f37-85ca-12795da6c8b7 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:28.581010 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68804c1-7871-4f37-85ca-12795da6c8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:28.581284 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68804c1-7871-4f37-85ca-12795da6c8b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:28.592077 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68804c1-7871-4f37-85ca-12795da6c8b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:28.592279 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5252cb-b865-490a-b7c3-9bb65e839ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:28.592914 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5252cb-b865-490a-b7c3-9bb65e839ede None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:28.593197 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5252cb-b865-490a-b7c3-9bb65e839ede None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:28.593472 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5252cb-b865-490a-b7c3-9bb65e839ede None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:28.596808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-c68804c1-7871-4f37-85ca-12795da6c8b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:26:28.596808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:28.596808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:28.596808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:28.596808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:28.596808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:28.596808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:28.596808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:28.596808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:28.596808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:28.596808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:28.596808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:28.596808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:28.596808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:28.596808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:28.596808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:28.597939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:28.597939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:28.597939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:28.597939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:28.597939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:28.597939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:28.597939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:28.597939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:28.597939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:28.597939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:28.597939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:28.597939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:28.597939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:28.597939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:28.597939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:28.597939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:28.598787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:28.598787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:28.598787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:28.598787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:28.598787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:28.598787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:28.598787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:28.598787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:28.598787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:28.598787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:28.598787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:26:28.598787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:28.598787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 358/732] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:26:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:28.598787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68804c1-7871-4f37-85ca-12795da6c8b7 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:28.601362 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5252cb-b865-490a-b7c3-9bb65e839ede None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:28.602913 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5252cb-b865-490a-b7c3-9bb65e839ede None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:28.615211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-fa5252cb-b865-490a-b7c3-9bb65e839ede None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:26:28.615211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:28.615211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:28.615211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:28.615211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:28.615211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:28.615211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:28.615211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:28.615211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:28.615211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:28.615211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:28.615211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:28.615211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:28.615211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:28.615211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:28.615211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:28.616424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:28.616424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:28.616424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:28.616424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:28.616424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:28.616424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:28.616424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:28.616424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:28.616424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:28.616424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:28.616424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:28.616424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:28.616424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:28.616424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:28.616424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:28.616424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:28.616424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:28.616424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:28.617366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:28.617366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:28.617366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:28.617366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:28.617366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:28.617366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:28.617366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:28.617366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:28.617366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:26:28.617366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:28.617366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 375/733] 10.222.0.69 () {56 vars in 1117 bytes} [Mon Aug 29 21:26:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:28.617974 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12cb8c-4314-4975-92f1-f6b2be7e5955 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:28.617974 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12cb8c-4314-4975-92f1-f6b2be7e5955 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:28.618161 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12cb8c-4314-4975-92f1-f6b2be7e5955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:28.629082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:28.637162 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-aa12cb8c-4314-4975-92f1-f6b2be7e5955 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:28.638369 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-aa12cb8c-4314-4975-92f1-f6b2be7e5955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:28.649717 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:28.706121 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68804c1-7871-4f37-85ca-12795da6c8b7 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:28.709522 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 376/734] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:28.710626 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de5636-d156-47bb-b793-ebbade817fa5 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:28.710917 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de5636-d156-47bb-b793-ebbade817fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:28.711192 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de5636-d156-47bb-b793-ebbade817fa5 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:28.712673 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 377/735] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:28.713225 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de5636-d156-47bb-b793-ebbade817fa5 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:28.744827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029790c-8762-4b1c-97c9-04a15442c84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:28.745479 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029790c-8762-4b1c-97c9-04a15442c84a None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:28.745716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029790c-8762-4b1c-97c9-04a15442c84a None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:28.746256 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029790c-8762-4b1c-97c9-04a15442c84a None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:28.746644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029790c-8762-4b1c-97c9-04a15442c84a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:28.746947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029790c-8762-4b1c-97c9-04a15442c84a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:28.748510 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029790c-8762-4b1c-97c9-04a15442c84a None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:28.761999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 359/736] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:26:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:28.761999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029790c-8762-4b1c-97c9-04a15442c84a None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:28.827302 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de5636-d156-47bb-b793-ebbade817fa5 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:28.852467 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:28.862791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5f44c-1c3c-461d-815d-de591498f265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:28.863392 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5f44c-1c3c-461d-815d-de591498f265 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:28.863670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5f44c-1c3c-461d-815d-de591498f265 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:28.863943 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5f44c-1c3c-461d-815d-de591498f265 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:28.864637 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5f44c-1c3c-461d-815d-de591498f265 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:28.864938 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5f44c-1c3c-461d-815d-de591498f265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:28.866318 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5f44c-1c3c-461d-815d-de591498f265 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:28.871187 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029790c-8762-4b1c-97c9-04a15442c84a None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:28.877082 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 378/737] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:26:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:28.878364 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337cc5b-7ce2-4e20-b6ef-821d7df7c165 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:28.878771 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337cc5b-7ce2-4e20-b6ef-821d7df7c165 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:28.879191 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337cc5b-7ce2-4e20-b6ef-821d7df7c165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:28.899811 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-c337cc5b-7ce2-4e20-b6ef-821d7df7c165 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:28.901814 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c337cc5b-7ce2-4e20-b6ef-821d7df7c165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:28.904054 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:28.914257 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc9856-135b-4956-8d09-a483fe32e1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:28.914873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc9856-135b-4956-8d09-a483fe32e1e3 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:28.915144 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc9856-135b-4956-8d09-a483fe32e1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:28.915414 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc9856-135b-4956-8d09-a483fe32e1e3 None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:28.916225 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc9856-135b-4956-8d09-a483fe32e1e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:28.916533 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc9856-135b-4956-8d09-a483fe32e1e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:28.917957 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc9856-135b-4956-8d09-a483fe32e1e3 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:28.937526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 360/738] 10.222.0.69 () {56 vars in 1149 bytes} [Mon Aug 29 21:26:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:28.938372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc9856-135b-4956-8d09-a483fe32e1e3 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:28.990369 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 379/739] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:28.990369 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337cc5b-7ce2-4e20-b6ef-821d7df7c165 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:29.063349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc9856-135b-4956-8d09-a483fe32e1e3 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:29.105820 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae912fb-cfdb-489c-87ba-7240b8b40b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:29.106798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae912fb-cfdb-489c-87ba-7240b8b40b14 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:29.107074 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae912fb-cfdb-489c-87ba-7240b8b40b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:29.107695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae912fb-cfdb-489c-87ba-7240b8b40b14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:29.116565 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337cc5b-7ce2-4e20-b6ef-821d7df7c165 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:29.118755 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae912fb-cfdb-489c-87ba-7240b8b40b14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:29.120835 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae912fb-cfdb-489c-87ba-7240b8b40b14 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:29.123492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:29.136851 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-0ae912fb-cfdb-489c-87ba-7240b8b40b14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:29.136851 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:29.136851 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:29.136851 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:29.136851 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:29.136851 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:29.136851 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:29.136851 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:29.136851 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:29.136851 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:29.136851 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:29.136851 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:29.136851 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:29.136851 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:29.136851 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:29.136851 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:29.137925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:29.137925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:29.137925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:29.137925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:29.137925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:29.137925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:29.137925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:29.137925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:29.137925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:29.137925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:29.137925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:29.137925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:29.137925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:29.137925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:29.137925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:29.137925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:29.137925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:29.138868 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:29.138868 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:29.138868 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:29.138868 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 361/740] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:29.138868 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae912fb-cfdb-489c-87ba-7240b8b40b14 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:29.162019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f16c49-018d-4637-9777-ba5f9cdfe8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:29.162650 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f16c49-018d-4637-9777-ba5f9cdfe8fd None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:29.162949 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f16c49-018d-4637-9777-ba5f9cdfe8fd None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:29.163197 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f16c49-018d-4637-9777-ba5f9cdfe8fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:29.175156 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f16c49-018d-4637-9777-ba5f9cdfe8fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:29.175930 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:29.178864 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f16c49-018d-4637-9777-ba5f9cdfe8fd None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:29.196912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-a5f16c49-018d-4637-9777-ba5f9cdfe8fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:29.196912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:29.196912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:29.196912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:29.196912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:29.196912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:29.196912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:29.196912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:29.196912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:29.196912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:29.196912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:29.196912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:29.196912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:29.196912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:29.196912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:29.196912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:29.197952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:29.197952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:29.197952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:29.197952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:29.197952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:29.197952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:29.197952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:29.197952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:29.197952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:29.197952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:29.197952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:29.197952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:29.197952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:29.197952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:29.197952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:29.197952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:29.197952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:29.198888 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:29.198888 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:29.198888 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:29.198888 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 380/741] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:29.198888 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f16c49-018d-4637-9777-ba5f9cdfe8fd None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:29.256754 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae912fb-cfdb-489c-87ba-7240b8b40b14 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:29.292168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c20d1b-46a0-4efa-92df-6850d6884416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:29.292801 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c20d1b-46a0-4efa-92df-6850d6884416 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:29.293083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c20d1b-46a0-4efa-92df-6850d6884416 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:29.293359 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c20d1b-46a0-4efa-92df-6850d6884416 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:29.312786 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f16c49-018d-4637-9777-ba5f9cdfe8fd None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:29.347278 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80beda44-2a11-44b6-9702-2d2836b75b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:29.347892 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80beda44-2a11-44b6-9702-2d2836b75b29 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:29.348196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80beda44-2a11-44b6-9702-2d2836b75b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:29.348485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80beda44-2a11-44b6-9702-2d2836b75b29 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:29.349138 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80beda44-2a11-44b6-9702-2d2836b75b29 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:29.350532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80beda44-2a11-44b6-9702-2d2836b75b29 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:29.357324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:29.365617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c20d1b-46a0-4efa-92df-6850d6884416 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:29.367149 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c20d1b-46a0-4efa-92df-6850d6884416 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:29.367273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 381/742] 10.222.0.69 () {60 vars in 1141 bytes} [Mon Aug 29 21:26:29 2022] POST /identity/v3/services => generated 240 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:26:29.368084 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80beda44-2a11-44b6-9702-2d2836b75b29 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:29.434849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:29.499307 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 362/743] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:26:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:29.500206 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c20d1b-46a0-4efa-92df-6850d6884416 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:29.510783 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80beda44-2a11-44b6-9702-2d2836b75b29 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:29.557701 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5ad4c-80ac-4c2d-9337-99191c92db1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:29.558577 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5ad4c-80ac-4c2d-9337-99191c92db1c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:29.559022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5ad4c-80ac-4c2d-9337-99191c92db1c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:29.559302 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5ad4c-80ac-4c2d-9337-99191c92db1c None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:29.559962 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa5ad4c-80ac-4c2d-9337-99191c92db1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:29.560371 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa5ad4c-80ac-4c2d-9337-99191c92db1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:29.561769 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa5ad4c-80ac-4c2d-9337-99191c92db1c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:29.579001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 382/744] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:29.579001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5ad4c-80ac-4c2d-9337-99191c92db1c None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:29.617284 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:29.623696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c20d1b-46a0-4efa-92df-6850d6884416 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:29.660558 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aaa998-1851-4be1-8d39-513386d32878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:29.661168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaa998-1851-4be1-8d39-513386d32878 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:29.661449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaa998-1851-4be1-8d39-513386d32878 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:29.661719 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaa998-1851-4be1-8d39-513386d32878 None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:29.662360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aaa998-1851-4be1-8d39-513386d32878 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:29.662662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aaa998-1851-4be1-8d39-513386d32878 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:29.664028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aaa998-1851-4be1-8d39-513386d32878 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:29.676485 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 363/745] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:29.677326 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aaa998-1851-4be1-8d39-513386d32878 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:29.694889 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5ad4c-80ac-4c2d-9337-99191c92db1c None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:29.702401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:29.734102 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b05bd-5e77-4b1e-95b9-bce3223eb906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:29.734722 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b05bd-5e77-4b1e-95b9-bce3223eb906 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:29.734998 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b05bd-5e77-4b1e-95b9-bce3223eb906 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:29.735267 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b05bd-5e77-4b1e-95b9-bce3223eb906 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:29.735918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b05bd-5e77-4b1e-95b9-bce3223eb906 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:29.737328 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b05bd-5e77-4b1e-95b9-bce3223eb906 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:29.753958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 383/746] 10.222.0.69 () {60 vars in 1141 bytes} [Mon Aug 29 21:26:29 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:26:29.761248 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b05bd-5e77-4b1e-95b9-bce3223eb906 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:29.798382 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aaa998-1851-4be1-8d39-513386d32878 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:29.846955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8bceae-0e5c-4fbd-811a-6e445ac89bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:29.847739 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bceae-0e5c-4fbd-811a-6e445ac89bff None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:29.847920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bceae-0e5c-4fbd-811a-6e445ac89bff None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:29.848218 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bceae-0e5c-4fbd-811a-6e445ac89bff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:29.862389 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8bceae-0e5c-4fbd-811a-6e445ac89bff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:29.863175 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8bceae-0e5c-4fbd-811a-6e445ac89bff None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:29.880446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-8b8bceae-0e5c-4fbd-811a-6e445ac89bff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:29.880446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:29.880446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:29.880446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:29.880446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:29.880446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:29.880446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:29.880446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:29.880446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:29.880446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:29.880446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:29.880446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:29.880446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:29.880446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:29.880446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:29.880446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:29.881464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:29.881464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:29.881464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:29.881464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:29.881464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:29.881464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:29.881464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:29.881464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:29.881464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:29.881464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:29.881464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:29.881464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:29.881464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:29.881464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:29.881464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:29.881464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:29.881464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:29.882395 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:29.882395 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:29.882395 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:29.882395 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 364/747] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:29.882889 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8bceae-0e5c-4fbd-811a-6e445ac89bff None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:29.891664 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:29.902814 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b05bd-5e77-4b1e-95b9-bce3223eb906 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:29.946293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77261a-4db3-4523-af05-2eb8d908bc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:29.946941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77261a-4db3-4523-af05-2eb8d908bc0d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:29.947800 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77261a-4db3-4523-af05-2eb8d908bc0d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:29.948024 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77261a-4db3-4523-af05-2eb8d908bc0d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:29.956074 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77261a-4db3-4523-af05-2eb8d908bc0d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:29.958185 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77261a-4db3-4523-af05-2eb8d908bc0d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:29.969849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-4b77261a-4db3-4523-af05-2eb8d908bc0d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:26:29.969849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:29.969849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:29.969849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:29.969849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:29.969849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:29.969849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:29.969849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:29.969849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:29.969849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:29.969849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:29.969849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:29.969849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:29.969849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:29.969849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:29.969849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:29.970849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:29.970849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:29.970849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:29.970849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:29.970849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:29.970849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:29.970849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:29.970849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:29.970849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:29.970849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:29.970849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:29.970849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:29.970849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:29.970849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:29.970849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:29.970849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:29.970849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:29.970849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:29.971851 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:29.971851 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:29.971851 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:29.971851 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:29.971851 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:29.971851 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:29.971851 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:29.971851 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:29.971851 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:26:29.971851 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:29.971851 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 384/748] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:26:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:29.971851 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77261a-4db3-4523-af05-2eb8d908bc0d None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:30.005116 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:30.052825 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8bceae-0e5c-4fbd-811a-6e445ac89bff None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:30.088146 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35765675-d53b-405f-a928-58fdd4d08e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:30.089534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35765675-d53b-405f-a928-58fdd4d08e44 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:30.089999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35765675-d53b-405f-a928-58fdd4d08e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:30.090453 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35765675-d53b-405f-a928-58fdd4d08e44 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:30.096257 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77261a-4db3-4523-af05-2eb8d908bc0d None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:30.099003 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35765675-d53b-405f-a928-58fdd4d08e44 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:30.100755 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35765675-d53b-405f-a928-58fdd4d08e44 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:30.113448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-35765675-d53b-405f-a928-58fdd4d08e44 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:26:30.113448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:30.113448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:30.113448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:30.113448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:30.113448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:30.113448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:30.113448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:30.113448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:30.113448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:30.113448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:30.113448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:30.113448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:30.113448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:30.113448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:30.113448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:30.114446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:30.114446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:30.114446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:30.114446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:30.114446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:30.114446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:30.114446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:30.114446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:30.114446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:30.114446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:30.114446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:30.114446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:30.114446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:30.114446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:30.114446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:30.114446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:30.114446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:30.114446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:30.115402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:30.115402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:30.115402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:30.115402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:30.115402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:30.115402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:30.115402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:30.115402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:30.115402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:26:30.115402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:30.118336 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 365/749] 10.222.0.69 () {56 vars in 1093 bytes} [Mon Aug 29 21:26:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:30.119583 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35765675-d53b-405f-a928-58fdd4d08e44 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:30.143557 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e02d4-dd93-41d0-b8e2-45af7c9bf79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:30.144577 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e02d4-dd93-41d0-b8e2-45af7c9bf79a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:30.145085 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e02d4-dd93-41d0-b8e2-45af7c9bf79a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:30.145578 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e02d4-dd93-41d0-b8e2-45af7c9bf79a None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:30.146470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e02d4-dd93-41d0-b8e2-45af7c9bf79a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:30.146981 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e02d4-dd93-41d0-b8e2-45af7c9bf79a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:30.148595 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e02d4-dd93-41d0-b8e2-45af7c9bf79a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:30.166734 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 385/750] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:30.167998 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e02d4-dd93-41d0-b8e2-45af7c9bf79a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:30.201702 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:30.248474 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35765675-d53b-405f-a928-58fdd4d08e44 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:30.292125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:30.302315 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe89db-1752-4021-8404-1e143bde2192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:30.303094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe89db-1752-4021-8404-1e143bde2192 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:30.303380 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe89db-1752-4021-8404-1e143bde2192 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:30.303655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe89db-1752-4021-8404-1e143bde2192 None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:30.304433 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe89db-1752-4021-8404-1e143bde2192 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:30.304982 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe89db-1752-4021-8404-1e143bde2192 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:30.307230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe89db-1752-4021-8404-1e143bde2192 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:30.312099 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e02d4-dd93-41d0-b8e2-45af7c9bf79a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:30.332218 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 366/751] 10.222.0.69 () {56 vars in 1135 bytes} [Mon Aug 29 21:26:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:30.333159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe89db-1752-4021-8404-1e143bde2192 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:30.353524 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1156e4f-a504-47a4-8b29-c092f7aff65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:30.355191 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1156e4f-a504-47a4-8b29-c092f7aff65a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:30.355707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1156e4f-a504-47a4-8b29-c092f7aff65a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:30.356264 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1156e4f-a504-47a4-8b29-c092f7aff65a None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:30.357595 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1156e4f-a504-47a4-8b29-c092f7aff65a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:30.358120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1156e4f-a504-47a4-8b29-c092f7aff65a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:30.359874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1156e4f-a504-47a4-8b29-c092f7aff65a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:30.385055 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 386/752] 10.222.0.69 () {56 vars in 1133 bytes} [Mon Aug 29 21:26:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:30.386365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1156e4f-a504-47a4-8b29-c092f7aff65a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:30.462881 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe89db-1752-4021-8404-1e143bde2192 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:30.489662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:30.505502 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ae9df-f27b-4ae9-97b4-37686ade1c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:30.506591 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ae9df-f27b-4ae9-97b4-37686ade1c54 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:30.507099 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ae9df-f27b-4ae9-97b4-37686ade1c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:30.507584 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ae9df-f27b-4ae9-97b4-37686ade1c54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:30.516618 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ae9df-f27b-4ae9-97b4-37686ade1c54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:30.518444 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ae9df-f27b-4ae9-97b4-37686ade1c54 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:30.523737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1156e4f-a504-47a4-8b29-c092f7aff65a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:30.530928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-651ae9df-f27b-4ae9-97b4-37686ade1c54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:30.530928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:30.530928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:30.530928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:30.530928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:30.530928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:30.530928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:30.530928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:30.530928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:30.530928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:30.530928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:30.530928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:30.530928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:30.530928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:30.530928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:30.531832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:30.531832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:30.531832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:30.531832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:30.531832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:30.531832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:30.531832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:30.531832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:30.531832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:30.531832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:30.531832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:30.531832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:30.531832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:30.531832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:30.531832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:30.531832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:30.531832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:30.532784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:30.532784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:30.532784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:30.532784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:30.532784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:30.532784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:30.532784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:30.532784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:30.539580 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 367/753] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:30.541353 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ae9df-f27b-4ae9-97b4-37686ade1c54 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:30.566634 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b4434-2740-43e7-b12d-254f53efdb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:30.567254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b4434-2740-43e7-b12d-254f53efdb72 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:30.567537 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b4434-2740-43e7-b12d-254f53efdb72 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:30.567812 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b4434-2740-43e7-b12d-254f53efdb72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:30.587987 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:30.653070 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ae9df-f27b-4ae9-97b4-37686ade1c54 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:30.667646 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b4434-2740-43e7-b12d-254f53efdb72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:30.669780 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b4434-2740-43e7-b12d-254f53efdb72 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:30.694408 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ac848-e51c-4da6-82ad-9e7f542cd2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:30.695052 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ac848-e51c-4da6-82ad-9e7f542cd2a4 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:30.695360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ac848-e51c-4da6-82ad-9e7f542cd2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:30.696153 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ac848-e51c-4da6-82ad-9e7f542cd2a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:30.712310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ac848-e51c-4da6-82ad-9e7f542cd2a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:30.713925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ac848-e51c-4da6-82ad-9e7f542cd2a4 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:30.733931 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-a77ac848-e51c-4da6-82ad-9e7f542cd2a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:30.733931 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:30.733931 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:30.733931 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:30.733931 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:30.733931 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:30.733931 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:30.733931 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:30.733931 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:30.733931 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:30.733931 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:30.733931 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:30.733931 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:30.733931 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:30.733931 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:30.733931 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:30.734948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:30.734948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:30.734948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:30.734948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:30.734948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:30.734948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:30.734948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:30.734948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:30.734948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:30.734948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:30.734948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:30.734948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:30.734948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:30.734948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:30.734948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:30.734948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:30.734948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:30.735860 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:30.735860 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:30.735860 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:30.735860 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 368/754] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:30.741084 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ac848-e51c-4da6-82ad-9e7f542cd2a4 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:30.778054 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:30.812239 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 387/755] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:26:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:26:30.812239 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b4434-2740-43e7-b12d-254f53efdb72 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:30.857947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ac848-e51c-4da6-82ad-9e7f542cd2a4 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:30.868350 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:30.896510 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0443a-11d9-4e12-9260-bec9cfb387ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:30.897361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0443a-11d9-4e12-9260-bec9cfb387ea None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:30.897749 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0443a-11d9-4e12-9260-bec9cfb387ea None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:30.898117 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0443a-11d9-4e12-9260-bec9cfb387ea None admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:30.898919 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0443a-11d9-4e12-9260-bec9cfb387ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:30.899318 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0443a-11d9-4e12-9260-bec9cfb387ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:30.900953 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0443a-11d9-4e12-9260-bec9cfb387ea None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:30.914443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 369/756] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:30.915495 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0443a-11d9-4e12-9260-bec9cfb387ea None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:30.944806 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b4434-2740-43e7-b12d-254f53efdb72 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:30.985642 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d3074-a32e-4c03-b23d-cb7a64f4bd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:30.986647 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d3074-a32e-4c03-b23d-cb7a64f4bd4f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:30.987266 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d3074-a32e-4c03-b23d-cb7a64f4bd4f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:30.987632 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d3074-a32e-4c03-b23d-cb7a64f4bd4f None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:30.988699 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d3074-a32e-4c03-b23d-cb7a64f4bd4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:30.989439 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d3074-a32e-4c03-b23d-cb7a64f4bd4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:30.991506 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d3074-a32e-4c03-b23d-cb7a64f4bd4f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:31.007459 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 388/757] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:31.008977 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d3074-a32e-4c03-b23d-cb7a64f4bd4f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:31.033050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:31.042145 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0443a-11d9-4e12-9260-bec9cfb387ea None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:31.084008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f9858-a0c5-4d18-a263-8578d062460a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:31.084812 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f9858-a0c5-4d18-a263-8578d062460a None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:31.085285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f9858-a0c5-4d18-a263-8578d062460a None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:31.085655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f9858-a0c5-4d18-a263-8578d062460a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:31.097486 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f9858-a0c5-4d18-a263-8578d062460a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:31.099807 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f9858-a0c5-4d18-a263-8578d062460a None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:31.118177 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-6f3f9858-a0c5-4d18-a263-8578d062460a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:31.118177 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:31.118177 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:31.118177 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:31.118177 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:31.118177 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:31.118177 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:31.118177 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:31.118177 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:31.118177 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:31.118177 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:31.118177 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:31.118177 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:31.118177 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:31.118177 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:31.118177 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:31.119481 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:31.119481 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:31.119481 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:31.119481 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:31.119481 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:31.119481 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:31.119481 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:31.119481 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:31.119481 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:31.119481 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:31.119481 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:31.119481 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:31.119481 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:31.119481 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:31.119481 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:31.119481 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:31.119481 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:31.120664 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:31.120664 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:31.120664 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:31.126143 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 370/758] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:31.127119 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f9858-a0c5-4d18-a263-8578d062460a None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:31.139282 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d3074-a32e-4c03-b23d-cb7a64f4bd4f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:31.141914 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:31.179295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb871d-bb4e-4a94-b22f-ca64d4478893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:31.180003 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb871d-bb4e-4a94-b22f-ca64d4478893 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:31.180318 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb871d-bb4e-4a94-b22f-ca64d4478893 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:31.180593 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb871d-bb4e-4a94-b22f-ca64d4478893 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:31.181557 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb871d-bb4e-4a94-b22f-ca64d4478893 None admin] RBAC: Adding query filter params (role.id=3766508ffa094bb5bbec6d9209745261, scope.project.id=a302406c548c43c983625c0d66da47cc, user.id=540e06e694524c4a9e84ebebd45956d6) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:31.181879 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb871d-bb4e-4a94-b22f-ca64d4478893 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:31.183318 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb871d-bb4e-4a94-b22f-ca64d4478893 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:31.190176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 389/759] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:26:31 2022] GET /identity/v3/role_assignments?user.id=540e06e694524c4a9e84ebebd45956d6&scope.project.id=a302406c548c43c983625c0d66da47cc&role.id=3766508ffa094bb5bbec6d9209745261 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:31.191162 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb871d-bb4e-4a94-b22f-ca64d4478893 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:31.238785 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f9858-a0c5-4d18-a263-8578d062460a None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:31.282383 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5e091-db89-4ed8-8cc0-2c25cd792b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:31.283578 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5e091-db89-4ed8-8cc0-2c25cd792b92 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:31.284098 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5e091-db89-4ed8-8cc0-2c25cd792b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:31.284655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5e091-db89-4ed8-8cc0-2c25cd792b92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:31.294976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5e091-db89-4ed8-8cc0-2c25cd792b92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:31.296537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5e091-db89-4ed8-8cc0-2c25cd792b92 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:31.308890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-d4d5e091-db89-4ed8-8cc0-2c25cd792b92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:31.308890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:31.308890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:31.308890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:31.308890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:31.308890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:31.308890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:31.308890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:31.308890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:31.308890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:31.308890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:31.308890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:31.308890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:31.308890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:31.308890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:31.309879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:31.309879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:31.309879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:31.309879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:31.309879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:31.309879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:31.309879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:31.309879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:31.309879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:31.309879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:31.309879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:31.309879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:31.309879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:31.309879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:31.309879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:31.309879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:31.309879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:31.310786 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:31.310786 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:31.310786 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:31.310786 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:31.310786 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:31.310786 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:31.310786 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:31.310786 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:31.310786 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 371/760] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:31.314903 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb871d-bb4e-4a94-b22f-ca64d4478893 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:31.317785 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5e091-db89-4ed8-8cc0-2c25cd792b92 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:31.333202 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:31.355998 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444c119-1cad-4ab3-aea2-5fcf80c1d6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:31.356904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444c119-1cad-4ab3-aea2-5fcf80c1d6cc None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:31.357194 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444c119-1cad-4ab3-aea2-5fcf80c1d6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:31.357465 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444c119-1cad-4ab3-aea2-5fcf80c1d6cc None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:31.358194 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444c119-1cad-4ab3-aea2-5fcf80c1d6cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:31.358503 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444c119-1cad-4ab3-aea2-5fcf80c1d6cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:31.359911 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444c119-1cad-4ab3-aea2-5fcf80c1d6cc None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:31.378230 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 390/761] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:31.382698 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444c119-1cad-4ab3-aea2-5fcf80c1d6cc None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:31.419658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:31.480729 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5e091-db89-4ed8-8cc0-2c25cd792b92 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:31.514957 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444c119-1cad-4ab3-aea2-5fcf80c1d6cc None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:31.527345 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c5d4e-81a7-4686-b28b-fc99eda31b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:31.527974 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c5d4e-81a7-4686-b28b-fc99eda31b23 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:31.528293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c5d4e-81a7-4686-b28b-fc99eda31b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:31.529043 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c5d4e-81a7-4686-b28b-fc99eda31b23 None admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:31.529774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c5d4e-81a7-4686-b28b-fc99eda31b23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:31.530084 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c5d4e-81a7-4686-b28b-fc99eda31b23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:31.531970 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c5d4e-81a7-4686-b28b-fc99eda31b23 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:31.549284 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 372/762] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:31.551325 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c65fc-2059-46fe-8bdd-5deaac6b9737 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:31.551325 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c65fc-2059-46fe-8bdd-5deaac6b9737 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:31.551325 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c65fc-2059-46fe-8bdd-5deaac6b9737 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:31.558090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 373/763] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:31.558090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c65fc-2059-46fe-8bdd-5deaac6b9737 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:31.565462 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534c701-dae0-49b1-b581-59ba3a0d6462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:31.566934 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534c701-dae0-49b1-b581-59ba3a0d6462 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:31.567446 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534c701-dae0-49b1-b581-59ba3a0d6462 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:31.567866 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534c701-dae0-49b1-b581-59ba3a0d6462 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:31.578978 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534c701-dae0-49b1-b581-59ba3a0d6462 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:31.580870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534c701-dae0-49b1-b581-59ba3a0d6462 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:31.597097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-b534c701-dae0-49b1-b581-59ba3a0d6462 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:31.597097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:31.597097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:31.597097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:31.597097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:31.597097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:31.597097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:31.597097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:31.597097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:31.597097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:31.597097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:31.597097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:31.597097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:31.597097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:31.597097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:31.598127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:31.598127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:31.598127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:31.598127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:31.598127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:31.598127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:31.598127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:31.598127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:31.598127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:31.598127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:31.598127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:31.598127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:31.598127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:31.598127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:31.598127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:31.598127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:31.598127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:31.599017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:31.599017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:31.599017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:31.599017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:31.599017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:31.599017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:31.599017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:31.599017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:31.601500 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 391/764] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:31.602889 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc3458-8cc9-4ca0-82d3-817a9fcac2ec None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:31.603369 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc3458-8cc9-4ca0-82d3-817a9fcac2ec None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:31.603798 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc3458-8cc9-4ca0-82d3-817a9fcac2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:31.628718 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-2ccc3458-8cc9-4ca0-82d3-817a9fcac2ec None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:31.630360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2ccc3458-8cc9-4ca0-82d3-817a9fcac2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:31.659198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:31.704125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 392/765] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:26:31.705387 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc3458-8cc9-4ca0-82d3-817a9fcac2ec None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:31.725037 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c65fc-2059-46fe-8bdd-5deaac6b9737 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:31.725785 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:31.793073 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e655c51-78e1-4f6a-9df2-0d70dea89c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:31.794105 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e655c51-78e1-4f6a-9df2-0d70dea89c92 None admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:31.794604 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e655c51-78e1-4f6a-9df2-0d70dea89c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:31.795078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e655c51-78e1-4f6a-9df2-0d70dea89c92 None admin] PATH_INFO: `/v3/projects/a302406c548c43c983625c0d66da47cc/users/96c35c544cae4ad187f1a1be723e0d21/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:31.798693 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e655c51-78e1-4f6a-9df2-0d70dea89c92 None admin] RBAC: Authorizing `identity:create_grant(project_id=a302406c548c43c983625c0d66da47cc, user_id=96c35c544cae4ad187f1a1be723e0d21, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:31.801780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e655c51-78e1-4f6a-9df2-0d70dea89c92 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:31.824263 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 374/766] 10.222.0.69 () {58 vars in 1439 bytes} [Mon Aug 29 21:26:31 2022] PUT /identity/v3/projects/a302406c548c43c983625c0d66da47cc/users/96c35c544cae4ad187f1a1be723e0d21/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:26:31.857318 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc3458-8cc9-4ca0-82d3-817a9fcac2ec None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:31.909054 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2a98e-6cbc-4bfb-9cf4-f27f3fdd5a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:31.910082 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2a98e-6cbc-4bfb-9cf4-f27f3fdd5a13 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:31.910706 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2a98e-6cbc-4bfb-9cf4-f27f3fdd5a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:31.911231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2a98e-6cbc-4bfb-9cf4-f27f3fdd5a13 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:31.912133 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2a98e-6cbc-4bfb-9cf4-f27f3fdd5a13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:31.912665 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2a98e-6cbc-4bfb-9cf4-f27f3fdd5a13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:31.914295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2a98e-6cbc-4bfb-9cf4-f27f3fdd5a13 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:31.932594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdd290-caf5-498c-82e2-59b1a20c8d1d None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:31.933222 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdd290-caf5-498c-82e2-59b1a20c8d1d None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:31.933700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdd290-caf5-498c-82e2-59b1a20c8d1d None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:31.935433 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 375/767] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:26:31.939265 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 393/768] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:31.941003 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb098e63-5f28-441a-962e-4c5064d5ac9b None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:31.941296 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb098e63-5f28-441a-962e-4c5064d5ac9b None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:31.941579 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb098e63-5f28-441a-962e-4c5064d5ac9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:31.945584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2a98e-6cbc-4bfb-9cf4-f27f3fdd5a13 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:31.963992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-bb098e63-5f28-441a-962e-4c5064d5ac9b None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:31.965328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-bb098e63-5f28-441a-962e-4c5064d5ac9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:32.051750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 376/769] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:26:32.089082 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:32.115255 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2a98e-6cbc-4bfb-9cf4-f27f3fdd5a13 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:32.117289 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb098e63-5f28-441a-962e-4c5064d5ac9b None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:32.179625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292862bb-4109-42ad-be87-68c4b52c1351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:32.180677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292862bb-4109-42ad-be87-68c4b52c1351 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:32.181164 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292862bb-4109-42ad-be87-68c4b52c1351 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:32.181759 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292862bb-4109-42ad-be87-68c4b52c1351 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:32.182703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292862bb-4109-42ad-be87-68c4b52c1351 None admin] RBAC: Adding query filter params (role.id=69369872661e4179bb51cd1ca76e28c3, scope.project.id=a302406c548c43c983625c0d66da47cc, user.id=714a2ba019144211931dbe853f1960aa) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:32.183269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292862bb-4109-42ad-be87-68c4b52c1351 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:32.185008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292862bb-4109-42ad-be87-68c4b52c1351 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:32.194124 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 394/770] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:26:31 2022] GET /identity/v3/role_assignments?user.id=714a2ba019144211931dbe853f1960aa&scope.project.id=a302406c548c43c983625c0d66da47cc&role.id=69369872661e4179bb51cd1ca76e28c3 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:32.249039 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:32.327599 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb098e63-5f28-441a-962e-4c5064d5ac9b None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:32.337251 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292862bb-4109-42ad-be87-68c4b52c1351 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:32.391912 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95607b-0d51-425a-92ed-81ddf3bdf727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:32.392572 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95607b-0d51-425a-92ed-81ddf3bdf727 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:32.392855 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95607b-0d51-425a-92ed-81ddf3bdf727 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:32.393133 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95607b-0d51-425a-92ed-81ddf3bdf727 None admin] PATH_INFO: `/v3/services/network` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:32.393738 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95607b-0d51-425a-92ed-81ddf3bdf727 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:32.395263 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95607b-0d51-425a-92ed-81ddf3bdf727 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:32.412725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-3d95607b-0d51-425a-92ed-81ddf3bdf727 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:26:32.412725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:32.412725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:26:32.412725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:26:32.412725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:26:32.412725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:26:32.412725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:26:32.412725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:32.412725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:26:32.412725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:32.412725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:26:32.412725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:32.412725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:32.412725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:32.412725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:32.412725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:32.412725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:32.413787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:32.413787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:32.413787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:32.413787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:32.413787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:32.413787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:32.413787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:26:32.413787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:26:32.413787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:26:32.413787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:26:32.413787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:32.413787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:32.413787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:32.413787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:32.413787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:32.413787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:32.414644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:32.414644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:32.414644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:32.414644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:32.414644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:32.414644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:32.414644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:32.414644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:32.414644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:32.414644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:32.414644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:26:32.414644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:32.414644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:26:32.414644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:32.414644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 377/771] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:32 2022] GET /identity/v3/services/network => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:26:32.423669 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95607b-0d51-425a-92ed-81ddf3bdf727 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:32.488052 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292862bb-4109-42ad-be87-68c4b52c1351 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:32.557812 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18649e7-7989-48f6-b211-f138f4fde1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:32.558461 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18649e7-7989-48f6-b211-f138f4fde1ae None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:32.558746 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18649e7-7989-48f6-b211-f138f4fde1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:32.559021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18649e7-7989-48f6-b211-f138f4fde1ae None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:32.559664 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18649e7-7989-48f6-b211-f138f4fde1ae None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:32.561075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18649e7-7989-48f6-b211-f138f4fde1ae None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:32.576106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-e18649e7-7989-48f6-b211-f138f4fde1ae None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:26:32.576106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:32.576106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:26:32.576106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:26:32.576106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:26:32.576106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:26:32.576106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:26:32.576106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:32.576106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:26:32.576106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:32.576106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:26:32.576106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:32.576106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:32.576106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:32.576106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:32.576106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:32.576106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:32.577179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:32.577179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:32.577179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:32.577179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:32.577179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:32.577179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:32.577179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:26:32.577179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:26:32.577179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:26:32.577179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:26:32.577179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:32.577179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:32.577179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:32.577179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:32.577179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:32.577179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:32.578075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:32.578075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:32.578075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:32.578075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:32.578075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:32.578075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:32.578075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:32.578075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:32.578075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:32.578075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:32.578075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:26:32.578075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:32.578075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:26:32.578075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:32.578075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 395/772] 10.222.0.69 () {56 vars in 1129 bytes} [Mon Aug 29 21:26:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:26:32.584145 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18649e7-7989-48f6-b211-f138f4fde1ae None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:32.605464 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:32.608118 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95607b-0d51-425a-92ed-81ddf3bdf727 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:32.631415 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:32.646620 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3dd5ea-d057-4a5f-9227-95d70d13a307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:32.647394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dd5ea-d057-4a5f-9227-95d70d13a307 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:32.647777 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dd5ea-d057-4a5f-9227-95d70d13a307 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:32.648151 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dd5ea-d057-4a5f-9227-95d70d13a307 None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:32.648919 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3dd5ea-d057-4a5f-9227-95d70d13a307 None admin] RBAC: Adding query filter params (name=network) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:32.649323 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3dd5ea-d057-4a5f-9227-95d70d13a307 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:32.651322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3dd5ea-d057-4a5f-9227-95d70d13a307 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:32.657190 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 378/773] 10.222.0.69 () {56 vars in 1112 bytes} [Mon Aug 29 21:26:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:32.662651 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3dd5ea-d057-4a5f-9227-95d70d13a307 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:32.811290 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18649e7-7989-48f6-b211-f138f4fde1ae None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:32.836549 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3dd5ea-d057-4a5f-9227-95d70d13a307 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:32.878535 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ab3f8-4873-402a-935e-fbc56567db90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:32.879648 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ab3f8-4873-402a-935e-fbc56567db90 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:32.880163 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ab3f8-4873-402a-935e-fbc56567db90 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:32.880693 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ab3f8-4873-402a-935e-fbc56567db90 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:32.881775 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ab3f8-4873-402a-935e-fbc56567db90 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:32.882298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ab3f8-4873-402a-935e-fbc56567db90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:32.883908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ab3f8-4873-402a-935e-fbc56567db90 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:32.895263 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 396/774] 10.222.0.69 () {56 vars in 1124 bytes} [Mon Aug 29 21:26:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:32.899689 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ab3f8-4873-402a-935e-fbc56567db90 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:32.904944 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83446f25-8b3b-438b-a06f-6953952e8e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:32.909080 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83446f25-8b3b-438b-a06f-6953952e8e9a None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:32.909574 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83446f25-8b3b-438b-a06f-6953952e8e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:32.910072 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83446f25-8b3b-438b-a06f-6953952e8e9a None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:32.910919 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83446f25-8b3b-438b-a06f-6953952e8e9a None admin] RBAC: Adding query filter params (type=network) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:32.911423 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83446f25-8b3b-438b-a06f-6953952e8e9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:32.913117 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83446f25-8b3b-438b-a06f-6953952e8e9a None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:32.926439 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 379/775] 10.222.0.69 () {56 vars in 1112 bytes} [Mon Aug 29 21:26:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:32.933384 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83446f25-8b3b-438b-a06f-6953952e8e9a None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:33.023944 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:33.049762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:33.079086 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ab3f8-4873-402a-935e-fbc56567db90 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:33.127699 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a07d6-8059-4173-9c0d-6f7093d422ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:33.129249 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a07d6-8059-4173-9c0d-6f7093d422ac None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:33.129392 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a07d6-8059-4173-9c0d-6f7093d422ac None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:33.129650 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a07d6-8059-4173-9c0d-6f7093d422ac None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:33.130285 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a07d6-8059-4173-9c0d-6f7093d422ac None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:33.130585 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a07d6-8059-4173-9c0d-6f7093d422ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:33.131963 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a07d6-8059-4173-9c0d-6f7093d422ac None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:33.147379 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 397/776] 10.222.0.69 () {56 vars in 1124 bytes} [Mon Aug 29 21:26:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:33.154064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a07d6-8059-4173-9c0d-6f7093d422ac None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:33.160293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83446f25-8b3b-438b-a06f-6953952e8e9a None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:33.273049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c95cbb-7839-4d98-8e76-3a4b9fe57d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:33.273693 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c95cbb-7839-4d98-8e76-3a4b9fe57d4a None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:33.273971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c95cbb-7839-4d98-8e76-3a4b9fe57d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:33.274244 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c95cbb-7839-4d98-8e76-3a4b9fe57d4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:33.274966 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c95cbb-7839-4d98-8e76-3a4b9fe57d4a None admin] RBAC: Adding query filter params (interface=public, service_id=1d94b153175c41708d5db266c577a241, region_id=RegionOne) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:33.275923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c95cbb-7839-4d98-8e76-3a4b9fe57d4a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:33.277355 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c95cbb-7839-4d98-8e76-3a4b9fe57d4a None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:33.286520 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a07d6-8059-4173-9c0d-6f7093d422ac None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:33.291852 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 380/777] 10.222.0.69 () {56 vars in 1251 bytes} [Mon Aug 29 21:26:32 2022] GET /identity/v3/endpoints?service_id=1d94b153175c41708d5db266c577a241&interface=public®ion_id=RegionOne => generated 194 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:33.297431 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c95cbb-7839-4d98-8e76-3a4b9fe57d4a None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:33.325188 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab2336-9c5d-4821-b95c-fbcc138089b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:33.325804 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab2336-9c5d-4821-b95c-fbcc138089b3 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:33.326115 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab2336-9c5d-4821-b95c-fbcc138089b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:33.326397 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab2336-9c5d-4821-b95c-fbcc138089b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:33.327103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab2336-9c5d-4821-b95c-fbcc138089b3 None admin] RBAC: Adding query filter params (interface=public, service_id=55fcdbca44d14c8da5c5d03c8a51b50f, region_id=RegionOne) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:33.327408 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab2336-9c5d-4821-b95c-fbcc138089b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:33.328815 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab2336-9c5d-4821-b95c-fbcc138089b3 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:33.330734 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:33.337989 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 398/778] 10.222.0.69 () {56 vars in 1251 bytes} [Mon Aug 29 21:26:33 2022] GET /identity/v3/endpoints?service_id=55fcdbca44d14c8da5c5d03c8a51b50f&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:33.349377 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab2336-9c5d-4821-b95c-fbcc138089b3 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:33.470888 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c95cbb-7839-4d98-8e76-3a4b9fe57d4a None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:33.489265 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:33.508018 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab2336-9c5d-4821-b95c-fbcc138089b3 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:33.522411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0432bc-0105-4ab1-9309-a6b353200a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:33.523121 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0432bc-0105-4ab1-9309-a6b353200a14 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:33.523675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0432bc-0105-4ab1-9309-a6b353200a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:33.524015 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0432bc-0105-4ab1-9309-a6b353200a14 None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:33.525192 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0432bc-0105-4ab1-9309-a6b353200a14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:33.527761 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0432bc-0105-4ab1-9309-a6b353200a14 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:33.535131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 381/779] 10.222.0.69 () {56 vars in 1087 bytes} [Mon Aug 29 21:26:33 2022] GET /identity/v3/services => generated 772 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:33.537288 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4afcee-9f2e-4444-b9b9-ee3821943092 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:33.537645 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4afcee-9f2e-4444-b9b9-ee3821943092 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:33.538262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4afcee-9f2e-4444-b9b9-ee3821943092 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:33.540764 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 382/780] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:33.546590 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588a0f2-ed37-4467-8efa-a22b033709c0 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:33.546879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588a0f2-ed37-4467-8efa-a22b033709c0 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:33.547159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588a0f2-ed37-4467-8efa-a22b033709c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:33.551522 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b46a88-f254-4092-9e31-972db94da874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:33.552561 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b46a88-f254-4092-9e31-972db94da874 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:33.552947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b46a88-f254-4092-9e31-972db94da874 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:33.553348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b46a88-f254-4092-9e31-972db94da874 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:33.554284 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b46a88-f254-4092-9e31-972db94da874 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:33.555973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b46a88-f254-4092-9e31-972db94da874 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:33.562995 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 399/781] 10.222.0.69 () {56 vars in 1087 bytes} [Mon Aug 29 21:26:33 2022] GET /identity/v3/services => generated 772 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:33.567065 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-3588a0f2-ed37-4467-8efa-a22b033709c0 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:33.568441 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-3588a0f2-ed37-4467-8efa-a22b033709c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:33.652407 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 383/782] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:26:33.941455 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b46a88-f254-4092-9e31-972db94da874 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:34.029236 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:34.088121 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b46a88-f254-4092-9e31-972db94da874 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:34.127970 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87985063-5e4b-432b-b887-6ccc1b693011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:34.129428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87985063-5e4b-432b-b887-6ccc1b693011 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:34.129931 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87985063-5e4b-432b-b887-6ccc1b693011 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:34.130411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87985063-5e4b-432b-b887-6ccc1b693011 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:34.142664 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87985063-5e4b-432b-b887-6ccc1b693011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:34.148608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-87985063-5e4b-432b-b887-6ccc1b693011 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:34.148608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:34.148608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:34.148608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:34.148608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:34.148608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:34.148608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:34.148608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:34.148608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:34.148608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:34.148608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:34.148608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:34.148608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:34.148608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:34.148608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:34.148608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:34.149568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:34.149568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:34.149568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:34.149568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:34.149568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:34.149568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:34.149568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:34.149568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:34.149568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:34.149568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:34.149568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:34.149568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:34.149568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:34.149568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:34.149568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:34.149568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:34.150793 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:34.150793 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:34.150793 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:34.150793 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:34.150793 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:34.150793 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:34.150793 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:34.150793 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:34.150793 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:34.150793 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:34.150793 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:34.150793 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:34.153743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 400/783] 10.222.0.69 () {56 vars in 1102 bytes} [Mon Aug 29 21:26:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:34.159458 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588a0f2-ed37-4467-8efa-a22b033709c0 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:34.239145 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbb8ea-f67e-48c6-ade6-6e33039e5938 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:34.239756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbb8ea-f67e-48c6-ade6-6e33039e5938 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:34.240367 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbb8ea-f67e-48c6-ade6-6e33039e5938 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:34.242290 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 401/784] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:34.247974 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bbcb0-24e1-402f-a77e-61c66fe3622a None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:34.248554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bbcb0-24e1-402f-a77e-61c66fe3622a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:34.249023 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bbcb0-24e1-402f-a77e-61c66fe3622a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:34.288923 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-aa9bbcb0-24e1-402f-a77e-61c66fe3622a None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:34.290212 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-aa9bbcb0-24e1-402f-a77e-61c66fe3622a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:34.339695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588a0f2-ed37-4467-8efa-a22b033709c0 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:34.354063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:34.411327 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cce1aa-ee6a-4e8b-93e7-ecb12d74e336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:34.412014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cce1aa-ee6a-4e8b-93e7-ecb12d74e336 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:34.412337 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cce1aa-ee6a-4e8b-93e7-ecb12d74e336 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:34.412615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cce1aa-ee6a-4e8b-93e7-ecb12d74e336 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:34.413348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cce1aa-ee6a-4e8b-93e7-ecb12d74e336 None admin] RBAC: Adding query filter params (name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:34.413659 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cce1aa-ee6a-4e8b-93e7-ecb12d74e336 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:34.415038 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cce1aa-ee6a-4e8b-93e7-ecb12d74e336 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:34.429087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 402/786] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:26:34.429281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 384/786] 10.222.0.69 () {56 vars in 1103 bytes} [Mon Aug 29 21:26:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:34.432467 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bbcb0-24e1-402f-a77e-61c66fe3622a None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:34.528936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:34.588424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bbcb0-24e1-402f-a77e-61c66fe3622a None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:34.629949 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef666e15-c7e1-4259-bbb7-0c6ef384c9f7 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:34.630600 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef666e15-c7e1-4259-bbb7-0c6ef384c9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:34.631099 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef666e15-c7e1-4259-bbb7-0c6ef384c9f7 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:34.632937 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 385/787] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:34.639087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e43ca-1471-4c5a-987a-35136d587586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:34.639729 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e43ca-1471-4c5a-987a-35136d587586 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:34.640014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e43ca-1471-4c5a-987a-35136d587586 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:34.640321 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e43ca-1471-4c5a-987a-35136d587586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:34.651011 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e43ca-1471-4c5a-987a-35136d587586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:34.652506 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e43ca-1471-4c5a-987a-35136d587586 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:34.671254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-fe1e43ca-1471-4c5a-987a-35136d587586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:34.671254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:34.671254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:34.671254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:34.671254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:34.671254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:34.671254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:34.671254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:34.671254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:34.671254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:34.671254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:34.671254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:34.671254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:34.671254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:34.671254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:34.671254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:34.672316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:34.672316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:34.672316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:34.672316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:34.672316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:34.672316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:34.672316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:34.672316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:34.672316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:34.672316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:34.672316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:34.672316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:34.672316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:34.672316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:34.672316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:34.672316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:34.672316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:34.673262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:34.673262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:34.673262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:34.673262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 403/788] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:26:34.674310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf864c5-ef9e-42cc-8765-bb7c05e27fb9 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:34.674839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf864c5-ef9e-42cc-8765-bb7c05e27fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:34.675332 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf864c5-ef9e-42cc-8765-bb7c05e27fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:34.684618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e43ca-1471-4c5a-987a-35136d587586 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:34.818076 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-aaf864c5-ef9e-42cc-8765-bb7c05e27fb9 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:34.819252 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-aaf864c5-ef9e-42cc-8765-bb7c05e27fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:34.840902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e43ca-1471-4c5a-987a-35136d587586 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:34.844936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:34.891353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51672c98-2291-40db-87b6-66f8d1287db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:34.892508 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51672c98-2291-40db-87b6-66f8d1287db4 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:34.893026 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51672c98-2291-40db-87b6-66f8d1287db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:34.893504 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51672c98-2291-40db-87b6-66f8d1287db4 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:34.894375 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51672c98-2291-40db-87b6-66f8d1287db4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:34.894892 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51672c98-2291-40db-87b6-66f8d1287db4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:34.896513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51672c98-2291-40db-87b6-66f8d1287db4 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:34.897317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 386/789] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:26:34.898171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf864c5-ef9e-42cc-8765-bb7c05e27fb9 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:34.912319 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 404/790] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:34.918233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51672c98-2291-40db-87b6-66f8d1287db4 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:35.075451 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:35.082080 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf864c5-ef9e-42cc-8765-bb7c05e27fb9 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:35.123356 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51672c98-2291-40db-87b6-66f8d1287db4 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:35.153664 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f684d-83bb-458c-92f1-7bc0b95f3411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:35.154697 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f684d-83bb-458c-92f1-7bc0b95f3411 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:35.155180 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f684d-83bb-458c-92f1-7bc0b95f3411 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:35.155652 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f684d-83bb-458c-92f1-7bc0b95f3411 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:35.177973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f684d-83bb-458c-92f1-7bc0b95f3411 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:35.187689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-d17f684d-83bb-458c-92f1-7bc0b95f3411 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:26:35.187689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:35.187689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:35.187689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:35.187689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:35.187689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:35.187689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:35.187689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:35.187689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:35.187689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:35.187689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:35.187689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:35.187689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:35.187689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:35.187689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:35.187689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:35.188778 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:35.188778 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:35.188778 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:35.188778 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:35.188778 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:35.188778 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:35.188778 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:35.188778 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:35.188778 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:35.188778 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:35.188778 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:35.188778 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:35.188778 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:35.188778 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:35.188778 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:35.188778 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:35.190094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:35.190094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:35.190094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:35.190094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:35.190094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:35.190094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:35.190094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:35.190094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:35.190094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:35.190094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:35.190094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:26:35.190094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:35.190094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 387/791] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:26:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:35.190094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f684d-83bb-458c-92f1-7bc0b95f3411 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:35.195816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a1b1e-ac7f-4a43-bd5a-3ae981771611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:35.196491 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a1b1e-ac7f-4a43-bd5a-3ae981771611 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:35.196772 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a1b1e-ac7f-4a43-bd5a-3ae981771611 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:35.197047 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a1b1e-ac7f-4a43-bd5a-3ae981771611 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:35.211314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a1b1e-ac7f-4a43-bd5a-3ae981771611 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:35.213109 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a1b1e-ac7f-4a43-bd5a-3ae981771611 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:35.226570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-d90a1b1e-ac7f-4a43-bd5a-3ae981771611 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:26:35.226570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:35.226570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:35.226570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:35.226570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:35.226570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:35.226570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:35.226570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:35.226570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:35.226570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:35.226570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:35.226570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:35.226570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:35.226570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:35.226570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:35.226570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:35.227549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:35.227549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:35.227549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:35.227549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:35.227549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:35.227549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:35.227549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:35.227549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:35.227549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:35.227549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:35.227549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:35.227549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:35.227549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:35.227549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:35.227549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:35.227549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:35.227549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:35.227549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:35.229090 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:35.229090 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:35.229090 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:35.229090 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:35.229090 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:35.229090 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:35.229090 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:35.229090 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:35.229090 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:26:35.229090 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:35.231343 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 405/792] 10.222.0.69 () {56 vars in 1117 bytes} [Mon Aug 29 21:26:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:35.232757 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a1b1e-ac7f-4a43-bd5a-3ae981771611 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:35.268710 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:35.320015 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f684d-83bb-458c-92f1-7bc0b95f3411 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:35.358372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dc6b6-de65-4b0d-a470-6500874c97e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:35.359902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dc6b6-de65-4b0d-a470-6500874c97e8 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:35.360353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a1b1e-ac7f-4a43-bd5a-3ae981771611 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:35.360499 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dc6b6-de65-4b0d-a470-6500874c97e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:35.360956 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dc6b6-de65-4b0d-a470-6500874c97e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:35.373092 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95dc6b6-de65-4b0d-a470-6500874c97e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:35.378421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-e95dc6b6-de65-4b0d-a470-6500874c97e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:26:35.378421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:35.378421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:35.378421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:35.378421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:35.378421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:35.378421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:35.378421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:35.378421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:35.378421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:35.378421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:35.378421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:35.378421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:35.378421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:35.378421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:35.378421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:35.379390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:35.379390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:35.379390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:35.379390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:35.379390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:35.379390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:35.379390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:35.379390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:35.379390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:35.379390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:35.379390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:35.379390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:35.379390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:35.379390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:35.379390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:35.379390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:35.380271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:35.380271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:35.380271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:35.380271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:35.380271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:35.380271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:35.380271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:35.380271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:35.380271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:35.380271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:35.380271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:26:35.380271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:35.382938 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 388/793] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:26:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:35.384284 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dc6b6-de65-4b0d-a470-6500874c97e8 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:35.405678 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1366f-9ae9-4aa4-a818-913f7339bae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:35.406298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1366f-9ae9-4aa4-a818-913f7339bae7 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:35.406604 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1366f-9ae9-4aa4-a818-913f7339bae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:35.406899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1366f-9ae9-4aa4-a818-913f7339bae7 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:35.407526 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1366f-9ae9-4aa4-a818-913f7339bae7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:35.407832 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1366f-9ae9-4aa4-a818-913f7339bae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:35.409254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1366f-9ae9-4aa4-a818-913f7339bae7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:35.412521 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:35.418697 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 406/794] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:26:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:35.419627 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1366f-9ae9-4aa4-a818-913f7339bae7 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:35.506474 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dc6b6-de65-4b0d-a470-6500874c97e8 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:35.512782 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:35.530621 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1366f-9ae9-4aa4-a818-913f7339bae7 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:35.545067 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3d16c-8dd2-4dfb-974d-c9bcf9a83cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:35.546030 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3d16c-8dd2-4dfb-974d-c9bcf9a83cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:35.546600 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3d16c-8dd2-4dfb-974d-c9bcf9a83cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:35.547076 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3d16c-8dd2-4dfb-974d-c9bcf9a83cd1 None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:35.548077 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3d16c-8dd2-4dfb-974d-c9bcf9a83cd1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:35.548615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3d16c-8dd2-4dfb-974d-c9bcf9a83cd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:35.550254 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3d16c-8dd2-4dfb-974d-c9bcf9a83cd1 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:35.568209 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef428a-b0e6-421a-9667-ad534040a74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:35.568699 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef428a-b0e6-421a-9667-ad534040a74c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:35.568985 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef428a-b0e6-421a-9667-ad534040a74c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:35.569258 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef428a-b0e6-421a-9667-ad534040a74c None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:35.569930 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef428a-b0e6-421a-9667-ad534040a74c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:35.570237 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef428a-b0e6-421a-9667-ad534040a74c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:35.571777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef428a-b0e6-421a-9667-ad534040a74c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:35.572038 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 389/795] 10.222.0.69 () {56 vars in 1149 bytes} [Mon Aug 29 21:26:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:35.573225 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3d16c-8dd2-4dfb-974d-c9bcf9a83cd1 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:35.588352 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 407/796] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:26:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:35.590890 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef428a-b0e6-421a-9667-ad534040a74c None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:35.664247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:35.697633 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3d16c-8dd2-4dfb-974d-c9bcf9a83cd1 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:35.730141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef428a-b0e6-421a-9667-ad534040a74c None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:35.748003 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81605566-a5e0-4313-9881-d274f20e0a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:35.749285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81605566-a5e0-4313-9881-d274f20e0a47 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:35.750152 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81605566-a5e0-4313-9881-d274f20e0a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:35.750633 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81605566-a5e0-4313-9881-d274f20e0a47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:35.766926 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81605566-a5e0-4313-9881-d274f20e0a47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:35.768403 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81605566-a5e0-4313-9881-d274f20e0a47 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:35.774242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cc92a-c323-45fd-ab9c-eb8a45cfc6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:35.775360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cc92a-c323-45fd-ab9c-eb8a45cfc6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:35.777106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cc92a-c323-45fd-ab9c-eb8a45cfc6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:35.777612 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cc92a-c323-45fd-ab9c-eb8a45cfc6a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:35.785068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-81605566-a5e0-4313-9881-d274f20e0a47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:35.785068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:35.785068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:35.785068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:35.785068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:35.785068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:35.785068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:35.785068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:35.785068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:35.785068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:35.785068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:35.785068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:35.785068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:35.785068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:35.785068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:35.785068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:35.786111 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:35.786111 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:35.786111 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:35.786111 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:35.786111 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:35.786111 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:35.786111 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:35.786111 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:35.786111 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:35.786111 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:35.786111 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:35.786111 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:35.786111 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:35.786111 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:35.786111 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:35.786111 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:35.786111 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:35.787668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:35.787668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:35.787668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:35.787668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 390/797] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:35.787668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81605566-a5e0-4313-9881-d274f20e0a47 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:35.797358 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cc92a-c323-45fd-ab9c-eb8a45cfc6a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:35.799812 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cc92a-c323-45fd-ab9c-eb8a45cfc6a9 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:35.815087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:35.822867 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-910cc92a-c323-45fd-ab9c-eb8a45cfc6a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:35.822867 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:35.822867 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:35.822867 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:35.822867 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:35.822867 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:35.822867 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:35.822867 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:35.822867 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:35.822867 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:35.822867 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:35.822867 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:35.822867 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:35.822867 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:35.822867 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:35.822867 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:35.824038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:35.824038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:35.824038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:35.824038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:35.824038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:35.824038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:35.824038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:35.824038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:35.824038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:35.824038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:35.824038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:35.824038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:35.824038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:35.824038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:35.824038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:35.824038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:35.824038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:35.825217 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:35.825217 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:35.825217 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:35.827574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 408/798] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:35.828540 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cc92a-c323-45fd-ab9c-eb8a45cfc6a9 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:35.910511 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81605566-a5e0-4313-9881-d274f20e0a47 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:35.940821 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:35.943311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cc92a-c323-45fd-ab9c-eb8a45cfc6a9 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:35.951282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0b177-de55-4520-810b-045d00f1123f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:35.951998 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0b177-de55-4520-810b-045d00f1123f None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:35.952375 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0b177-de55-4520-810b-045d00f1123f None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:35.952719 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0b177-de55-4520-810b-045d00f1123f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:35.965243 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0b177-de55-4520-810b-045d00f1123f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:35.966792 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0b177-de55-4520-810b-045d00f1123f None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:35.979262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c028aac-2193-447b-993b-b15337b3c1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:35.979979 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c028aac-2193-447b-993b-b15337b3c1df None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:35.980369 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c028aac-2193-447b-993b-b15337b3c1df None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:35.980651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c028aac-2193-447b-993b-b15337b3c1df None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:35.981334 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c028aac-2193-447b-993b-b15337b3c1df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:35.981633 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c028aac-2193-447b-993b-b15337b3c1df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:35.983258 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c028aac-2193-447b-993b-b15337b3c1df None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:35.983663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-b4c0b177-de55-4520-810b-045d00f1123f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:35.983663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:35.983663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:35.983663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:35.983663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:35.983663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:35.983663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:35.983663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:35.983663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:35.983663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:35.983663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:35.983663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:35.983663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:35.983663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:35.983663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:35.983663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:35.984873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:35.984873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:35.984873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:35.984873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:35.984873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:35.984873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:35.984873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:35.984873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:35.984873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:35.984873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:35.984873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:35.984873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:35.984873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:35.984873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:35.984873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:35.984873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:35.984873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:35.985829 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:35.985829 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:35.985829 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:35.985829 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 391/799] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:35.985829 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0b177-de55-4520-810b-045d00f1123f None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:36.005295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 409/800] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:36.005295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98936f5-c22e-4f1f-9de6-0e29e08e37c5 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:36.005295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98936f5-c22e-4f1f-9de6-0e29e08e37c5 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:36.005295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98936f5-c22e-4f1f-9de6-0e29e08e37c5 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:36.005295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 410/801] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:36.005295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98936f5-c22e-4f1f-9de6-0e29e08e37c5 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:36.067677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:36.106002 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0b177-de55-4520-810b-045d00f1123f None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:36.117453 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98936f5-c22e-4f1f-9de6-0e29e08e37c5 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:36.142139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effdf668-cfc5-4f9a-8b50-e4bf9c225923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:36.142749 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdf668-cfc5-4f9a-8b50-e4bf9c225923 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:36.143022 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdf668-cfc5-4f9a-8b50-e4bf9c225923 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:36.143294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdf668-cfc5-4f9a-8b50-e4bf9c225923 None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:36.143936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effdf668-cfc5-4f9a-8b50-e4bf9c225923 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:36.144260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effdf668-cfc5-4f9a-8b50-e4bf9c225923 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:36.145630 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effdf668-cfc5-4f9a-8b50-e4bf9c225923 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:36.152760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433bc09-d477-460e-91d5-fa8212353ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:36.153377 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433bc09-d477-460e-91d5-fa8212353ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:36.153667 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433bc09-d477-460e-91d5-fa8212353ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:36.153940 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433bc09-d477-460e-91d5-fa8212353ee4 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:36.154583 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433bc09-d477-460e-91d5-fa8212353ee4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:36.154894 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433bc09-d477-460e-91d5-fa8212353ee4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:36.156281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433bc09-d477-460e-91d5-fa8212353ee4 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:36.157974 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 392/802] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:36.162596 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effdf668-cfc5-4f9a-8b50-e4bf9c225923 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:36.173199 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 411/803] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:36.174528 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1415d45-8c33-4849-bc43-bf7f837f8af9 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:36.174875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1415d45-8c33-4849-bc43-bf7f837f8af9 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:36.175099 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1415d45-8c33-4849-bc43-bf7f837f8af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:36.194551 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-c1415d45-8c33-4849-bc43-bf7f837f8af9 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:36.195045 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c1415d45-8c33-4849-bc43-bf7f837f8af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:36.216999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:36.264530 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 412/804] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:26:36.265804 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013d7fe-4b5f-4ca5-bb68-92236bfe282a None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:36.266088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013d7fe-4b5f-4ca5-bb68-92236bfe282a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:36.266361 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013d7fe-4b5f-4ca5-bb68-92236bfe282a None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:36.267766 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 413/805] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:36.268297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013d7fe-4b5f-4ca5-bb68-92236bfe282a None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:36.291759 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effdf668-cfc5-4f9a-8b50-e4bf9c225923 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:36.327266 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:36.328201 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ec0f3-c0a0-457a-8a4b-3091f650cfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:36.328881 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ec0f3-c0a0-457a-8a4b-3091f650cfce None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:36.329161 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ec0f3-c0a0-457a-8a4b-3091f650cfce None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:36.329435 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ec0f3-c0a0-457a-8a4b-3091f650cfce None admin] PATH_INFO: `/v3/users/nova` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:36.337143 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ec0f3-c0a0-457a-8a4b-3091f650cfce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:36.339146 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ec0f3-c0a0-457a-8a4b-3091f650cfce None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:36.351700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-510ec0f3-c0a0-457a-8a4b-3091f650cfce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:26:36.351700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:36.351700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:36.351700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:36.351700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:36.351700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:36.351700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:36.351700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:36.351700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:36.351700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:36.351700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:36.351700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:36.351700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:36.351700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:36.351700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:36.351700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:36.352969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:36.352969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:36.352969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:36.352969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:36.352969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:36.352969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:36.352969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:36.352969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:36.352969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:36.352969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:36.352969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:36.352969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:36.352969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:36.352969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:36.352969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:36.352969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:36.352969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:36.352969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:36.354218 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:36.354218 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:36.354218 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:36.354218 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:36.354218 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:36.354218 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:36.354218 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:36.354218 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:36.354218 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:26:36.354218 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:36.358468 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 393/806] 10.222.0.69 () {56 vars in 1093 bytes} [Mon Aug 29 21:26:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:36.359520 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ec0f3-c0a0-457a-8a4b-3091f650cfce None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:36.389647 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013d7fe-4b5f-4ca5-bb68-92236bfe282a None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:36.436112 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a9a8c-7d0d-4124-b6ec-d3c03c46b485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:36.437158 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a9a8c-7d0d-4124-b6ec-d3c03c46b485 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:36.437516 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a9a8c-7d0d-4124-b6ec-d3c03c46b485 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:36.437863 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a9a8c-7d0d-4124-b6ec-d3c03c46b485 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:36.447887 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a9a8c-7d0d-4124-b6ec-d3c03c46b485 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:36.450175 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a9a8c-7d0d-4124-b6ec-d3c03c46b485 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:36.467427 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-648a9a8c-7d0d-4124-b6ec-d3c03c46b485 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:36.467427 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:36.467427 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:36.467427 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:36.467427 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:36.467427 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:36.467427 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:36.467427 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:36.467427 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:36.467427 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:36.467427 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:36.467427 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:36.467427 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:36.467427 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:36.467427 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:36.468670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:36.468670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:36.468670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:36.468670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:36.468670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:36.468670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:36.468670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:36.468670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:36.468670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:36.468670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:36.468670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:36.468670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:36.468670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:36.468670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:36.468670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:36.468670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:36.468670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:36.469727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:36.469727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:36.469727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:36.469727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:36.469727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:36.469727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:36.469727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:36.469727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:36.469727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 414/807] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:36.470727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad760339-b2e8-459e-a9db-bd6a7d182e1a None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:36.471013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad760339-b2e8-459e-a9db-bd6a7d182e1a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:36.471305 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad760339-b2e8-459e-a9db-bd6a7d182e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:36.473454 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:36.477077 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ec0f3-c0a0-457a-8a4b-3091f650cfce None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:36.494679 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ad760339-b2e8-459e-a9db-bd6a7d182e1a None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:36.495908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ad760339-b2e8-459e-a9db-bd6a7d182e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:36.515762 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7030e-146c-4c8f-a3ff-3d1a647e0912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:36.516439 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7030e-146c-4c8f-a3ff-3d1a647e0912 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:36.516719 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7030e-146c-4c8f-a3ff-3d1a647e0912 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:36.516989 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7030e-146c-4c8f-a3ff-3d1a647e0912 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:36.524835 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7030e-146c-4c8f-a3ff-3d1a647e0912 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:36.526892 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7030e-146c-4c8f-a3ff-3d1a647e0912 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:36.538205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-efb7030e-146c-4c8f-a3ff-3d1a647e0912 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:26:36.538205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:36.538205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:36.538205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:36.538205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:36.538205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:36.538205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:36.538205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:36.538205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:36.538205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:36.538205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:36.538205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:36.538205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:36.538205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:36.538205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:36.538205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:36.539373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:36.539373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:36.539373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:36.539373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:36.539373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:36.539373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:36.539373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:36.539373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:36.539373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:36.539373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:36.539373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:36.539373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:36.539373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:36.539373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:36.539373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:36.539373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:36.539373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:36.539373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:36.540396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:36.540396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:36.540396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:36.540396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:36.540396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:36.540396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:36.540396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:36.540396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:36.540396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:26:36.540396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:36.540396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 394/808] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:26:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:36.540396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7030e-146c-4c8f-a3ff-3d1a647e0912 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:36.649155 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7030e-146c-4c8f-a3ff-3d1a647e0912 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:36.682186 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 415/809] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:26:36.683041 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad760339-b2e8-459e-a9db-bd6a7d182e1a None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:36.692916 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236fac6-1b17-45e3-881f-227e88675a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:36.693905 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236fac6-1b17-45e3-881f-227e88675a7e None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:36.694202 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236fac6-1b17-45e3-881f-227e88675a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:36.694479 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236fac6-1b17-45e3-881f-227e88675a7e None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:36.695525 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236fac6-1b17-45e3-881f-227e88675a7e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:36.695836 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236fac6-1b17-45e3-881f-227e88675a7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:36.697874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236fac6-1b17-45e3-881f-227e88675a7e None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:36.722063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 395/810] 10.222.0.69 () {56 vars in 1133 bytes} [Mon Aug 29 21:26:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:36.722063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236fac6-1b17-45e3-881f-227e88675a7e None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:36.733764 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:36.739629 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:36.799007 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad760339-b2e8-459e-a9db-bd6a7d182e1a None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:36.832970 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236fac6-1b17-45e3-881f-227e88675a7e None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:36.836229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c72ccc-3586-43ec-9269-efe456494793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:36.836915 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c72ccc-3586-43ec-9269-efe456494793 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:36.837264 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c72ccc-3586-43ec-9269-efe456494793 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:36.837607 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c72ccc-3586-43ec-9269-efe456494793 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:36.838422 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c72ccc-3586-43ec-9269-efe456494793 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:36.838796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c72ccc-3586-43ec-9269-efe456494793 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:36.840329 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c72ccc-3586-43ec-9269-efe456494793 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:36.858835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 416/811] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:36.858835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c72ccc-3586-43ec-9269-efe456494793 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:36.874528 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267372e-d6de-45df-bfa3-6472d4af0248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:36.875306 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267372e-d6de-45df-bfa3-6472d4af0248 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:36.875636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267372e-d6de-45df-bfa3-6472d4af0248 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:36.875974 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267372e-d6de-45df-bfa3-6472d4af0248 None admin] PATH_INFO: `/v3/services/network` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:36.876684 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267372e-d6de-45df-bfa3-6472d4af0248 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:36.878138 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267372e-d6de-45df-bfa3-6472d4af0248 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:36.888694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-4267372e-d6de-45df-bfa3-6472d4af0248 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:26:36.888694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:36.888694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:26:36.888694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:26:36.888694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:26:36.888694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:26:36.888694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:26:36.888694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:36.888694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:26:36.888694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:36.888694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:26:36.888694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:36.888694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:36.888694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:36.888694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:36.888694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:36.888694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:36.889928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:36.889928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:36.889928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:36.889928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:36.889928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:36.889928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:36.889928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:26:36.889928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:26:36.889928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:26:36.889928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:26:36.889928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:36.889928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:36.889928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:36.889928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:36.889928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:36.889928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:36.891029 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:36.891029 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:36.891029 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:36.891029 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:36.891029 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:36.891029 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:36.891029 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:36.891029 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:36.891029 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:36.891029 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:36.891029 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:26:36.891029 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:36.891029 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:26:36.891029 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:36.891889 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 396/812] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:36 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:36.892777 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267372e-d6de-45df-bfa3-6472d4af0248 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:36.971405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:36.974525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c72ccc-3586-43ec-9269-efe456494793 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:36.977988 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:36.997411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267372e-d6de-45df-bfa3-6472d4af0248 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:37.010390 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a341a-28c2-4399-8bcd-59eca1ac0e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:37.010994 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a341a-28c2-4399-8bcd-59eca1ac0e0c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:37.011273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a341a-28c2-4399-8bcd-59eca1ac0e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:37.011545 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a341a-28c2-4399-8bcd-59eca1ac0e0c None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:37.012298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a341a-28c2-4399-8bcd-59eca1ac0e0c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:37.012602 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a341a-28c2-4399-8bcd-59eca1ac0e0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:37.014026 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a341a-28c2-4399-8bcd-59eca1ac0e0c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:37.030713 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c3e0d-20c5-4755-962d-99cc181c3edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:37.031320 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c3e0d-20c5-4755-962d-99cc181c3edb None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:37.031416 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 417/813] 10.222.0.69 () {56 vars in 1135 bytes} [Mon Aug 29 21:26:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:37.031599 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c3e0d-20c5-4755-962d-99cc181c3edb None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:37.031872 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c3e0d-20c5-4755-962d-99cc181c3edb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:37.032150 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a341a-28c2-4399-8bcd-59eca1ac0e0c None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:37.100863 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c3e0d-20c5-4755-962d-99cc181c3edb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:37.102311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c3e0d-20c5-4755-962d-99cc181c3edb None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:37.133389 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a341a-28c2-4399-8bcd-59eca1ac0e0c None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:37.168162 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728756b4-8e6c-4d7c-b546-a6df53dd135a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:37.168861 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728756b4-8e6c-4d7c-b546-a6df53dd135a None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:37.169138 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728756b4-8e6c-4d7c-b546-a6df53dd135a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:37.169468 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728756b4-8e6c-4d7c-b546-a6df53dd135a None admin] PATH_INFO: `/v3/projects/a302406c548c43c983625c0d66da47cc/users/540e06e694524c4a9e84ebebd45956d6/roles/3766508ffa094bb5bbec6d9209745261` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:37.184359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728756b4-8e6c-4d7c-b546-a6df53dd135a None admin] RBAC: Authorizing `identity:create_grant(project_id=a302406c548c43c983625c0d66da47cc, user_id=540e06e694524c4a9e84ebebd45956d6, role_id=3766508ffa094bb5bbec6d9209745261)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:37.184705 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:37.185810 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728756b4-8e6c-4d7c-b546-a6df53dd135a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:37.197915 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 418/814] 10.222.0.69 () {58 vars in 1439 bytes} [Mon Aug 29 21:26:37 2022] PUT /identity/v3/projects/a302406c548c43c983625c0d66da47cc/users/540e06e694524c4a9e84ebebd45956d6/roles/3766508ffa094bb5bbec6d9209745261 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:26:37.198720 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728756b4-8e6c-4d7c-b546-a6df53dd135a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:37.206089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 397/815] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:26:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:26:37.207908 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c3e0d-20c5-4755-962d-99cc181c3edb None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:37.211673 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:37.321967 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728756b4-8e6c-4d7c-b546-a6df53dd135a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:37.330062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c3e0d-20c5-4755-962d-99cc181c3edb None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:37.373990 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e99064-f04f-4530-a6f4-463cf07b47ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:37.374608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e99064-f04f-4530-a6f4-463cf07b47ec None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:37.374884 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e99064-f04f-4530-a6f4-463cf07b47ec None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:37.375157 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e99064-f04f-4530-a6f4-463cf07b47ec None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:37.375795 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e99064-f04f-4530-a6f4-463cf07b47ec None admin] RBAC: Adding query filter params (name=network) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:37.376106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e99064-f04f-4530-a6f4-463cf07b47ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:37.377468 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733c683-e031-494c-92d9-bad07f8ddba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:37.377929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e99064-f04f-4530-a6f4-463cf07b47ec None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:37.378726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733c683-e031-494c-92d9-bad07f8ddba2 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:37.379159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733c683-e031-494c-92d9-bad07f8ddba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:37.379560 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733c683-e031-494c-92d9-bad07f8ddba2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:37.380394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733c683-e031-494c-92d9-bad07f8ddba2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:37.381932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733c683-e031-494c-92d9-bad07f8ddba2 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:37.382447 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 419/816] 10.222.0.69 () {56 vars in 1112 bytes} [Mon Aug 29 21:26:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:37.383229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e99064-f04f-4530-a6f4-463cf07b47ec None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:37.397131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-8733c683-e031-494c-92d9-bad07f8ddba2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:26:37.397131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:37.397131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:26:37.397131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:26:37.397131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:26:37.397131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:26:37.397131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:26:37.397131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:37.397131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:26:37.397131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:37.397131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:26:37.397131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:37.397131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:37.397131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:37.397131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:37.397131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:37.397131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:37.398208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:37.398208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:37.398208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:37.398208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:37.398208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:37.398208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:37.398208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:26:37.398208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:26:37.398208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:26:37.398208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:26:37.398208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:37.398208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:37.398208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:37.398208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:37.398208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:37.398208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:37.399049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:37.399049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:37.399049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:37.399049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:37.399049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:37.399049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:37.399049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:37.399049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:37.399049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:37.399049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:37.399049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:26:37.399049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:37.399049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:26:37.399049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:37.403561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 398/817] 10.222.0.69 () {56 vars in 1129 bytes} [Mon Aug 29 21:26:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:37.403561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733c683-e031-494c-92d9-bad07f8ddba2 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:37.458607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:37.467089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:37.499621 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e99064-f04f-4530-a6f4-463cf07b47ec None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:37.522701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733c683-e031-494c-92d9-bad07f8ddba2 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:37.542944 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba65d2-e926-4e01-ba64-659c2dd9a77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:37.543575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba65d2-e926-4e01-ba64-659c2dd9a77a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:37.543861 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba65d2-e926-4e01-ba64-659c2dd9a77a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:37.544624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba65d2-e926-4e01-ba64-659c2dd9a77a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:37.555203 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba65d2-e926-4e01-ba64-659c2dd9a77a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:37.557275 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba65d2-e926-4e01-ba64-659c2dd9a77a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:37.560849 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31ef1b-030e-40c1-b703-83ca889327bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:37.561482 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31ef1b-030e-40c1-b703-83ca889327bc None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:37.561766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31ef1b-030e-40c1-b703-83ca889327bc None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:37.562090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31ef1b-030e-40c1-b703-83ca889327bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:37.573066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-5aba65d2-e926-4e01-ba64-659c2dd9a77a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:37.573066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:37.573066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:37.573066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:37.573066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:37.573066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:37.573066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:37.573066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:37.573066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:37.573066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:37.573066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:37.573066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:37.573066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:37.573066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:37.573066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:37.573066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:37.574014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:37.574014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:37.574014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:37.574014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:37.574014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:37.574014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:37.574014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:37.574014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:37.574014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:37.574014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:37.574014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:37.574014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:37.574014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:37.574014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:37.574014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:37.574014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:37.574014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:37.579906 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:37.579906 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:37.579906 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:37.580078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31ef1b-030e-40c1-b703-83ca889327bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:37.580078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31ef1b-030e-40c1-b703-83ca889327bc None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:37.580248 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 420/818] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:37.580248 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba65d2-e926-4e01-ba64-659c2dd9a77a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:37.595647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-ee31ef1b-030e-40c1-b703-83ca889327bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:37.595647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:37.595647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:37.595647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:37.595647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:37.595647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:37.595647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:37.595647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:37.595647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:37.595647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:37.595647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:37.595647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:37.595647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:37.595647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:37.595647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:37.595647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:37.596885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:37.596885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:37.596885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:37.596885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:37.596885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:37.596885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:37.596885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:37.596885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:37.596885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:37.596885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:37.596885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:37.596885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:37.596885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:37.596885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:37.596885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:37.596885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:37.596885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:37.597802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:37.597802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:37.597802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:37.597802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 399/819] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:37.597802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31ef1b-030e-40c1-b703-83ca889327bc None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:37.701133 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba65d2-e926-4e01-ba64-659c2dd9a77a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:37.706748 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:37.711280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31ef1b-030e-40c1-b703-83ca889327bc None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:37.732443 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:37.744144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb4d0d-83b6-4780-bdc3-cc1fbedf14f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:37.744784 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb4d0d-83b6-4780-bdc3-cc1fbedf14f9 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:37.745062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb4d0d-83b6-4780-bdc3-cc1fbedf14f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:37.745328 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb4d0d-83b6-4780-bdc3-cc1fbedf14f9 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:37.745959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb4d0d-83b6-4780-bdc3-cc1fbedf14f9 None admin] RBAC: Adding query filter params (type=network) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:37.746257 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb4d0d-83b6-4780-bdc3-cc1fbedf14f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:37.747608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb4d0d-83b6-4780-bdc3-cc1fbedf14f9 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:37.750445 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c3e19-a015-4f8f-b70a-e6c7edc9410a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:37.751046 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c3e19-a015-4f8f-b70a-e6c7edc9410a None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:37.751321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c3e19-a015-4f8f-b70a-e6c7edc9410a None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:37.751588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c3e19-a015-4f8f-b70a-e6c7edc9410a None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:37.752233 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c3e19-a015-4f8f-b70a-e6c7edc9410a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:37.752537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c3e19-a015-4f8f-b70a-e6c7edc9410a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:37.757265 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 421/820] 10.222.0.69 () {56 vars in 1112 bytes} [Mon Aug 29 21:26:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:37.757265 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb4d0d-83b6-4780-bdc3-cc1fbedf14f9 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:37.757511 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c3e19-a015-4f8f-b70a-e6c7edc9410a None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:37.766802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 400/821] 10.222.0.69 () {56 vars in 1124 bytes} [Mon Aug 29 21:26:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:37.766802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c3e19-a015-4f8f-b70a-e6c7edc9410a None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:37.863755 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb4d0d-83b6-4780-bdc3-cc1fbedf14f9 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:37.886334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c3e19-a015-4f8f-b70a-e6c7edc9410a None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:37.902608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4181b-5511-4c62-9b86-74ace49c413a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:37.903219 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4181b-5511-4c62-9b86-74ace49c413a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:37.903499 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4181b-5511-4c62-9b86-74ace49c413a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:37.903766 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4181b-5511-4c62-9b86-74ace49c413a None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:37.904448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4181b-5511-4c62-9b86-74ace49c413a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:37.904759 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4181b-5511-4c62-9b86-74ace49c413a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:37.906128 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4181b-5511-4c62-9b86-74ace49c413a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:37.923595 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 422/822] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:37.923595 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4181b-5511-4c62-9b86-74ace49c413a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:37.927437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5584805-0d32-4e01-add5-cafce524082f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:37.928083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5584805-0d32-4e01-add5-cafce524082f None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:37.928413 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5584805-0d32-4e01-add5-cafce524082f None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:37.928685 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5584805-0d32-4e01-add5-cafce524082f None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:37.929334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5584805-0d32-4e01-add5-cafce524082f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:37.929636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5584805-0d32-4e01-add5-cafce524082f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:37.931078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5584805-0d32-4e01-add5-cafce524082f None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:37.944437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 401/823] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:37.949422 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5584805-0d32-4e01-add5-cafce524082f None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:37.973790 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:37.975093 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:38.028415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4181b-5511-4c62-9b86-74ace49c413a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:38.059468 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5584805-0d32-4e01-add5-cafce524082f None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:38.066322 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd052c-0ce4-4792-a559-ecc5518160e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:38.066945 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd052c-0ce4-4792-a559-ecc5518160e9 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:38.067223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd052c-0ce4-4792-a559-ecc5518160e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:38.067498 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd052c-0ce4-4792-a559-ecc5518160e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:38.068651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd052c-0ce4-4792-a559-ecc5518160e9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:38.070401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd052c-0ce4-4792-a559-ecc5518160e9 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:38.094557 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 423/824] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:26:37 2022] POST /identity/v3/endpoints => generated 337 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:26:38.095725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd052c-0ce4-4792-a559-ecc5518160e9 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:38.115887 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f6de6-f6f0-4b63-8ba7-893d0e47a8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:38.116468 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f6de6-f6f0-4b63-8ba7-893d0e47a8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:38.116749 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f6de6-f6f0-4b63-8ba7-893d0e47a8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:38.117024 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f6de6-f6f0-4b63-8ba7-893d0e47a8b8 None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:38.117679 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f6de6-f6f0-4b63-8ba7-893d0e47a8b8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:38.117981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f6de6-f6f0-4b63-8ba7-893d0e47a8b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:38.119993 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f6de6-f6f0-4b63-8ba7-893d0e47a8b8 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:38.128347 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 402/825] 10.222.0.69 () {56 vars in 1124 bytes} [Mon Aug 29 21:26:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:38.129617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f6de6-f6f0-4b63-8ba7-893d0e47a8b8 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:38.237288 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd052c-0ce4-4792-a559-ecc5518160e9 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:38.241550 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:38.269288 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:38.289519 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43b754-a5fe-4d84-9978-51ac7558524e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:38.290165 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43b754-a5fe-4d84-9978-51ac7558524e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:38.290446 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43b754-a5fe-4d84-9978-51ac7558524e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:38.290714 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43b754-a5fe-4d84-9978-51ac7558524e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:38.296149 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f6de6-f6f0-4b63-8ba7-893d0e47a8b8 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:38.303862 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43b754-a5fe-4d84-9978-51ac7558524e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:38.305497 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43b754-a5fe-4d84-9978-51ac7558524e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:38.320480 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-8e43b754-a5fe-4d84-9978-51ac7558524e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:38.320480 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:38.320480 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:38.320480 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:38.320480 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:38.320480 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:38.320480 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:38.320480 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:38.320480 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:38.320480 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:38.320480 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:38.320480 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:38.320480 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:38.320480 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:38.320480 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:38.321509 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:38.321509 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:38.321509 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:38.321509 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:38.321509 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:38.321509 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:38.321509 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:38.321509 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:38.321509 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:38.321509 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:38.321509 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:38.321509 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:38.321509 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:38.321509 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:38.321509 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:38.321509 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:38.321509 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:38.322861 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:38.322861 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:38.322861 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:38.322861 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:38.322861 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:38.322861 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:38.322861 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:38.322861 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:38.322861 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 424/826] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:38.322861 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43b754-a5fe-4d84-9978-51ac7558524e None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:38.351205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8ff52-83ec-46eb-b80e-70afc9a85170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:38.351993 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8ff52-83ec-46eb-b80e-70afc9a85170 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:38.352310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8ff52-83ec-46eb-b80e-70afc9a85170 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:38.352586 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8ff52-83ec-46eb-b80e-70afc9a85170 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:38.363164 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8ff52-83ec-46eb-b80e-70afc9a85170 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:38.364681 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8ff52-83ec-46eb-b80e-70afc9a85170 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:38.380324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-e6e8ff52-83ec-46eb-b80e-70afc9a85170 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:38.380324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:38.380324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:38.380324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:38.380324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:38.380324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:38.380324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:38.380324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:38.380324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:38.380324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:38.380324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:38.380324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:38.380324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:38.380324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:38.380324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:38.381828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:38.381828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:38.381828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:38.381828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:38.381828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:38.381828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:38.381828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:38.381828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:38.381828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:38.381828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:38.381828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:38.381828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:38.381828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:38.381828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:38.381828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:38.381828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:38.381828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:38.382732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:38.382732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:38.382732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:38.382732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:38.382732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:38.382732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:38.382732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:38.382732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:38.382732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 403/827] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:38.382732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8ff52-83ec-46eb-b80e-70afc9a85170 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:38.468495 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43b754-a5fe-4d84-9978-51ac7558524e None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:38.501214 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8ff52-83ec-46eb-b80e-70afc9a85170 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:38.518782 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bcea1c-1d55-4767-88b7-146ec7ee9eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:38.519408 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcea1c-1d55-4767-88b7-146ec7ee9eeb None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:38.519687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcea1c-1d55-4767-88b7-146ec7ee9eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:38.519966 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcea1c-1d55-4767-88b7-146ec7ee9eeb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:38.520727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bcea1c-1d55-4767-88b7-146ec7ee9eeb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:38.522078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bcea1c-1d55-4767-88b7-146ec7ee9eeb None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:38.544207 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21466976-579d-4fac-9491-34536e12724d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:38.544823 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21466976-579d-4fac-9491-34536e12724d None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:38.545129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 425/828] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:26:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:26:38.546117 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bcea1c-1d55-4767-88b7-146ec7ee9eeb None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:38.552730 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21466976-579d-4fac-9491-34536e12724d None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:38.553396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21466976-579d-4fac-9491-34536e12724d None admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:38.554378 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21466976-579d-4fac-9491-34536e12724d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:38.554935 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21466976-579d-4fac-9491-34536e12724d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:38.558201 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21466976-579d-4fac-9491-34536e12724d None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:38.576984 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:38.579237 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 404/829] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:38.585446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21466976-579d-4fac-9491-34536e12724d None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:38.588480 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:38.693700 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bcea1c-1d55-4767-88b7-146ec7ee9eeb None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:38.706779 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21466976-579d-4fac-9491-34536e12724d None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:38.742233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20379bfa-d127-4270-9889-404b9d8bbc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:38.742917 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20379bfa-d127-4270-9889-404b9d8bbc13 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:38.743100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20379bfa-d127-4270-9889-404b9d8bbc13 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:38.743514 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20379bfa-d127-4270-9889-404b9d8bbc13 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:38.744024 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20379bfa-d127-4270-9889-404b9d8bbc13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:38.744894 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20379bfa-d127-4270-9889-404b9d8bbc13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:38.746420 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20379bfa-d127-4270-9889-404b9d8bbc13 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:38.756639 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c7d8c-8859-47c3-b383-f4f7ecda8b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:38.757310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c7d8c-8859-47c3-b383-f4f7ecda8b28 None admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:38.757627 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c7d8c-8859-47c3-b383-f4f7ecda8b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:38.757903 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c7d8c-8859-47c3-b383-f4f7ecda8b28 None admin] PATH_INFO: `/v3/projects/a302406c548c43c983625c0d66da47cc/users/714a2ba019144211931dbe853f1960aa/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:38.760792 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856c7d8c-8859-47c3-b383-f4f7ecda8b28 None admin] RBAC: Authorizing `identity:create_grant(project_id=a302406c548c43c983625c0d66da47cc, user_id=714a2ba019144211931dbe853f1960aa, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:38.761588 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 426/830] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:38.762225 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856c7d8c-8859-47c3-b383-f4f7ecda8b28 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:38.767776 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20379bfa-d127-4270-9889-404b9d8bbc13 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:38.783486 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 405/831] 10.222.0.69 () {58 vars in 1439 bytes} [Mon Aug 29 21:26:38 2022] PUT /identity/v3/projects/a302406c548c43c983625c0d66da47cc/users/714a2ba019144211931dbe853f1960aa/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:26:38.871312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:38.904021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20379bfa-d127-4270-9889-404b9d8bbc13 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:38.955150 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42a8fb-7022-47d6-8a91-0ec3fffa85db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:38.955899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42a8fb-7022-47d6-8a91-0ec3fffa85db None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:38.956312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42a8fb-7022-47d6-8a91-0ec3fffa85db None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:38.956695 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42a8fb-7022-47d6-8a91-0ec3fffa85db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:38.958096 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42a8fb-7022-47d6-8a91-0ec3fffa85db None admin] RBAC: Adding query filter params (role.id=69369872661e4179bb51cd1ca76e28c3, scope.project.id=a302406c548c43c983625c0d66da47cc, user.id=96c35c544cae4ad187f1a1be723e0d21) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:38.958096 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42a8fb-7022-47d6-8a91-0ec3fffa85db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:38.959484 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42a8fb-7022-47d6-8a91-0ec3fffa85db None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:38.967300 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 427/832] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:26:38 2022] GET /identity/v3/role_assignments?user.id=96c35c544cae4ad187f1a1be723e0d21&scope.project.id=a302406c548c43c983625c0d66da47cc&role.id=69369872661e4179bb51cd1ca76e28c3 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:39.199808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cb527-613d-4e15-80ed-325a124fe4f5 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:39.200311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cb527-613d-4e15-80ed-325a124fe4f5 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:39.200797 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cb527-613d-4e15-80ed-325a124fe4f5 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:39.203290 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 406/833] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:39.213674 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd76d8e-dd00-41fb-9f3e-0b64cf3176ce None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:39.214108 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd76d8e-dd00-41fb-9f3e-0b64cf3176ce None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:39.214499 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd76d8e-dd00-41fb-9f3e-0b64cf3176ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:39.236721 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-2cd76d8e-dd00-41fb-9f3e-0b64cf3176ce None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:39.237930 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2cd76d8e-dd00-41fb-9f3e-0b64cf3176ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:39.317088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 428/834] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:26:39.598022 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cb527-613d-4e15-80ed-325a124fe4f5 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:39.671011 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:39.721056 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cb527-613d-4e15-80ed-325a124fe4f5 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:39.761383 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacdcec-abba-4a49-8d4b-4d64dfe32e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:39.762265 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacdcec-abba-4a49-8d4b-4d64dfe32e2c None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:39.762685 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacdcec-abba-4a49-8d4b-4d64dfe32e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:39.763097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacdcec-abba-4a49-8d4b-4d64dfe32e2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:39.774520 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacdcec-abba-4a49-8d4b-4d64dfe32e2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:39.780027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-3bacdcec-abba-4a49-8d4b-4d64dfe32e2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:39.780027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:39.780027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:39.780027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:39.780027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:39.780027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:39.780027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:39.780027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:39.780027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:39.780027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:39.780027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:39.780027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:39.780027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:39.780027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:39.780027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:39.780027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:39.781193 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:39.781193 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:39.781193 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:39.781193 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:39.781193 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:39.781193 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:39.781193 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:39.781193 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:39.781193 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:39.781193 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:39.781193 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:39.781193 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:39.781193 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:39.781193 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:39.781193 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:39.781193 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:39.782248 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:39.782248 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:39.782248 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:39.782248 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:39.782248 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:39.782248 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:39.782248 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:39.782248 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:39.782248 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:39.782248 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:39.782248 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:26:39.782248 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:39.784632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 407/835] 10.222.0.69 () {56 vars in 1102 bytes} [Mon Aug 29 21:26:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:39.790713 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd76d8e-dd00-41fb-9f3e-0b64cf3176ce None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:39.865991 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:39.899546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd76d8e-dd00-41fb-9f3e-0b64cf3176ce None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:39.944978 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa801098-50e4-492a-bd62-6a53d3ee2319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:39.945994 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa801098-50e4-492a-bd62-6a53d3ee2319 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:39.946487 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa801098-50e4-492a-bd62-6a53d3ee2319 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:39.946964 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa801098-50e4-492a-bd62-6a53d3ee2319 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:39.948157 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa801098-50e4-492a-bd62-6a53d3ee2319 None admin] RBAC: Adding query filter params (name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:39.948722 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa801098-50e4-492a-bd62-6a53d3ee2319 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:39.951238 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa801098-50e4-492a-bd62-6a53d3ee2319 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:39.967095 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 429/836] 10.222.0.69 () {56 vars in 1103 bytes} [Mon Aug 29 21:26:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:39.975085 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacdcec-abba-4a49-8d4b-4d64dfe32e2c None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:40.128422 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacdcec-abba-4a49-8d4b-4d64dfe32e2c None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:40.156593 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:40.164607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8d882-d9cc-4e05-8836-dbadd8b6bcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:40.165248 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8d882-d9cc-4e05-8836-dbadd8b6bcf5 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:40.165528 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8d882-d9cc-4e05-8836-dbadd8b6bcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:40.165808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8d882-d9cc-4e05-8836-dbadd8b6bcf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:40.177863 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8d882-d9cc-4e05-8836-dbadd8b6bcf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:40.179329 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8d882-d9cc-4e05-8836-dbadd8b6bcf5 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:40.194317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-adb8d882-d9cc-4e05-8836-dbadd8b6bcf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:40.194317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:40.194317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:40.194317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:40.194317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:40.194317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:40.194317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:40.194317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:40.194317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:40.194317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:40.194317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:40.194317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:40.194317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:40.194317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:40.194317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:40.194317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:40.195411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:40.195411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:40.195411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:40.195411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:40.195411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:40.195411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:40.195411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:40.195411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:40.195411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:40.195411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:40.195411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:40.195411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:40.195411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:40.195411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:40.195411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:40.195411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:40.195411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:40.196343 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:40.196343 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:40.196343 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:40.198476 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 408/837] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:40.215966 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa801098-50e4-492a-bd62-6a53d3ee2319 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:40.378793 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa801098-50e4-492a-bd62-6a53d3ee2319 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:40.411512 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:40.417802 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0fc81-9b45-4cc4-a157-0003a36e4972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:40.418428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0fc81-9b45-4cc4-a157-0003a36e4972 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:40.418699 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0fc81-9b45-4cc4-a157-0003a36e4972 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:40.418965 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0fc81-9b45-4cc4-a157-0003a36e4972 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:40.419616 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0fc81-9b45-4cc4-a157-0003a36e4972 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:40.419903 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0fc81-9b45-4cc4-a157-0003a36e4972 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:40.421654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0fc81-9b45-4cc4-a157-0003a36e4972 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:40.443363 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 430/838] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:40.451701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8d882-d9cc-4e05-8836-dbadd8b6bcf5 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:40.592534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8d882-d9cc-4e05-8836-dbadd8b6bcf5 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:40.628789 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f528ef-56f1-482e-a483-939cc03b8d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:40.629670 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f528ef-56f1-482e-a483-939cc03b8d45 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:40.629846 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f528ef-56f1-482e-a483-939cc03b8d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:40.630210 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f528ef-56f1-482e-a483-939cc03b8d45 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:40.639828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f528ef-56f1-482e-a483-939cc03b8d45 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:40.641400 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f528ef-56f1-482e-a483-939cc03b8d45 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:40.655361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-19f528ef-56f1-482e-a483-939cc03b8d45 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:26:40.655361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:40.655361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:40.655361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:40.655361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:40.655361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:40.655361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:40.655361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:40.655361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:40.655361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:40.655361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:40.655361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:40.655361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:40.655361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:40.655361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:40.655361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:40.657675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:40.657675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:40.657675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:40.657675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:40.657675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:40.657675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:40.657675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:40.657675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:40.657675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:40.657675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:40.657675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:40.657675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:40.657675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:40.657675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:40.657675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:40.657675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:40.657675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:40.657675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:40.659938 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:40.659938 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:40.659938 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:40.659938 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:40.659938 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:40.659938 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:40.659938 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:40.659938 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:40.659938 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:26:40.659938 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:40.659938 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 409/839] 10.222.0.69 () {56 vars in 1117 bytes} [Mon Aug 29 21:26:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:26:40.662707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0fc81-9b45-4cc4-a157-0003a36e4972 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:40.767926 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee0c8b-5f3b-4e3b-87c7-48e74d6b6394 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:40.768250 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee0c8b-5f3b-4e3b-87c7-48e74d6b6394 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:40.768518 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee0c8b-5f3b-4e3b-87c7-48e74d6b6394 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:40.770122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 410/840] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:40.774453 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0fc81-9b45-4cc4-a157-0003a36e4972 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:40.775496 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d3788-d0a9-4bcd-816c-ad0a72cf222b None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:40.775784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d3788-d0a9-4bcd-816c-ad0a72cf222b None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:40.776063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d3788-d0a9-4bcd-816c-ad0a72cf222b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:40.795636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-ad7d3788-d0a9-4bcd-816c-ad0a72cf222b None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:40.797330 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-ad7d3788-d0a9-4bcd-816c-ad0a72cf222b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:40.811430 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742a181-4dcd-4104-8dd8-30bd584e64dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:40.812721 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742a181-4dcd-4104-8dd8-30bd584e64dc None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:40.813178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742a181-4dcd-4104-8dd8-30bd584e64dc None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:40.813630 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742a181-4dcd-4104-8dd8-30bd584e64dc None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:40.814525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742a181-4dcd-4104-8dd8-30bd584e64dc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:40.815002 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742a181-4dcd-4104-8dd8-30bd584e64dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:40.816665 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742a181-4dcd-4104-8dd8-30bd584e64dc None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:40.829784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:40.835987 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 431/841] 10.222.0.69 () {56 vars in 1149 bytes} [Mon Aug 29 21:26:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:40.842049 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742a181-4dcd-4104-8dd8-30bd584e64dc None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:40.892767 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 411/842] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:26:40.908610 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:40.911704 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5013d1-0ffa-4f5c-bf6e-a1a459b5d785 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:40.912233 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5013d1-0ffa-4f5c-bf6e-a1a459b5d785 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:40.913227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5013d1-0ffa-4f5c-bf6e-a1a459b5d785 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:40.915722 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 412/843] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:26:40.921962 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc278ae3-3ab4-4aa1-bfdc-03c3a02fd064 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:40.922523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc278ae3-3ab4-4aa1-bfdc-03c3a02fd064 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:40.923004 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc278ae3-3ab4-4aa1-bfdc-03c3a02fd064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:40.942552 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-cc278ae3-3ab4-4aa1-bfdc-03c3a02fd064 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:40.944202 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-cc278ae3-3ab4-4aa1-bfdc-03c3a02fd064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:40.959607 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742a181-4dcd-4104-8dd8-30bd584e64dc None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:40.997318 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791fc60-9727-4133-bcca-e3bcabc79098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:40.997938 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791fc60-9727-4133-bcca-e3bcabc79098 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:40.998273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791fc60-9727-4133-bcca-e3bcabc79098 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:40.998545 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791fc60-9727-4133-bcca-e3bcabc79098 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:41.036655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 413/844] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:26:41.073957 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791fc60-9727-4133-bcca-e3bcabc79098 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:41.075420 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791fc60-9727-4133-bcca-e3bcabc79098 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:41.125837 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:41.167470 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc278ae3-3ab4-4aa1-bfdc-03c3a02fd064 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:41.180677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 432/845] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:26:40 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:26:41.189852 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791fc60-9727-4133-bcca-e3bcabc79098 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:41.314308 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791fc60-9727-4133-bcca-e3bcabc79098 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:41.318238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:41.326949 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc278ae3-3ab4-4aa1-bfdc-03c3a02fd064 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:41.351810 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b6a28-88aa-4f00-840b-5282c6b22039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:41.352467 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b6a28-88aa-4f00-840b-5282c6b22039 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:41.352743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b6a28-88aa-4f00-840b-5282c6b22039 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:41.353010 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b6a28-88aa-4f00-840b-5282c6b22039 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:41.364621 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b6a28-88aa-4f00-840b-5282c6b22039 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:41.366055 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b6a28-88aa-4f00-840b-5282c6b22039 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:41.371132 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22814b79-c758-41fd-8ab1-e31a96e8631d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:41.372172 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22814b79-c758-41fd-8ab1-e31a96e8631d None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:41.373126 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22814b79-c758-41fd-8ab1-e31a96e8631d None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:41.373610 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22814b79-c758-41fd-8ab1-e31a96e8631d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:41.374394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22814b79-c758-41fd-8ab1-e31a96e8631d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:41.376873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22814b79-c758-41fd-8ab1-e31a96e8631d None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:41.381482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-6a1b6a28-88aa-4f00-840b-5282c6b22039 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:41.381482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:41.381482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:41.381482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:41.381482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:41.381482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:41.381482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:41.381482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:41.381482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:41.381482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:41.381482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:41.381482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:41.381482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:41.381482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:41.381482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:41.381482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:41.387020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:41.387020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:41.387020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:41.387020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:41.387020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:41.387020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:41.387020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:41.387020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:41.387020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:41.387020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:41.387020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:41.387020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:41.387020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:41.387020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:41.387020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:41.387020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:41.387020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:41.388495 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:41.388495 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:41.388495 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:41.388495 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 433/846] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:41.388495 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b6a28-88aa-4f00-840b-5282c6b22039 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:41.389724 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:41.396874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-22814b79-c758-41fd-8ab1-e31a96e8631d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:26:41.396874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:41.396874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:26:41.396874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:26:41.396874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:26:41.396874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:26:41.396874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:26:41.396874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:41.396874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:26:41.396874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:41.396874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:26:41.396874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:41.396874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:41.396874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:41.396874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:41.396874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:41.396874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:41.398625 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:41.398625 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:41.398625 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:41.398625 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:41.398625 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:41.398625 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:41.398625 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:26:41.398625 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:26:41.398625 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:26:41.398625 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:26:41.398625 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:41.398625 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:41.398625 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:41.398625 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:41.398625 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:41.398625 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:41.399788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:41.399788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:41.399788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:41.399788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:41.399788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:41.399788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:41.399788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:41.399788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:41.399788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:41.399788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:41.399788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:26:41.399788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:41.399788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:26:41.399788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:41.399788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 414/847] 10.222.0.69 () {56 vars in 1114 bytes} [Mon Aug 29 21:26:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:41.401239 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22814b79-c758-41fd-8ab1-e31a96e8631d None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:41.499369 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b6a28-88aa-4f00-840b-5282c6b22039 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:41.502548 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22814b79-c758-41fd-8ab1-e31a96e8631d None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:41.533428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ba0a3-adf0-4fd0-918a-379639db6b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:41.534370 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ba0a3-adf0-4fd0-918a-379639db6b07 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:41.534650 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ba0a3-adf0-4fd0-918a-379639db6b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:41.534924 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ba0a3-adf0-4fd0-918a-379639db6b07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:41.536780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f849f3-2ea0-4a42-8153-db17f3ed3942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:41.537784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f849f3-2ea0-4a42-8153-db17f3ed3942 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:41.538279 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f849f3-2ea0-4a42-8153-db17f3ed3942 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:41.538788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f849f3-2ea0-4a42-8153-db17f3ed3942 None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:41.539758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f849f3-2ea0-4a42-8153-db17f3ed3942 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:41.540069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f849f3-2ea0-4a42-8153-db17f3ed3942 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:41.542123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f849f3-2ea0-4a42-8153-db17f3ed3942 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:41.551074 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ba0a3-adf0-4fd0-918a-379639db6b07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:41.557784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 415/848] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:41.558652 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f849f3-2ea0-4a42-8153-db17f3ed3942 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:41.559384 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-874ba0a3-adf0-4fd0-918a-379639db6b07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:26:41.559384 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:41.559384 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:41.559384 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:41.559384 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:41.559384 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:41.559384 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:41.559384 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:41.559384 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:41.559384 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:41.559384 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:41.559384 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:41.559384 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:41.559384 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:41.559384 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:41.559384 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:41.560378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:41.560378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:41.560378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:41.560378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:41.560378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:41.560378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:41.560378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:41.560378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:41.560378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:41.560378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:41.560378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:41.560378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:41.560378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:41.560378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:41.560378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:41.560378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:41.561279 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:41.561279 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:41.561279 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:41.561279 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:41.561279 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:41.561279 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:41.561279 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:41.561279 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:41.561279 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:41.561279 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:41.561279 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:26:41.561279 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:41.561279 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 434/849] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:26:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:41.562012 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b19d69-9117-4a5a-a8eb-b037bf39e5ef None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:41.562012 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b19d69-9117-4a5a-a8eb-b037bf39e5ef None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:41.562940 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b19d69-9117-4a5a-a8eb-b037bf39e5ef None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:41.563578 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 435/850] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:41.565178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b19d69-9117-4a5a-a8eb-b037bf39e5ef None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:41.581373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:41.629017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:41.663886 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f849f3-2ea0-4a42-8153-db17f3ed3942 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:41.671993 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b19d69-9117-4a5a-a8eb-b037bf39e5ef None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:41.698814 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84499f64-5152-4774-bea1-4b3f866a7dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:41.699416 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84499f64-5152-4774-bea1-4b3f866a7dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:41.699699 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84499f64-5152-4774-bea1-4b3f866a7dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:41.699977 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84499f64-5152-4774-bea1-4b3f866a7dd5 None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:41.700656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84499f64-5152-4774-bea1-4b3f866a7dd5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:41.700964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84499f64-5152-4774-bea1-4b3f866a7dd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:41.702342 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84499f64-5152-4774-bea1-4b3f866a7dd5 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:41.705798 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d99e9-ef8b-4081-b7e3-feb74750cea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:41.706424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d99e9-ef8b-4081-b7e3-feb74750cea9 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:41.706712 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d99e9-ef8b-4081-b7e3-feb74750cea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:41.706939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 416/851] 10.222.0.69 () {56 vars in 1114 bytes} [Mon Aug 29 21:26:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:41.707034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d99e9-ef8b-4081-b7e3-feb74750cea9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:41.707544 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84499f64-5152-4774-bea1-4b3f866a7dd5 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:41.715023 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d99e9-ef8b-4081-b7e3-feb74750cea9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:41.716488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d99e9-ef8b-4081-b7e3-feb74750cea9 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:41.728130 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-4c3d99e9-ef8b-4081-b7e3-feb74750cea9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:41.728130 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:41.728130 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:41.728130 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:41.728130 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:41.728130 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:41.728130 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:41.728130 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:41.728130 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:41.728130 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:41.728130 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:41.728130 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:41.728130 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:41.728130 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:41.728130 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:41.729211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:41.729211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:41.729211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:41.729211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:41.729211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:41.729211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:41.729211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:41.729211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:41.729211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:41.729211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:41.729211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:41.729211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:41.729211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:41.729211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:41.729211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:41.729211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:41.729211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:41.730115 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:41.730115 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:41.730115 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:41.730115 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:41.730115 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:41.730115 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:41.730115 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:41.730115 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:41.730115 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 436/852] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:41.730640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c268b8-f914-470a-a22c-860e20178405 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:41.731194 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c268b8-f914-470a-a22c-860e20178405 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:41.731194 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c268b8-f914-470a-a22c-860e20178405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:41.749766 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f1c268b8-f914-470a-a22c-860e20178405 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:41.750890 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f1c268b8-f914-470a-a22c-860e20178405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:41.796357 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:41.816056 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84499f64-5152-4774-bea1-4b3f866a7dd5 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:41.818328 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 437/853] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:26:41.819181 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c268b8-f914-470a-a22c-860e20178405 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:41.854273 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa8d63-1711-4daf-96d5-f62e0629906f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:41.854887 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa8d63-1711-4daf-96d5-f62e0629906f None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:41.855171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa8d63-1711-4daf-96d5-f62e0629906f None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:41.855445 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa8d63-1711-4daf-96d5-f62e0629906f None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:41.856114 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa8d63-1711-4daf-96d5-f62e0629906f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:41.856469 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa8d63-1711-4daf-96d5-f62e0629906f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:41.858102 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa8d63-1711-4daf-96d5-f62e0629906f None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:41.867532 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 417/854] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:26:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:41.868375 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa8d63-1711-4daf-96d5-f62e0629906f None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:41.881795 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:41.945367 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c268b8-f914-470a-a22c-860e20178405 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:41.984887 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6cef9-9b07-44bf-b01d-bdeb97e4b444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:41.985501 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6cef9-9b07-44bf-b01d-bdeb97e4b444 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:41.985778 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6cef9-9b07-44bf-b01d-bdeb97e4b444 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:41.986048 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6cef9-9b07-44bf-b01d-bdeb97e4b444 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:41.986666 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6cef9-9b07-44bf-b01d-bdeb97e4b444 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:41.986968 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6cef9-9b07-44bf-b01d-bdeb97e4b444 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:41.988348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6cef9-9b07-44bf-b01d-bdeb97e4b444 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:41.993680 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 438/855] 10.222.0.69 () {56 vars in 1114 bytes} [Mon Aug 29 21:26:41 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:41.994492 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6cef9-9b07-44bf-b01d-bdeb97e4b444 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:42.009156 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa8d63-1711-4daf-96d5-f62e0629906f None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:42.062088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcf3db-de5a-40f2-af06-85fca87e04f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:42.063844 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcf3db-de5a-40f2-af06-85fca87e04f2 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:42.064368 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcf3db-de5a-40f2-af06-85fca87e04f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:42.065090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcf3db-de5a-40f2-af06-85fca87e04f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:42.066271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fcf3db-de5a-40f2-af06-85fca87e04f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:42.066787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fcf3db-de5a-40f2-af06-85fca87e04f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:42.069150 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fcf3db-de5a-40f2-af06-85fca87e04f2 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:42.092009 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 418/856] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:42.093825 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcf3db-de5a-40f2-af06-85fca87e04f2 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:42.102811 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:42.122814 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6cef9-9b07-44bf-b01d-bdeb97e4b444 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:42.143481 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:42.164396 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b68032-78a7-4bc7-bd71-a204bd0c2aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:42.165046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b68032-78a7-4bc7-bd71-a204bd0c2aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:42.165329 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b68032-78a7-4bc7-bd71-a204bd0c2aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:42.165603 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b68032-78a7-4bc7-bd71-a204bd0c2aa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:42.178790 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b68032-78a7-4bc7-bd71-a204bd0c2aa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:42.180268 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b68032-78a7-4bc7-bd71-a204bd0c2aa5 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:42.204628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-84b68032-78a7-4bc7-bd71-a204bd0c2aa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:42.204628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:42.204628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:42.204628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:42.204628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:42.204628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:42.204628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:42.204628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:42.204628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:42.204628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:42.204628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:42.204628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:42.204628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:42.204628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:42.204628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:42.204628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:42.205920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:42.205920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:42.205920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:42.205920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:42.205920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:42.205920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:42.205920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:42.205920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:42.205920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:42.205920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:42.205920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:42.205920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:42.205920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:42.205920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:42.205920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:42.205920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:42.205920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:42.206912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:42.206912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:42.206912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:42.206912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 439/857] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:42.207372 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b68032-78a7-4bc7-bd71-a204bd0c2aa5 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:42.235447 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcf3db-de5a-40f2-af06-85fca87e04f2 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:42.283170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88691f-224c-493b-8925-c1c3d118f5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:42.283755 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88691f-224c-493b-8925-c1c3d118f5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:42.284122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88691f-224c-493b-8925-c1c3d118f5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:42.284426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88691f-224c-493b-8925-c1c3d118f5f6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:42.285023 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88691f-224c-493b-8925-c1c3d118f5f6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:42.286391 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88691f-224c-493b-8925-c1c3d118f5f6 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:42.299028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-5c88691f-224c-493b-8925-c1c3d118f5f6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:26:42.299028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:42.299028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:26:42.299028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:26:42.299028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:26:42.299028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:26:42.299028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:26:42.299028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:42.299028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:26:42.299028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:42.299028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:26:42.299028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:42.299028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:42.299028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:42.299028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:42.299028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:42.300367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:42.300367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:42.300367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:42.300367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:42.300367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:42.300367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:42.300367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:42.300367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:26:42.300367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:26:42.300367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:26:42.300367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:26:42.300367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:42.300367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:42.300367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:42.300367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:42.300367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:42.300367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:42.301293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:42.301293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:42.301293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:42.301293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:42.301293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:42.301293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:42.301293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:42.301293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:42.301293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:42.301293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:42.301293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:26:42.301293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:42.301293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:26:42.301293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:42.306689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 419/858] 10.222.0.69 () {56 vars in 1132 bytes} [Mon Aug 29 21:26:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:42.307468 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88691f-224c-493b-8925-c1c3d118f5f6 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:42.348098 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b68032-78a7-4bc7-bd71-a204bd0c2aa5 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:42.392792 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10c23b-d646-4887-9b0b-e644687aad84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:42.393523 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10c23b-d646-4887-9b0b-e644687aad84 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:42.393805 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10c23b-d646-4887-9b0b-e644687aad84 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:42.394317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10c23b-d646-4887-9b0b-e644687aad84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:42.395306 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:42.395636 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10c23b-d646-4887-9b0b-e644687aad84 None admin] RBAC: Adding query filter params (role.id=3766508ffa094bb5bbec6d9209745261, scope.project.id=a302406c548c43c983625c0d66da47cc, user.id=540e06e694524c4a9e84ebebd45956d6) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:42.395933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10c23b-d646-4887-9b0b-e644687aad84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:42.398274 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10c23b-d646-4887-9b0b-e644687aad84 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:42.416751 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 440/859] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:26:42 2022] GET /identity/v3/role_assignments?user.id=540e06e694524c4a9e84ebebd45956d6&scope.project.id=a302406c548c43c983625c0d66da47cc&role.id=3766508ffa094bb5bbec6d9209745261 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:42.418173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10c23b-d646-4887-9b0b-e644687aad84 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:42.455037 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88691f-224c-493b-8925-c1c3d118f5f6 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:42.477691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:42.504383 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fdbfb-47ee-4839-b56f-c28094516d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:42.505065 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fdbfb-47ee-4839-b56f-c28094516d6d None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:42.505402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fdbfb-47ee-4839-b56f-c28094516d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:42.505728 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fdbfb-47ee-4839-b56f-c28094516d6d None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:42.506403 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44fdbfb-47ee-4839-b56f-c28094516d6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:42.506714 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44fdbfb-47ee-4839-b56f-c28094516d6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:42.508330 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44fdbfb-47ee-4839-b56f-c28094516d6d None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:42.523701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 420/860] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:42.529203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fdbfb-47ee-4839-b56f-c28094516d6d None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:42.585048 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10c23b-d646-4887-9b0b-e644687aad84 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:42.628957 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5969db-4328-405e-ac6b-be7737104d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:42.629580 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5969db-4328-405e-ac6b-be7737104d38 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:42.631431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5969db-4328-405e-ac6b-be7737104d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:42.631699 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5969db-4328-405e-ac6b-be7737104d38 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:42.632943 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5969db-4328-405e-ac6b-be7737104d38 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:42.633253 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5969db-4328-405e-ac6b-be7737104d38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:42.634723 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5969db-4328-405e-ac6b-be7737104d38 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:42.642906 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 441/861] 10.222.0.69 () {56 vars in 1126 bytes} [Mon Aug 29 21:26:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:42.650809 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5969db-4328-405e-ac6b-be7737104d38 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:42.682562 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fdbfb-47ee-4839-b56f-c28094516d6d None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:42.724206 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:42.746912 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edf57a-1f9b-4180-8b70-39bbab62fd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:42.747945 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edf57a-1f9b-4180-8b70-39bbab62fd7e None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:42.748526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edf57a-1f9b-4180-8b70-39bbab62fd7e None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:42.749020 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edf57a-1f9b-4180-8b70-39bbab62fd7e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:42.774699 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edf57a-1f9b-4180-8b70-39bbab62fd7e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:42.775859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:42.778179 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edf57a-1f9b-4180-8b70-39bbab62fd7e None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:42.783119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5969db-4328-405e-ac6b-be7737104d38 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:42.793348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-d9edf57a-1f9b-4180-8b70-39bbab62fd7e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:26:42.793348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:42.793348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:42.793348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:42.793348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:42.793348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:42.793348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:42.793348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:42.793348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:42.793348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:42.793348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:42.793348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:42.793348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:42.793348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:42.793348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:42.793348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:42.795420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:42.795420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:42.795420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:42.795420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:42.795420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:42.795420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:42.795420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:42.795420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:42.795420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:42.795420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:42.795420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:42.795420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:42.795420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:42.795420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:42.795420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:42.795420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:42.795420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:42.795420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:42.796958 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:42.796958 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:42.796958 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:42.796958 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:42.796958 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:42.796958 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:42.796958 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:42.796958 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:42.796958 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:26:42.796958 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:42.796958 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 421/862] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:26:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:42.804059 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edf57a-1f9b-4180-8b70-39bbab62fd7e None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:42.829146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385933ca-20cd-4b1e-8342-03c098575604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:42.830520 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385933ca-20cd-4b1e-8342-03c098575604 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:42.830976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385933ca-20cd-4b1e-8342-03c098575604 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:42.831399 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385933ca-20cd-4b1e-8342-03c098575604 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:42.832219 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385933ca-20cd-4b1e-8342-03c098575604 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:42.832687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385933ca-20cd-4b1e-8342-03c098575604 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:42.834331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385933ca-20cd-4b1e-8342-03c098575604 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:42.840370 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 442/863] 10.222.0.69 () {56 vars in 1126 bytes} [Mon Aug 29 21:26:42 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:42.930624 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edf57a-1f9b-4180-8b70-39bbab62fd7e None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:42.972329 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fbc29-19e8-4444-8ff6-a175d0391816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:42.973198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fbc29-19e8-4444-8ff6-a175d0391816 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:42.973576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fbc29-19e8-4444-8ff6-a175d0391816 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:42.973950 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fbc29-19e8-4444-8ff6-a175d0391816 None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:42.974830 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fbc29-19e8-4444-8ff6-a175d0391816 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:42.975326 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fbc29-19e8-4444-8ff6-a175d0391816 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:42.976988 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fbc29-19e8-4444-8ff6-a175d0391816 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:42.999139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 422/864] 10.222.0.69 () {56 vars in 1135 bytes} [Mon Aug 29 21:26:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:43.005105 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385933ca-20cd-4b1e-8342-03c098575604 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:43.125931 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385933ca-20cd-4b1e-8342-03c098575604 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:43.166123 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f06c1-0374-4a64-940b-e193969a8cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:43.168860 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f06c1-0374-4a64-940b-e193969a8cbc None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:43.168860 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f06c1-0374-4a64-940b-e193969a8cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:43.168860 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f06c1-0374-4a64-940b-e193969a8cbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:43.201020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:43.248663 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f06c1-0374-4a64-940b-e193969a8cbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:43.250296 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f06c1-0374-4a64-940b-e193969a8cbc None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:43.360141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 443/865] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:26:43 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:26:43.365973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fbc29-19e8-4444-8ff6-a175d0391816 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:43.421040 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:43.478462 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fbc29-19e8-4444-8ff6-a175d0391816 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:43.516066 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4f03e-cb1a-4149-9095-f83e7705cde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:43.516739 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4f03e-cb1a-4149-9095-f83e7705cde7 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:43.517019 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4f03e-cb1a-4149-9095-f83e7705cde7 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:43.517293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4f03e-cb1a-4149-9095-f83e7705cde7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:43.527921 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4f03e-cb1a-4149-9095-f83e7705cde7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:43.529417 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4f03e-cb1a-4149-9095-f83e7705cde7 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:43.545534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-3df4f03e-cb1a-4149-9095-f83e7705cde7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:43.545534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:43.545534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:43.545534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:43.545534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:43.545534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:43.545534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:43.545534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:43.545534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:43.545534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:43.545534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:43.545534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:43.545534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:43.545534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:43.545534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:43.545534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:43.546537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:43.546537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:43.546537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:43.546537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:43.546537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:43.546537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:43.546537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:43.546537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:43.546537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:43.546537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:43.546537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:43.546537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:43.546537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:43.546537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:43.546537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:43.546537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:43.546537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:43.547443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:43.547443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:43.547443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:43.547443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 423/866] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:43.552652 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f06c1-0374-4a64-940b-e193969a8cbc None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:43.617323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:43.660895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f06c1-0374-4a64-940b-e193969a8cbc None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:43.698012 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33605374-3e82-4bad-a49d-24ed860192e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:43.698810 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33605374-3e82-4bad-a49d-24ed860192e0 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:43.699305 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33605374-3e82-4bad-a49d-24ed860192e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:43.699524 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33605374-3e82-4bad-a49d-24ed860192e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:43.700197 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33605374-3e82-4bad-a49d-24ed860192e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:43.700540 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33605374-3e82-4bad-a49d-24ed860192e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:43.701918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33605374-3e82-4bad-a49d-24ed860192e0 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:43.715315 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 444/867] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:43.721121 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4f03e-cb1a-4149-9095-f83e7705cde7 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:43.823525 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:43.827194 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4f03e-cb1a-4149-9095-f83e7705cde7 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:43.863541 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07a411-c355-4bca-a61a-44cb4793fa38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:43.864274 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07a411-c355-4bca-a61a-44cb4793fa38 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:43.864561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07a411-c355-4bca-a61a-44cb4793fa38 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:43.864843 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07a411-c355-4bca-a61a-44cb4793fa38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:43.872336 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07a411-c355-4bca-a61a-44cb4793fa38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:43.873782 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07a411-c355-4bca-a61a-44cb4793fa38 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:43.885350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-af07a411-c355-4bca-a61a-44cb4793fa38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:43.885350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:43.885350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:43.885350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:43.885350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:43.885350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:43.885350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:43.885350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:43.885350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:43.885350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:43.885350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:43.885350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:43.885350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:43.885350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:43.885350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:43.886308 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:43.886308 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:43.886308 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:43.886308 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:43.886308 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:43.886308 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:43.886308 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:43.886308 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:43.886308 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:43.886308 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:43.886308 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:43.886308 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:43.886308 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:43.886308 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:43.886308 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:43.886308 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:43.886308 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:43.887209 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:43.887209 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:43.887209 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:43.887209 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:43.887209 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:43.887209 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:43.887209 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:43.887209 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:43.887209 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 424/868] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:43.892606 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33605374-3e82-4bad-a49d-24ed860192e0 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:44.001640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33605374-3e82-4bad-a49d-24ed860192e0 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:44.023925 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:44.042078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad848d-3be3-4511-b1e6-660c38cf273b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:44.043043 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad848d-3be3-4511-b1e6-660c38cf273b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:44.043554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad848d-3be3-4511-b1e6-660c38cf273b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:44.044035 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad848d-3be3-4511-b1e6-660c38cf273b None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:44.044983 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad848d-3be3-4511-b1e6-660c38cf273b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:44.045510 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad848d-3be3-4511-b1e6-660c38cf273b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:44.047154 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad848d-3be3-4511-b1e6-660c38cf273b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:44.062240 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 445/869] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:44.071098 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad848d-3be3-4511-b1e6-660c38cf273b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:44.071298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de97352-fe6c-49bc-9b85-c1731688716c None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:44.071298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de97352-fe6c-49bc-9b85-c1731688716c None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:44.071298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de97352-fe6c-49bc-9b85-c1731688716c None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:44.071298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 425/870] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:44.077070 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892372cf-308b-4bce-964b-4f9c00dd42db None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:44.077352 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892372cf-308b-4bce-964b-4f9c00dd42db None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:44.077626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892372cf-308b-4bce-964b-4f9c00dd42db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:44.097536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-892372cf-308b-4bce-964b-4f9c00dd42db None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:44.098716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-892372cf-308b-4bce-964b-4f9c00dd42db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:44.175629 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 426/871] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:26:44.200932 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad848d-3be3-4511-b1e6-660c38cf273b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:44.238633 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27337f26-b821-4ace-a1e3-55bcb3a02070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:44.239679 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27337f26-b821-4ace-a1e3-55bcb3a02070 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:44.239967 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27337f26-b821-4ace-a1e3-55bcb3a02070 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:44.240273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27337f26-b821-4ace-a1e3-55bcb3a02070 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:44.241014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27337f26-b821-4ace-a1e3-55bcb3a02070 None admin] RBAC: Adding query filter params (role.id=69369872661e4179bb51cd1ca76e28c3, scope.project.id=a302406c548c43c983625c0d66da47cc, user.id=714a2ba019144211931dbe853f1960aa) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:44.241330 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27337f26-b821-4ace-a1e3-55bcb3a02070 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:44.242841 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27337f26-b821-4ace-a1e3-55bcb3a02070 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:44.249882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 446/872] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:26:44 2022] GET /identity/v3/role_assignments?user.id=714a2ba019144211931dbe853f1960aa&scope.project.id=a302406c548c43c983625c0d66da47cc&role.id=69369872661e4179bb51cd1ca76e28c3 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:44.471413 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892372cf-308b-4bce-964b-4f9c00dd42db None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:44.566082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:44.570692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f023d-0ff9-437c-bb5a-630b1f74f1a2 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:44.570984 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f023d-0ff9-437c-bb5a-630b1f74f1a2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:44.571260 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f023d-0ff9-437c-bb5a-630b1f74f1a2 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:44.573416 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 447/873] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:44.578516 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9c2e3-c33e-4acb-a714-85df36a674a9 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:44.578837 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9c2e3-c33e-4acb-a714-85df36a674a9 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:44.579091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9c2e3-c33e-4acb-a714-85df36a674a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:44.582021 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892372cf-308b-4bce-964b-4f9c00dd42db None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:44.599482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-fdf9c2e3-c33e-4acb-a714-85df36a674a9 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:44.601042 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fdf9c2e3-c33e-4acb-a714-85df36a674a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:44.630910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c1d4a-fdbd-428c-812f-0c1c21393215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:44.631527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c1d4a-fdbd-428c-812f-0c1c21393215 None admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:44.631802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c1d4a-fdbd-428c-812f-0c1c21393215 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:44.632138 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c1d4a-fdbd-428c-812f-0c1c21393215 None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:44.632919 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c1d4a-fdbd-428c-812f-0c1c21393215 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:44.634286 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c1d4a-fdbd-428c-812f-0c1c21393215 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:44.652469 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 427/874] 10.222.0.69 () {60 vars in 1141 bytes} [Mon Aug 29 21:26:44 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:26:44.660721 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:44.708566 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 448/875] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:44 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:26:44.970545 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c4e3c-a16d-47b7-bd47-da02f47d3fc8 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:44.971085 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c4e3c-a16d-47b7-bd47-da02f47d3fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:44.971085 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c4e3c-a16d-47b7-bd47-da02f47d3fc8 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:44.972713 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 428/876] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:44.978095 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ffba6-f98f-4811-a9ad-0be8b6e73990 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:44.978563 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ffba6-f98f-4811-a9ad-0be8b6e73990 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:44.979182 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ffba6-f98f-4811-a9ad-0be8b6e73990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:44.979583 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c4e3c-a16d-47b7-bd47-da02f47d3fc8 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:45.000656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-9e3ffba6-f98f-4811-a9ad-0be8b6e73990 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:45.001857 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9e3ffba6-f98f-4811-a9ad-0be8b6e73990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:45.087596 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 449/877] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:44 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:26:45.115409 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c4e3c-a16d-47b7-bd47-da02f47d3fc8 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:45.154238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb3323-fb9f-476d-adc9-8d2fae405010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:45.154942 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb3323-fb9f-476d-adc9-8d2fae405010 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:45.155218 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb3323-fb9f-476d-adc9-8d2fae405010 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:45.155488 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb3323-fb9f-476d-adc9-8d2fae405010 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:45.173819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb3323-fb9f-476d-adc9-8d2fae405010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:45.178862 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-1bdb3323-fb9f-476d-adc9-8d2fae405010 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:26:45.178862 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:45.178862 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:45.178862 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:45.178862 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:45.178862 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:45.178862 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:45.178862 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:45.178862 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:45.178862 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:45.178862 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:45.178862 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:45.178862 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:45.178862 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:45.178862 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:45.178862 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:45.179816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:45.179816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:45.179816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:45.179816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:45.179816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:45.179816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:45.179816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:45.179816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:45.179816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:45.179816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:45.179816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:45.179816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:45.179816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:45.179816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:45.179816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:45.179816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:45.180726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:45.180726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:45.180726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:45.180726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:45.180726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:45.180726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:45.180726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:45.180726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:45.180726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:45.180726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:45.180726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:26:45.180726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:45.180726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 429/878] 10.222.0.69 () {56 vars in 1120 bytes} [Mon Aug 29 21:26:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:45.189298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ffba6-f98f-4811-a9ad-0be8b6e73990 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:45.295952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:45.299454 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ffba6-f98f-4811-a9ad-0be8b6e73990 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:45.340225 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634af673-8e23-4c16-b90a-fd1f31e2e95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:45.340840 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634af673-8e23-4c16-b90a-fd1f31e2e95c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:45.341124 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634af673-8e23-4c16-b90a-fd1f31e2e95c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:45.341402 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634af673-8e23-4c16-b90a-fd1f31e2e95c None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:45.342078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634af673-8e23-4c16-b90a-fd1f31e2e95c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:45.342453 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634af673-8e23-4c16-b90a-fd1f31e2e95c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:45.343827 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634af673-8e23-4c16-b90a-fd1f31e2e95c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:45.352793 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 450/879] 10.222.0.69 () {56 vars in 1115 bytes} [Mon Aug 29 21:26:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:45.358584 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb3323-fb9f-476d-adc9-8d2fae405010 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:45.375544 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:45.390850 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634af673-8e23-4c16-b90a-fd1f31e2e95c None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:45.500094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb3323-fb9f-476d-adc9-8d2fae405010 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:45.504895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634af673-8e23-4c16-b90a-fd1f31e2e95c None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:45.539840 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288aaa14-2ca5-45d6-9046-55e284f4e3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:45.540896 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aaa14-2ca5-45d6-9046-55e284f4e3c9 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:45.541925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aaa14-2ca5-45d6-9046-55e284f4e3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:45.542419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aaa14-2ca5-45d6-9046-55e284f4e3c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:45.549146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cc39b-67a7-4cc5-b3b6-41a749088246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:45.549702 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cc39b-67a7-4cc5-b3b6-41a749088246 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:45.549988 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cc39b-67a7-4cc5-b3b6-41a749088246 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:45.550265 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cc39b-67a7-4cc5-b3b6-41a749088246 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:45.551495 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cc39b-67a7-4cc5-b3b6-41a749088246 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:45.552925 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cc39b-67a7-4cc5-b3b6-41a749088246 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:45.555693 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288aaa14-2ca5-45d6-9046-55e284f4e3c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:45.558096 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288aaa14-2ca5-45d6-9046-55e284f4e3c9 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:45.573137 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 451/880] 10.222.0.69 () {60 vars in 1141 bytes} [Mon Aug 29 21:26:45 2022] POST /identity/v3/services => generated 269 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:26:45.584385 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-288aaa14-2ca5-45d6-9046-55e284f4e3c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:45.584385 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:45.584385 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:45.584385 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:45.584385 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:45.584385 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:45.584385 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:45.584385 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:45.584385 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:45.584385 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:45.584385 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:45.584385 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:45.584385 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:45.584385 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:45.584385 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:45.584385 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:45.585561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:45.585561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:45.585561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:45.585561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:45.585561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:45.585561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:45.585561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:45.585561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:45.585561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:45.585561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:45.585561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:45.585561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:45.585561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:45.585561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:45.585561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:45.585561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:45.585561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:45.587197 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:45.587197 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:45.587197 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:45.587197 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 430/881] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:45.592041 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cc39b-67a7-4cc5-b3b6-41a749088246 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:45.622684 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:45.724760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cc39b-67a7-4cc5-b3b6-41a749088246 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:45.765711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171b8d5-a769-4ef1-b37f-2ed324968d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:45.766688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171b8d5-a769-4ef1-b37f-2ed324968d05 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:45.767178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171b8d5-a769-4ef1-b37f-2ed324968d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:45.767660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171b8d5-a769-4ef1-b37f-2ed324968d05 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:45.768595 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171b8d5-a769-4ef1-b37f-2ed324968d05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:45.769094 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171b8d5-a769-4ef1-b37f-2ed324968d05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:45.770904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171b8d5-a769-4ef1-b37f-2ed324968d05 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:45.784529 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 452/882] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:45.789798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288aaa14-2ca5-45d6-9046-55e284f4e3c9 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:45.860453 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:45.905945 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288aaa14-2ca5-45d6-9046-55e284f4e3c9 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:45.942317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c422d93-4676-43bc-a26a-44c13b771f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:45.943325 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c422d93-4676-43bc-a26a-44c13b771f00 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:45.943814 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c422d93-4676-43bc-a26a-44c13b771f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:45.944346 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c422d93-4676-43bc-a26a-44c13b771f00 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:45.952740 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c422d93-4676-43bc-a26a-44c13b771f00 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:45.954488 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c422d93-4676-43bc-a26a-44c13b771f00 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:45.967588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-4c422d93-4676-43bc-a26a-44c13b771f00 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:26:45.967588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:45.967588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:45.967588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:45.967588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:45.967588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:45.967588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:45.967588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:45.967588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:45.967588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:45.967588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:45.967588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:45.967588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:45.967588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:45.967588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:45.967588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:45.968679 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:45.968679 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:45.968679 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:45.968679 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:45.968679 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:45.968679 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:45.968679 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:45.968679 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:45.968679 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:45.968679 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:45.968679 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:45.968679 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:45.968679 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:45.968679 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:45.968679 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:45.968679 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:45.968679 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:45.968679 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:45.969642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:45.969642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:45.969642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:45.969642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:45.969642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:45.969642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:45.969642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:45.969642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:45.969642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:26:45.969642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:45.972208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 431/883] 10.222.0.69 () {56 vars in 1117 bytes} [Mon Aug 29 21:26:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:45.977938 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171b8d5-a769-4ef1-b37f-2ed324968d05 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:46.062565 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:46.087485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171b8d5-a769-4ef1-b37f-2ed324968d05 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:46.126132 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda016b-354f-4697-b037-c0def717988a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:46.126735 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda016b-354f-4697-b037-c0def717988a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:46.127027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda016b-354f-4697-b037-c0def717988a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:46.127357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda016b-354f-4697-b037-c0def717988a None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:46.128155 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda016b-354f-4697-b037-c0def717988a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:46.128501 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda016b-354f-4697-b037-c0def717988a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:46.129934 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda016b-354f-4697-b037-c0def717988a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:46.149442 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 453/884] 10.222.0.69 () {56 vars in 1149 bytes} [Mon Aug 29 21:26:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:46.155253 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c422d93-4676-43bc-a26a-44c13b771f00 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:46.264076 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c422d93-4676-43bc-a26a-44c13b771f00 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:46.286317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:46.288649 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72feccd-cf3c-44db-88f7-566c492f8d4f None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:46.289042 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72feccd-cf3c-44db-88f7-566c492f8d4f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:46.289412 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72feccd-cf3c-44db-88f7-566c492f8d4f None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:46.291224 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 454/885] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:46.296415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c883006-c97d-426e-ba5f-d785b6de8366 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:46.296798 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c883006-c97d-426e-ba5f-d785b6de8366 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:46.297410 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c883006-c97d-426e-ba5f-d785b6de8366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:46.302816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670967ac-2e88-4020-96a9-3793d33937cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:46.303629 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670967ac-2e88-4020-96a9-3793d33937cf None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:46.304129 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670967ac-2e88-4020-96a9-3793d33937cf None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:46.304598 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670967ac-2e88-4020-96a9-3793d33937cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:46.315695 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-2c883006-c97d-426e-ba5f-d785b6de8366 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:46.317224 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2c883006-c97d-426e-ba5f-d785b6de8366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:46.384345 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670967ac-2e88-4020-96a9-3793d33937cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:46.386668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670967ac-2e88-4020-96a9-3793d33937cf None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:46.416222 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 455/886] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:46 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:26:46.512811 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 432/887] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:26:46 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:26:46.518121 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c883006-c97d-426e-ba5f-d785b6de8366 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:46.587637 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:46.624446 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c883006-c97d-426e-ba5f-d785b6de8366 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:46.660528 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c6ba2-0214-4f29-83a1-14777a955405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:46.661087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c6ba2-0214-4f29-83a1-14777a955405 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:46.661369 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c6ba2-0214-4f29-83a1-14777a955405 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:46.661645 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c6ba2-0214-4f29-83a1-14777a955405 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:46.672221 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c6ba2-0214-4f29-83a1-14777a955405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:46.673241 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4acc4c-cbf4-49e0-b7ae-54bf0cdfe06c None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:46.673535 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4acc4c-cbf4-49e0-b7ae-54bf0cdfe06c None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:46.673811 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4acc4c-cbf4-49e0-b7ae-54bf0cdfe06c None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:46.673915 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c6ba2-0214-4f29-83a1-14777a955405 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:46.675393 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 433/888] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:46.680514 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08f7a3-5fae-4105-aed5-6357bfc3943c None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:46.680800 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08f7a3-5fae-4105-aed5-6357bfc3943c None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:46.681081 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08f7a3-5fae-4105-aed5-6357bfc3943c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:46.689656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-246c6ba2-0214-4f29-83a1-14777a955405 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:46.689656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:46.689656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:46.689656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:46.689656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:46.689656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:46.689656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:46.689656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:46.689656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:46.689656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:46.689656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:46.689656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:46.689656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:46.689656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:46.689656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:46.689656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:46.690908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:46.690908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:46.690908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:46.690908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:46.690908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:46.690908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:46.690908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:46.690908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:46.690908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:46.690908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:46.690908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:46.690908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:46.690908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:46.690908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:46.690908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:46.690908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:46.690908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:46.691820 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:46.691820 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:46.691820 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:46.691820 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 456/889] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:46.691820 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c6ba2-0214-4f29-83a1-14777a955405 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:46.701218 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-1c08f7a3-5fae-4105-aed5-6357bfc3943c None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:46.702396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-1c08f7a3-5fae-4105-aed5-6357bfc3943c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:46.718656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:46.783096 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 434/890] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:46 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:26:46.784402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08f7a3-5fae-4105-aed5-6357bfc3943c None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:46.826031 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c6ba2-0214-4f29-83a1-14777a955405 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:46.860589 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:46.865584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09026ed-b259-4e91-a636-30fa0cddf8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:46.866328 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09026ed-b259-4e91-a636-30fa0cddf8dc None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:46.866733 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09026ed-b259-4e91-a636-30fa0cddf8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:46.867126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09026ed-b259-4e91-a636-30fa0cddf8dc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:46.867818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09026ed-b259-4e91-a636-30fa0cddf8dc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:46.869836 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09026ed-b259-4e91-a636-30fa0cddf8dc None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:46.879273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-a09026ed-b259-4e91-a636-30fa0cddf8dc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:26:46.879273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:46.879273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:26:46.879273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:26:46.879273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:26:46.879273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:26:46.879273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:26:46.879273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:46.879273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:26:46.879273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:46.879273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:26:46.879273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:46.879273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:46.879273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:46.879273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:46.879273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:46.879273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:46.880470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:46.880470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:46.880470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:46.880470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:46.880470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:46.880470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:46.880470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:26:46.880470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:26:46.880470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:26:46.880470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:26:46.880470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:46.880470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:46.880470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:46.880470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:46.880470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:46.880470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:46.881323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:46.881323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:46.881323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:46.881323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:46.881323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:46.881323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:46.881323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:46.881323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:46.881323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:46.881323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:46.881323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:26:46.881323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:46.881323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:26:46.881323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:46.886947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 457/891] 10.222.0.69 () {56 vars in 1126 bytes} [Mon Aug 29 21:26:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:46.887626 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09026ed-b259-4e91-a636-30fa0cddf8dc None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:46.903276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08f7a3-5fae-4105-aed5-6357bfc3943c None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:46.939768 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3cea9-59ee-4cd5-b249-f3cf67ca1ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:46.940757 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3cea9-59ee-4cd5-b249-f3cf67ca1ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:46.941239 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3cea9-59ee-4cd5-b249-f3cf67ca1ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:46.941713 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3cea9-59ee-4cd5-b249-f3cf67ca1ec8 None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:46.942575 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3cea9-59ee-4cd5-b249-f3cf67ca1ec8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:46.943076 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3cea9-59ee-4cd5-b249-f3cf67ca1ec8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:46.944692 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3cea9-59ee-4cd5-b249-f3cf67ca1ec8 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:46.957609 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 435/892] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:46.962728 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3cea9-59ee-4cd5-b249-f3cf67ca1ec8 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:46.978578 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:46.998176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09026ed-b259-4e91-a636-30fa0cddf8dc None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:47.034683 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d182f-acd8-43ec-8b5d-a972591fc607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:47.036956 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d182f-acd8-43ec-8b5d-a972591fc607 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:47.037437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d182f-acd8-43ec-8b5d-a972591fc607 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:47.037920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d182f-acd8-43ec-8b5d-a972591fc607 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:47.038735 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d182f-acd8-43ec-8b5d-a972591fc607 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:47.039240 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d182f-acd8-43ec-8b5d-a972591fc607 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:47.040825 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d182f-acd8-43ec-8b5d-a972591fc607 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:47.051187 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 458/893] 10.222.0.69 () {56 vars in 1122 bytes} [Mon Aug 29 21:26:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:47.054227 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d182f-acd8-43ec-8b5d-a972591fc607 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:47.075169 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3cea9-59ee-4cd5-b249-f3cf67ca1ec8 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:47.109140 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:47.111510 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f450e-8d1c-4c8d-8f97-fe9dfcc289a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:47.112205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f450e-8d1c-4c8d-8f97-fe9dfcc289a4 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:47.112460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f450e-8d1c-4c8d-8f97-fe9dfcc289a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:47.112737 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f450e-8d1c-4c8d-8f97-fe9dfcc289a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:47.120577 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f450e-8d1c-4c8d-8f97-fe9dfcc289a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:47.122041 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f450e-8d1c-4c8d-8f97-fe9dfcc289a4 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:47.134276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-cf1f450e-8d1c-4c8d-8f97-fe9dfcc289a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:47.134276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:47.134276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:47.134276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:47.134276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:47.134276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:47.134276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:47.134276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:47.134276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:47.134276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:47.134276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:47.134276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:47.134276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:47.134276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:47.134276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:47.135285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:47.135285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:47.135285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:47.135285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:47.135285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:47.135285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:47.135285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:47.135285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:47.135285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:47.135285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:47.135285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:47.135285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:47.135285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:47.135285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:47.135285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:47.135285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:47.135285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:47.141367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:47.141367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:47.141367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:47.141367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:47.141367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:47.141367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:47.141367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:47.141367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:47.141367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 436/894] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:47.141367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f450e-8d1c-4c8d-8f97-fe9dfcc289a4 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:47.180998 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d182f-acd8-43ec-8b5d-a972591fc607 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:47.220503 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:47.222741 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8103a-0915-45e3-82b8-926f7e899164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:47.223496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8103a-0915-45e3-82b8-926f7e899164 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:47.223696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8103a-0915-45e3-82b8-926f7e899164 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:47.223967 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8103a-0915-45e3-82b8-926f7e899164 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:47.224625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8103a-0915-45e3-82b8-926f7e899164 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:47.224928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8103a-0915-45e3-82b8-926f7e899164 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:47.226317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8103a-0915-45e3-82b8-926f7e899164 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:47.232952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 459/895] 10.222.0.69 () {56 vars in 1122 bytes} [Mon Aug 29 21:26:47 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:47.245795 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8103a-0915-45e3-82b8-926f7e899164 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:47.257972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f450e-8d1c-4c8d-8f97-fe9dfcc289a4 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:47.301838 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89278069-7bf6-483a-96ef-90e010f938bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:47.301838 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89278069-7bf6-483a-96ef-90e010f938bc None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:47.302160 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89278069-7bf6-483a-96ef-90e010f938bc None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:47.302483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89278069-7bf6-483a-96ef-90e010f938bc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:47.303210 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89278069-7bf6-483a-96ef-90e010f938bc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:47.304770 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89278069-7bf6-483a-96ef-90e010f938bc None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:47.317227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-89278069-7bf6-483a-96ef-90e010f938bc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:26:47.317227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:47.317227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:26:47.317227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:26:47.317227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:26:47.317227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:26:47.317227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:26:47.317227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:47.317227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:26:47.317227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:47.317227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:26:47.317227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:47.317227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:47.317227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:47.317227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:47.317227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:47.317227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:47.318401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:47.318401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:47.318401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:47.318401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:47.318401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:47.318401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:47.318401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:26:47.318401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:26:47.318401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:26:47.318401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:26:47.318401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:47.318401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:47.318401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:47.318401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:47.318401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:47.318401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:47.319270 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:47.319270 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:47.319270 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:47.319270 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:47.319270 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:47.319270 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:47.319270 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:47.319270 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:47.319270 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:47.319270 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:47.319270 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:26:47.319270 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:47.319270 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:26:47.319270 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:47.323820 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 437/896] 10.222.0.69 () {56 vars in 1114 bytes} [Mon Aug 29 21:26:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:47.324904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89278069-7bf6-483a-96ef-90e010f938bc None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:47.405975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8103a-0915-45e3-82b8-926f7e899164 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:47.422628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:47.449077 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a56a7e-9ce6-486c-bcaa-378f2bd1784e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:47.449700 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a56a7e-9ce6-486c-bcaa-378f2bd1784e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:47.449985 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a56a7e-9ce6-486c-bcaa-378f2bd1784e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:47.450260 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a56a7e-9ce6-486c-bcaa-378f2bd1784e None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:47.450960 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a56a7e-9ce6-486c-bcaa-378f2bd1784e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:47.451267 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a56a7e-9ce6-486c-bcaa-378f2bd1784e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:47.452861 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a56a7e-9ce6-486c-bcaa-378f2bd1784e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:47.471130 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 460/897] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:47.471319 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89278069-7bf6-483a-96ef-90e010f938bc None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:47.472297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a56a7e-9ce6-486c-bcaa-378f2bd1784e None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:47.509591 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9ae9e-0e21-4d3e-81a4-e4ef856a8356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:47.510743 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9ae9e-0e21-4d3e-81a4-e4ef856a8356 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:47.511251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9ae9e-0e21-4d3e-81a4-e4ef856a8356 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:47.511766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9ae9e-0e21-4d3e-81a4-e4ef856a8356 None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:47.512451 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9ae9e-0e21-4d3e-81a4-e4ef856a8356 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:47.512757 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9ae9e-0e21-4d3e-81a4-e4ef856a8356 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:47.514131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9ae9e-0e21-4d3e-81a4-e4ef856a8356 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:47.515464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:47.524340 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 438/898] 10.222.0.69 () {56 vars in 1114 bytes} [Mon Aug 29 21:26:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:47.528139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9ae9e-0e21-4d3e-81a4-e4ef856a8356 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:47.604824 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a56a7e-9ce6-486c-bcaa-378f2bd1784e None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:47.641562 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a204b-4814-4928-bebb-0adf843cf388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:47.642000 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a204b-4814-4928-bebb-0adf843cf388 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:47.642283 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a204b-4814-4928-bebb-0adf843cf388 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:47.642559 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a204b-4814-4928-bebb-0adf843cf388 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:47.643289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a204b-4814-4928-bebb-0adf843cf388 None admin] RBAC: Adding query filter params (role.id=5a3de60a67584f299df269bc459f952f, scope.project.id=a302406c548c43c983625c0d66da47cc, user.id=540e06e694524c4a9e84ebebd45956d6) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:47.643601 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a204b-4814-4928-bebb-0adf843cf388 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:47.645117 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a204b-4814-4928-bebb-0adf843cf388 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:47.656543 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 461/899] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:26:47 2022] GET /identity/v3/role_assignments?user.id=540e06e694524c4a9e84ebebd45956d6&scope.project.id=a302406c548c43c983625c0d66da47cc&role.id=5a3de60a67584f299df269bc459f952f => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:47.662258 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9ae9e-0e21-4d3e-81a4-e4ef856a8356 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:47.704515 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d7c20-6e35-4b5f-87aa-6fb5a658a4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:47.705575 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d7c20-6e35-4b5f-87aa-6fb5a658a4bd None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:47.706067 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d7c20-6e35-4b5f-87aa-6fb5a658a4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:47.706554 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d7c20-6e35-4b5f-87aa-6fb5a658a4bd None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:47.707476 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d7c20-6e35-4b5f-87aa-6fb5a658a4bd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:47.708366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d7c20-6e35-4b5f-87aa-6fb5a658a4bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:47.709821 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ce19a-7fb6-4339-846f-f5835a0696f4 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:47.710110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ce19a-7fb6-4339-846f-f5835a0696f4 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:47.710387 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ce19a-7fb6-4339-846f-f5835a0696f4 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:47.710784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d7c20-6e35-4b5f-87aa-6fb5a658a4bd None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:47.714021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 462/900] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:26:47.718599 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 439/901] 10.222.0.69 () {56 vars in 1114 bytes} [Mon Aug 29 21:26:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:47.724079 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33138d-8b23-46f0-be13-389c5fb08928 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:47.724079 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33138d-8b23-46f0-be13-389c5fb08928 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:47.724079 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33138d-8b23-46f0-be13-389c5fb08928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:47.725589 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d7c20-6e35-4b5f-87aa-6fb5a658a4bd None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:47.741870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-cb33138d-8b23-46f0-be13-389c5fb08928 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:47.743087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cb33138d-8b23-46f0-be13-389c5fb08928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:47.782368 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:47.808568 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:47.844284 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 463/902] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:47 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:26:47.853341 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d7c20-6e35-4b5f-87aa-6fb5a658a4bd None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:47.890589 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353c3ef-66b7-456b-b0b3-0054713e6c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:47.891598 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353c3ef-66b7-456b-b0b3-0054713e6c69 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:47.892087 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353c3ef-66b7-456b-b0b3-0054713e6c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:47.892594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353c3ef-66b7-456b-b0b3-0054713e6c69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:47.893525 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353c3ef-66b7-456b-b0b3-0054713e6c69 None admin] RBAC: Adding query filter params (interface=public, service_id=6a3b8e7445b14beaa34e747769b9ccd8, region_id=RegionOne) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:47.894094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353c3ef-66b7-456b-b0b3-0054713e6c69 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:47.895820 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353c3ef-66b7-456b-b0b3-0054713e6c69 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:47.902901 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 440/903] 10.222.0.69 () {56 vars in 1251 bytes} [Mon Aug 29 21:26:47 2022] GET /identity/v3/endpoints?service_id=6a3b8e7445b14beaa34e747769b9ccd8&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:47.908759 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33138d-8b23-46f0-be13-389c5fb08928 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:48.014072 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33138d-8b23-46f0-be13-389c5fb08928 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:48.049029 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e19f8-393d-4f04-bfe8-849112ee9ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:48.049641 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e19f8-393d-4f04-bfe8-849112ee9ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:48.049921 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e19f8-393d-4f04-bfe8-849112ee9ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:48.050194 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e19f8-393d-4f04-bfe8-849112ee9ed8 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:48.050797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e19f8-393d-4f04-bfe8-849112ee9ed8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:48.052157 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e19f8-393d-4f04-bfe8-849112ee9ed8 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:48.058436 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 464/904] 10.222.0.69 () {56 vars in 1087 bytes} [Mon Aug 29 21:26:47 2022] GET /identity/v3/services => generated 1268 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:26:48.119758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353c3ef-66b7-456b-b0b3-0054713e6c69 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:48.241459 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353c3ef-66b7-456b-b0b3-0054713e6c69 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:48.273347 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:48.283280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa0b8f-b998-4745-ba02-47e88b43c244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:48.283987 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa0b8f-b998-4745-ba02-47e88b43c244 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:48.284328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa0b8f-b998-4745-ba02-47e88b43c244 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:48.284763 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa0b8f-b998-4745-ba02-47e88b43c244 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:48.285554 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa0b8f-b998-4745-ba02-47e88b43c244 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:48.287105 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa0b8f-b998-4745-ba02-47e88b43c244 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:48.299891 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-f1aa0b8f-b998-4745-ba02-47e88b43c244 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:26:48.299891 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:48.299891 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:26:48.299891 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:26:48.299891 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:26:48.299891 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:26:48.299891 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:26:48.299891 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:48.299891 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:26:48.299891 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:48.299891 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:26:48.299891 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:48.299891 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:48.299891 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:48.299891 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:48.299891 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:48.300947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:48.300947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:48.300947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:48.300947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:48.300947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:48.300947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:48.300947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:48.300947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:26:48.300947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:26:48.300947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:26:48.300947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:26:48.300947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:48.300947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:48.300947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:48.300947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:48.300947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:48.300947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:48.302141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:48.302141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:48.302141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:48.302141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:48.302141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:48.302141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:48.302141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:48.302141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:48.302141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:48.302141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:48.302141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:26:48.302141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:48.302141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:26:48.302141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:48.302141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 441/905] 10.222.0.69 () {56 vars in 1132 bytes} [Mon Aug 29 21:26:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:48.310749 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e19f8-393d-4f04-bfe8-849112ee9ed8 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:48.346185 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:48.428105 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e19f8-393d-4f04-bfe8-849112ee9ed8 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:48.465923 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34544f-e861-458a-be8f-7fc04c8d6eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:48.466903 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34544f-e861-458a-be8f-7fc04c8d6eab None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:48.467383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34544f-e861-458a-be8f-7fc04c8d6eab None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:48.467857 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34544f-e861-458a-be8f-7fc04c8d6eab None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:48.468765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34544f-e861-458a-be8f-7fc04c8d6eab None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:48.469288 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34544f-e861-458a-be8f-7fc04c8d6eab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:48.470836 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34544f-e861-458a-be8f-7fc04c8d6eab None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:48.479724 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 465/906] 10.222.0.69 () {56 vars in 1126 bytes} [Mon Aug 29 21:26:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:48.482247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa0b8f-b998-4745-ba02-47e88b43c244 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:48.598944 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa0b8f-b998-4745-ba02-47e88b43c244 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:48.635944 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a367a-4f85-4f44-b735-4f9795bc6ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:48.636591 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a367a-4f85-4f44-b735-4f9795bc6ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:48.636871 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a367a-4f85-4f44-b735-4f9795bc6ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:48.637147 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a367a-4f85-4f44-b735-4f9795bc6ad2 None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:48.637779 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a367a-4f85-4f44-b735-4f9795bc6ad2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:48.638110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a367a-4f85-4f44-b735-4f9795bc6ad2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:48.639648 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a367a-4f85-4f44-b735-4f9795bc6ad2 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:48.645367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 442/907] 10.222.0.69 () {56 vars in 1126 bytes} [Mon Aug 29 21:26:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:48.651365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34544f-e861-458a-be8f-7fc04c8d6eab None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:48.749409 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:48.758293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34544f-e861-458a-be8f-7fc04c8d6eab None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:48.794647 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02283c30-096c-43f2-96c0-258fb6fd59e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:48.795594 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02283c30-096c-43f2-96c0-258fb6fd59e7 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:48.796021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02283c30-096c-43f2-96c0-258fb6fd59e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:48.796459 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02283c30-096c-43f2-96c0-258fb6fd59e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:48.797320 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02283c30-096c-43f2-96c0-258fb6fd59e7 None admin] RBAC: Adding query filter params (interface=public, service_id=737c6a1c700d4b46a9365b63c28a250b, region_id=RegionOne) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:48.797785 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02283c30-096c-43f2-96c0-258fb6fd59e7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:48.799296 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02283c30-096c-43f2-96c0-258fb6fd59e7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:48.810257 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 466/908] 10.222.0.69 () {56 vars in 1251 bytes} [Mon Aug 29 21:26:48 2022] GET /identity/v3/endpoints?service_id=737c6a1c700d4b46a9365b63c28a250b&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:48.811828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a367a-4f85-4f44-b735-4f9795bc6ad2 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:48.873652 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:48.922336 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a367a-4f85-4f44-b735-4f9795bc6ad2 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:48.959053 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062371e-5383-4c23-9489-6bf4f721fd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:48.959905 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062371e-5383-4c23-9489-6bf4f721fd3d None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:48.960359 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062371e-5383-4c23-9489-6bf4f721fd3d None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:48.960811 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062371e-5383-4c23-9489-6bf4f721fd3d None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:48.961564 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062371e-5383-4c23-9489-6bf4f721fd3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:48.963066 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062371e-5383-4c23-9489-6bf4f721fd3d None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:48.976325 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 443/909] 10.222.0.69 () {56 vars in 1087 bytes} [Mon Aug 29 21:26:48 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:26:49.259589 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039eb19a-55c9-4efd-871d-211c84ae917c None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:49.259930 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039eb19a-55c9-4efd-871d-211c84ae917c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:49.260705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039eb19a-55c9-4efd-871d-211c84ae917c None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:49.262171 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 467/910] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:49.268226 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe4254-8e2c-4d58-b346-e147ca038374 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:49.269173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe4254-8e2c-4d58-b346-e147ca038374 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:49.269678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe4254-8e2c-4d58-b346-e147ca038374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:49.289772 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-9ffe4254-8e2c-4d58-b346-e147ca038374 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:49.291373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-9ffe4254-8e2c-4d58-b346-e147ca038374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:49.372691 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 444/911] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:26:49.649336 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039eb19a-55c9-4efd-871d-211c84ae917c None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:49.705951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb5586-f263-44ff-b2b7-6f6d5fc96f1c None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:49.706585 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb5586-f263-44ff-b2b7-6f6d5fc96f1c None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:49.707058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb5586-f263-44ff-b2b7-6f6d5fc96f1c None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:49.708849 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 445/912] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:49.714239 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63149a60-d8a1-470e-b7b5-c965fbc8e62d None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:49.714878 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63149a60-d8a1-470e-b7b5-c965fbc8e62d None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:49.715674 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63149a60-d8a1-470e-b7b5-c965fbc8e62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:49.735216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-63149a60-d8a1-470e-b7b5-c965fbc8e62d None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:49.736889 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-63149a60-d8a1-470e-b7b5-c965fbc8e62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:49.767213 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039eb19a-55c9-4efd-871d-211c84ae917c None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:49.790366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:49.818753 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40001825-3372-41cb-a073-347413770c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:49.819729 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40001825-3372-41cb-a073-347413770c87 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:49.820147 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40001825-3372-41cb-a073-347413770c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:49.820623 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40001825-3372-41cb-a073-347413770c87 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:49.821413 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40001825-3372-41cb-a073-347413770c87 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:49.823520 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40001825-3372-41cb-a073-347413770c87 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:49.824608 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 446/913] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:26:49.841392 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 468/914] 10.222.0.69 () {60 vars in 1141 bytes} [Mon Aug 29 21:26:49 2022] POST /identity/v3/services => generated 241 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:26:50.095003 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63149a60-d8a1-470e-b7b5-c965fbc8e62d None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:50.192436 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c143a96-1772-4ca4-b9ae-37ebd4d0a6d2 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:50.193102 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c143a96-1772-4ca4-b9ae-37ebd4d0a6d2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:50.193584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c143a96-1772-4ca4-b9ae-37ebd4d0a6d2 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:50.195371 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 469/915] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:50.201290 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0d4fc-1fc1-4090-8465-ae3274c250f4 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:50.201860 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0d4fc-1fc1-4090-8465-ae3274c250f4 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:50.202377 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0d4fc-1fc1-4090-8465-ae3274c250f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:50.220321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63149a60-d8a1-470e-b7b5-c965fbc8e62d None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:50.226799 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d4d0d4fc-1fc1-4090-8465-ae3274c250f4 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:50.228323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d4d0d4fc-1fc1-4090-8465-ae3274c250f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:50.241779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:50.273983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3929823-97a7-4573-987e-f1de33c5c028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:50.274642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3929823-97a7-4573-987e-f1de33c5c028 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:50.274901 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3929823-97a7-4573-987e-f1de33c5c028 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:50.275338 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3929823-97a7-4573-987e-f1de33c5c028 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:50.288665 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3929823-97a7-4573-987e-f1de33c5c028 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:50.295143 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-f3929823-97a7-4573-987e-f1de33c5c028 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:26:50.295143 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:50.295143 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:50.295143 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:50.295143 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:50.295143 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:50.295143 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:50.295143 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:50.295143 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:50.295143 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:50.295143 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:50.295143 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:50.295143 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:50.295143 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:50.295143 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:50.295143 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:50.296145 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:50.296145 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:50.296145 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:50.296145 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:50.296145 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:50.296145 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:50.296145 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:50.296145 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:50.296145 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:50.296145 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:50.296145 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:50.296145 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:50.296145 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:50.296145 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:50.296145 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:50.296145 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:50.297063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:50.297063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:50.297063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:50.297063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:50.297063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:50.297063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:50.297063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:50.297063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:50.297063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:50.297063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:50.297063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:26:50.297063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:50.297063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 447/916] 10.222.0.69 () {56 vars in 1120 bytes} [Mon Aug 29 21:26:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:50.305322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3929823-97a7-4573-987e-f1de33c5c028 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:50.322840 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 470/917] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:26:50.348039 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:50.419407 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3929823-97a7-4573-987e-f1de33c5c028 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:50.455273 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d082a8d-7b6b-4f4d-9b5d-754f00d20ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:50.455890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d082a8d-7b6b-4f4d-9b5d-754f00d20ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:50.456168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d082a8d-7b6b-4f4d-9b5d-754f00d20ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:50.456478 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d082a8d-7b6b-4f4d-9b5d-754f00d20ee2 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:50.457222 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d082a8d-7b6b-4f4d-9b5d-754f00d20ee2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:50.457525 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d082a8d-7b6b-4f4d-9b5d-754f00d20ee2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:50.458957 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d082a8d-7b6b-4f4d-9b5d-754f00d20ee2 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:50.468726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 448/918] 10.222.0.69 () {56 vars in 1115 bytes} [Mon Aug 29 21:26:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:50.477333 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0d4fc-1fc1-4090-8465-ae3274c250f4 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:50.586641 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0d4fc-1fc1-4090-8465-ae3274c250f4 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:50.623939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fabb24-0878-43b3-92ca-6d86c50d2a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:50.624968 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fabb24-0878-43b3-92ca-6d86c50d2a9a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:50.625452 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fabb24-0878-43b3-92ca-6d86c50d2a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:50.625941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fabb24-0878-43b3-92ca-6d86c50d2a9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:50.636796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fabb24-0878-43b3-92ca-6d86c50d2a9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:50.638624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fabb24-0878-43b3-92ca-6d86c50d2a9a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:50.639524 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d082a8d-7b6b-4f4d-9b5d-754f00d20ee2 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:50.649098 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:50.660639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-e6fabb24-0878-43b3-92ca-6d86c50d2a9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:50.660639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:50.660639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:50.660639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:50.660639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:50.660639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:50.660639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:50.660639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:50.660639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:50.660639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:50.660639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:50.660639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:50.660639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:50.660639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:50.660639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:50.660639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:50.662064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:50.662064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:50.662064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:50.662064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:50.662064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:50.662064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:50.662064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:50.662064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:50.662064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:50.662064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:50.662064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:50.662064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:50.662064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:50.662064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:50.662064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:50.662064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:50.662064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:50.662961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:50.662961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:50.662961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:50.662961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 471/919] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:50.671169 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fabb24-0878-43b3-92ca-6d86c50d2a9a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:50.754575 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:50.761212 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d082a8d-7b6b-4f4d-9b5d-754f00d20ee2 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:50.787670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fabb24-0878-43b3-92ca-6d86c50d2a9a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:50.796855 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521bab0-4c91-4144-9eeb-a9f741efebe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:50.797493 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521bab0-4c91-4144-9eeb-a9f741efebe5 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:50.797776 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521bab0-4c91-4144-9eeb-a9f741efebe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:50.798054 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521bab0-4c91-4144-9eeb-a9f741efebe5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:50.798704 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521bab0-4c91-4144-9eeb-a9f741efebe5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:50.800143 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521bab0-4c91-4144-9eeb-a9f741efebe5 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:50.809612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-2521bab0-4c91-4144-9eeb-a9f741efebe5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:26:50.809612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:50.809612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:26:50.809612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:26:50.809612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:26:50.809612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:26:50.809612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:26:50.809612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:50.809612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:26:50.809612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:50.809612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:26:50.809612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:50.809612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:50.809612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:50.809612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:50.809612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:50.809612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:50.810657 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:50.810657 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:50.810657 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:50.810657 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:50.810657 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:50.810657 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:50.810657 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:26:50.810657 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:26:50.810657 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:26:50.810657 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:26:50.810657 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:50.810657 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:50.810657 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:50.810657 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:50.810657 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:50.810657 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:50.811502 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:50.811502 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:50.811502 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:50.811502 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:50.811502 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:50.811502 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:50.811502 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:50.811502 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:50.811502 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:50.811502 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:50.811502 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:26:50.811502 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:50.811502 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:26:50.811502 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:50.816148 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 449/920] 10.222.0.69 () {56 vars in 1114 bytes} [Mon Aug 29 21:26:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:26:50.818244 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521bab0-4c91-4144-9eeb-a9f741efebe5 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:50.836940 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f42b43-8258-415a-a61e-36dd6df24f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:50.837561 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f42b43-8258-415a-a61e-36dd6df24f55 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:50.837845 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f42b43-8258-415a-a61e-36dd6df24f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:50.838121 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f42b43-8258-415a-a61e-36dd6df24f55 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:50.839570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f42b43-8258-415a-a61e-36dd6df24f55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:50.839878 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f42b43-8258-415a-a61e-36dd6df24f55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:50.842015 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f42b43-8258-415a-a61e-36dd6df24f55 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:50.861987 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 472/921] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:50.864030 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f42b43-8258-415a-a61e-36dd6df24f55 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:50.936307 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521bab0-4c91-4144-9eeb-a9f741efebe5 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:50.938380 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:50.977801 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70ad0d-b63a-4294-8e28-c4251de5a9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:50.978424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70ad0d-b63a-4294-8e28-c4251de5a9fd None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:50.979318 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70ad0d-b63a-4294-8e28-c4251de5a9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:50.979596 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70ad0d-b63a-4294-8e28-c4251de5a9fd None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:50.980280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70ad0d-b63a-4294-8e28-c4251de5a9fd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:50.980588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70ad0d-b63a-4294-8e28-c4251de5a9fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:50.981978 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70ad0d-b63a-4294-8e28-c4251de5a9fd None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:50.988230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 450/922] 10.222.0.69 () {56 vars in 1114 bytes} [Mon Aug 29 21:26:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:50.988819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3c46e-61f1-4bab-8c27-c1683e75d334 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:50.989289 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3c46e-61f1-4bab-8c27-c1683e75d334 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:50.989699 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3c46e-61f1-4bab-8c27-c1683e75d334 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:50.994790 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 451/923] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:50.994790 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3c46e-61f1-4bab-8c27-c1683e75d334 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:50.996642 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f42b43-8258-415a-a61e-36dd6df24f55 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:51.023635 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:51.037316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac571edb-6525-4332-957b-2c6b71713457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:51.037952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac571edb-6525-4332-957b-2c6b71713457 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:51.038237 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac571edb-6525-4332-957b-2c6b71713457 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:51.038510 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac571edb-6525-4332-957b-2c6b71713457 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:51.046000 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac571edb-6525-4332-957b-2c6b71713457 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:51.047446 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac571edb-6525-4332-957b-2c6b71713457 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:51.059435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-ac571edb-6525-4332-957b-2c6b71713457 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:26:51.059435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:51.059435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:51.059435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:51.059435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:51.059435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:51.059435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:51.059435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:51.059435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:51.059435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:51.059435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:51.059435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:51.059435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:51.059435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:51.059435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:51.059435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:51.060618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:51.060618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:51.060618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:51.060618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:51.060618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:51.060618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:51.060618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:51.060618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:51.060618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:51.060618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:51.060618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:51.060618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:51.060618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:51.060618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:51.060618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:51.060618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:51.060618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:51.060618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:51.061590 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:51.061590 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:51.061590 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:51.061590 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:51.061590 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:51.061590 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:51.061590 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:51.061590 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:51.061590 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:26:51.061590 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:51.061590 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 473/924] 10.222.0.69 () {56 vars in 1117 bytes} [Mon Aug 29 21:26:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:51.066404 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a9125-a6c1-488c-8b50-ec8acddf3d14 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:51.066695 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a9125-a6c1-488c-8b50-ec8acddf3d14 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:51.066975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a9125-a6c1-488c-8b50-ec8acddf3d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:51.086570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-971a9125-a6c1-488c-8b50-ec8acddf3d14 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:51.087780 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-971a9125-a6c1-488c-8b50-ec8acddf3d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:51.112005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3c46e-61f1-4bab-8c27-c1683e75d334 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:51.148246 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa9c13-47d0-4bee-9a1b-28d1bcbbe4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:51.148862 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa9c13-47d0-4bee-9a1b-28d1bcbbe4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:51.149150 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa9c13-47d0-4bee-9a1b-28d1bcbbe4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:51.149422 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa9c13-47d0-4bee-9a1b-28d1bcbbe4c1 None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:51.150049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa9c13-47d0-4bee-9a1b-28d1bcbbe4c1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:51.150352 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa9c13-47d0-4bee-9a1b-28d1bcbbe4c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:51.152345 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa9c13-47d0-4bee-9a1b-28d1bcbbe4c1 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:51.157509 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 452/925] 10.222.0.69 () {56 vars in 1114 bytes} [Mon Aug 29 21:26:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:51.158295 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa9c13-47d0-4bee-9a1b-28d1bcbbe4c1 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:51.168005 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 474/926] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:26:51.169419 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a9125-a6c1-488c-8b50-ec8acddf3d14 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:51.231537 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:51.290386 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:51.304567 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a9125-a6c1-488c-8b50-ec8acddf3d14 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:51.305107 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa9c13-47d0-4bee-9a1b-28d1bcbbe4c1 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:51.347435 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe7a85-3fd2-4cc5-b281-bee821f70281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:51.348045 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe7a85-3fd2-4cc5-b281-bee821f70281 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:51.348361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe7a85-3fd2-4cc5-b281-bee821f70281 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:51.348637 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe7a85-3fd2-4cc5-b281-bee821f70281 None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:51.349378 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe7a85-3fd2-4cc5-b281-bee821f70281 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:51.349688 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe7a85-3fd2-4cc5-b281-bee821f70281 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:51.350368 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e63384-6f6f-4e51-9d13-200790744df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:51.351116 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe7a85-3fd2-4cc5-b281-bee821f70281 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:51.351370 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e63384-6f6f-4e51-9d13-200790744df5 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:51.351853 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e63384-6f6f-4e51-9d13-200790744df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:51.352350 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e63384-6f6f-4e51-9d13-200790744df5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:51.353286 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e63384-6f6f-4e51-9d13-200790744df5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:51.354959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e63384-6f6f-4e51-9d13-200790744df5 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:51.377615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 453/927] 10.222.0.69 () {56 vars in 1149 bytes} [Mon Aug 29 21:26:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:51.378759 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe7a85-3fd2-4cc5-b281-bee821f70281 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:51.389098 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 475/928] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:26:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:26:51.461953 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e63384-6f6f-4e51-9d13-200790744df5 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:51.529615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe7a85-3fd2-4cc5-b281-bee821f70281 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:51.579165 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df6cfb-6fa4-414a-9ffb-a0fff74c05d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:51.579807 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df6cfb-6fa4-414a-9ffb-a0fff74c05d8 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:51.580080 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df6cfb-6fa4-414a-9ffb-a0fff74c05d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:51.580385 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df6cfb-6fa4-414a-9ffb-a0fff74c05d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:51.585666 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e63384-6f6f-4e51-9d13-200790744df5 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:51.588879 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:51.593689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df6cfb-6fa4-414a-9ffb-a0fff74c05d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:51.595608 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df6cfb-6fa4-414a-9ffb-a0fff74c05d8 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:51.598446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:51.617267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-10df6cfb-6fa4-414a-9ffb-a0fff74c05d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:51.617267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:51.617267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:51.617267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:51.617267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:51.617267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:51.617267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:51.617267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:51.617267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:51.617267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:51.617267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:51.617267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:51.617267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:51.617267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:51.617267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:51.617267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:51.618293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:51.618293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:51.618293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:51.618293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:51.618293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:51.618293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:51.618293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:51.618293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:51.618293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:51.618293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:51.618293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:51.618293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:51.618293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:51.618293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:51.618293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:51.618293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:51.618293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:51.619198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:51.619198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:51.619198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:51.619198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 454/929] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:51.625107 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df6cfb-6fa4-414a-9ffb-a0fff74c05d8 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:51.634864 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88ef0e-cc8a-4a37-824d-9f9fba914145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:51.635534 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88ef0e-cc8a-4a37-824d-9f9fba914145 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:51.635817 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88ef0e-cc8a-4a37-824d-9f9fba914145 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:51.636092 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88ef0e-cc8a-4a37-824d-9f9fba914145 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:51.636724 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88ef0e-cc8a-4a37-824d-9f9fba914145 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:51.638090 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88ef0e-cc8a-4a37-824d-9f9fba914145 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:51.647819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-af88ef0e-cc8a-4a37-824d-9f9fba914145 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:26:51.647819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:51.647819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:26:51.647819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:26:51.647819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:26:51.647819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:26:51.647819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:26:51.647819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:51.647819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:26:51.647819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:51.647819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:26:51.647819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:51.647819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:51.647819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:51.647819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:51.647819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:51.648828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:51.648828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:51.648828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:51.648828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:51.648828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:51.648828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:51.648828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:51.648828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:26:51.648828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:26:51.648828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:26:51.648828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:26:51.648828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:51.648828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:51.648828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:51.648828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:51.648828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:51.648828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:51.649737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:51.649737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:51.649737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:51.649737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:51.649737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:51.649737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:51.649737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:51.649737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:51.649737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:51.649737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:51.649737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:26:51.649737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:51.649737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:26:51.649737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:51.649737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 476/930] 10.222.0.69 () {56 vars in 1132 bytes} [Mon Aug 29 21:26:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:51.657649 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88ef0e-cc8a-4a37-824d-9f9fba914145 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:51.755325 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df6cfb-6fa4-414a-9ffb-a0fff74c05d8 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:51.783591 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88ef0e-cc8a-4a37-824d-9f9fba914145 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:51.801068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e620e2-4b47-4e40-98f8-d9fb3c8699e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:51.801686 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e620e2-4b47-4e40-98f8-d9fb3c8699e1 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:51.801973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e620e2-4b47-4e40-98f8-d9fb3c8699e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:51.802241 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e620e2-4b47-4e40-98f8-d9fb3c8699e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:51.803134 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e620e2-4b47-4e40-98f8-d9fb3c8699e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:51.803263 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e620e2-4b47-4e40-98f8-d9fb3c8699e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:51.804644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e620e2-4b47-4e40-98f8-d9fb3c8699e1 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:51.822792 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 455/931] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:51.823813 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e620e2-4b47-4e40-98f8-d9fb3c8699e1 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:51.827235 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d51c57-f438-4871-9459-5b50d5d81e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:51.828078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d51c57-f438-4871-9459-5b50d5d81e62 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:51.828536 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d51c57-f438-4871-9459-5b50d5d81e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:51.829058 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d51c57-f438-4871-9459-5b50d5d81e62 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:51.829857 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d51c57-f438-4871-9459-5b50d5d81e62 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:51.830322 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d51c57-f438-4871-9459-5b50d5d81e62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:51.831849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d51c57-f438-4871-9459-5b50d5d81e62 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:51.837978 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 477/932] 10.222.0.69 () {56 vars in 1126 bytes} [Mon Aug 29 21:26:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:51.839658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b248e7e-ff05-4112-88b6-b1fd2a43d782 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:51.840148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b248e7e-ff05-4112-88b6-b1fd2a43d782 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:51.840593 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b248e7e-ff05-4112-88b6-b1fd2a43d782 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:51.842266 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 478/933] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:51.845860 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b248e7e-ff05-4112-88b6-b1fd2a43d782 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:51.882031 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:51.883140 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:51.937006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e620e2-4b47-4e40-98f8-d9fb3c8699e1 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:51.964257 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b248e7e-ff05-4112-88b6-b1fd2a43d782 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:51.973604 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065d31c-6f51-4a99-a12e-11b734ed3cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:51.974237 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065d31c-6f51-4a99-a12e-11b734ed3cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:51.974509 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065d31c-6f51-4a99-a12e-11b734ed3cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:51.974776 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065d31c-6f51-4a99-a12e-11b734ed3cd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:51.984521 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065d31c-6f51-4a99-a12e-11b734ed3cd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:51.985964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065d31c-6f51-4a99-a12e-11b734ed3cd2 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:51.997178 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-0065d31c-6f51-4a99-a12e-11b734ed3cd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:51.997178 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:51.997178 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:51.997178 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:51.997178 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:51.997178 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:51.997178 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:51.997178 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:51.997178 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:51.997178 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:51.997178 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:51.997178 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:51.997178 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:51.997178 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:51.997178 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:51.998113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:51.998113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:51.998113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:51.998113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:51.998113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:51.998113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:51.998113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:51.998113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:51.998113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:51.998113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:51.998113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:51.998113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:51.998113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:51.998113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:51.998113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:51.998113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:51.998113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:51.999047 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:51.999047 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:51.999047 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:51.999047 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:51.999047 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:51.999047 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:51.999047 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:51.999047 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:51.999047 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 456/934] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:51.999556 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bd7cd-0b9a-4093-8235-dc046fd13132 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:52.000074 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bd7cd-0b9a-4093-8235-dc046fd13132 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:52.000074 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bd7cd-0b9a-4093-8235-dc046fd13132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:52.009817 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab5519-66c6-40e8-8b20-c4f567564818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:52.010789 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab5519-66c6-40e8-8b20-c4f567564818 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:52.011297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab5519-66c6-40e8-8b20-c4f567564818 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:52.011772 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab5519-66c6-40e8-8b20-c4f567564818 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:52.012798 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab5519-66c6-40e8-8b20-c4f567564818 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:52.013310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab5519-66c6-40e8-8b20-c4f567564818 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:52.014940 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab5519-66c6-40e8-8b20-c4f567564818 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:52.017835 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-6e3bd7cd-0b9a-4093-8235-dc046fd13132 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:52.019013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-6e3bd7cd-0b9a-4093-8235-dc046fd13132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:52.025522 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 479/935] 10.222.0.69 () {56 vars in 1126 bytes} [Mon Aug 29 21:26:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:52.027143 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab5519-66c6-40e8-8b20-c4f567564818 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:52.094633 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 457/936] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:26:52.095774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bd7cd-0b9a-4093-8235-dc046fd13132 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:52.141308 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:52.146541 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:52.149130 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab5519-66c6-40e8-8b20-c4f567564818 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:52.197691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cba4d-eecc-493d-a69f-6dc5296c5068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:52.198400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cba4d-eecc-493d-a69f-6dc5296c5068 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:52.198747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cba4d-eecc-493d-a69f-6dc5296c5068 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:52.199097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cba4d-eecc-493d-a69f-6dc5296c5068 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:52.201016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211cba4d-eecc-493d-a69f-6dc5296c5068 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:52.201874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211cba4d-eecc-493d-a69f-6dc5296c5068 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:52.204285 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211cba4d-eecc-493d-a69f-6dc5296c5068 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:52.218058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bd7cd-0b9a-4093-8235-dc046fd13132 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:52.220268 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 480/937] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:52.226429 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cba4d-eecc-493d-a69f-6dc5296c5068 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:52.261259 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b9c28-cfcb-41d7-b9ae-f7d85d988be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:52.262270 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b9c28-cfcb-41d7-b9ae-f7d85d988be1 None admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:52.262774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b9c28-cfcb-41d7-b9ae-f7d85d988be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:52.263271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b9c28-cfcb-41d7-b9ae-f7d85d988be1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:52.264144 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b9c28-cfcb-41d7-b9ae-f7d85d988be1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:52.265739 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b9c28-cfcb-41d7-b9ae-f7d85d988be1 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:52.295983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 458/938] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:26:52 2022] POST /identity/v3/endpoints => generated 347 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:26:52.335742 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cba4d-eecc-493d-a69f-6dc5296c5068 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:52.381239 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ef1f8-f79e-4496-9da7-f5e0f02d67f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:52.381912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ef1f8-f79e-4496-9da7-f5e0f02d67f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:52.382227 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ef1f8-f79e-4496-9da7-f5e0f02d67f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:52.382463 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ef1f8-f79e-4496-9da7-f5e0f02d67f6 None admin] PATH_INFO: `/v3/projects/a302406c548c43c983625c0d66da47cc/users/540e06e694524c4a9e84ebebd45956d6/roles/5a3de60a67584f299df269bc459f952f` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:52.384734 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ef1f8-f79e-4496-9da7-f5e0f02d67f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a302406c548c43c983625c0d66da47cc, user_id=540e06e694524c4a9e84ebebd45956d6, role_id=5a3de60a67584f299df269bc459f952f)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:52.386741 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ef1f8-f79e-4496-9da7-f5e0f02d67f6 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:52.395026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b9c28-cfcb-41d7-b9ae-f7d85d988be1 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:52.409230 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 481/939] 10.222.0.69 () {58 vars in 1439 bytes} [Mon Aug 29 21:26:52 2022] PUT /identity/v3/projects/a302406c548c43c983625c0d66da47cc/users/540e06e694524c4a9e84ebebd45956d6/roles/5a3de60a67584f299df269bc459f952f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:26:52.534364 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:52.542176 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b9c28-cfcb-41d7-b9ae-f7d85d988be1 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:52.585101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34098922-a343-4dee-8111-301b672f4b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:52.585784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34098922-a343-4dee-8111-301b672f4b5b None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:52.586066 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34098922-a343-4dee-8111-301b672f4b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:52.586346 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34098922-a343-4dee-8111-301b672f4b5b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:52.586955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34098922-a343-4dee-8111-301b672f4b5b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:52.588998 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34098922-a343-4dee-8111-301b672f4b5b None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:52.600402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-34098922-a343-4dee-8111-301b672f4b5b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:26:52.600402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:52.600402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:26:52.600402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:26:52.600402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:26:52.600402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:26:52.600402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:26:52.600402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:52.600402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:26:52.600402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:52.600402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:26:52.600402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:52.600402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:52.600402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:52.600402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:52.600402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:52.600402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:52.601449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:52.601449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:52.601449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:52.601449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:52.601449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:52.601449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:52.601449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:26:52.601449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:26:52.601449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:26:52.601449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:26:52.601449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:52.601449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:52.601449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:52.601449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:52.601449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:52.601449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:52.602301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:52.602301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:52.602301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:52.602301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:52.602301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:52.602301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:52.602301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:52.602301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:52.602301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:52.602301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:52.602301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:26:52.602301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:52.602301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:26:52.602301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:52.602301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 459/940] 10.222.0.69 () {56 vars in 1126 bytes} [Mon Aug 29 21:26:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:26:52.608650 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ef1f8-f79e-4496-9da7-f5e0f02d67f6 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:52.628670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:52.716214 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ef1f8-f79e-4496-9da7-f5e0f02d67f6 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:52.752878 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81eeea4-adaf-492b-9beb-0f4321546543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:52.753493 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81eeea4-adaf-492b-9beb-0f4321546543 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:52.753783 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81eeea4-adaf-492b-9beb-0f4321546543 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:52.754061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81eeea4-adaf-492b-9beb-0f4321546543 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:52.754701 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81eeea4-adaf-492b-9beb-0f4321546543 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:52.755015 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81eeea4-adaf-492b-9beb-0f4321546543 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:52.756633 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81eeea4-adaf-492b-9beb-0f4321546543 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:52.763277 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 482/941] 10.222.0.69 () {56 vars in 1122 bytes} [Mon Aug 29 21:26:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:52.769033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34098922-a343-4dee-8111-301b672f4b5b None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:52.881822 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34098922-a343-4dee-8111-301b672f4b5b None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:52.920751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896abc1-cc02-4b95-b332-55a8317ad6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:52.921479 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896abc1-cc02-4b95-b332-55a8317ad6cb None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:52.921763 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896abc1-cc02-4b95-b332-55a8317ad6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:52.922040 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896abc1-cc02-4b95-b332-55a8317ad6cb None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:52.922677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896abc1-cc02-4b95-b332-55a8317ad6cb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:52.922981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896abc1-cc02-4b95-b332-55a8317ad6cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:52.924382 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896abc1-cc02-4b95-b332-55a8317ad6cb None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:52.930459 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 460/942] 10.222.0.69 () {56 vars in 1122 bytes} [Mon Aug 29 21:26:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:52.936948 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81eeea4-adaf-492b-9beb-0f4321546543 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:53.019595 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:53.044569 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81eeea4-adaf-492b-9beb-0f4321546543 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:53.080738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57dba9c-556f-4d6c-8f9d-2a38ddee99e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:53.081361 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dba9c-556f-4d6c-8f9d-2a38ddee99e0 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:53.081643 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dba9c-556f-4d6c-8f9d-2a38ddee99e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:53.081918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dba9c-556f-4d6c-8f9d-2a38ddee99e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:53.082626 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57dba9c-556f-4d6c-8f9d-2a38ddee99e0 None admin] RBAC: Adding query filter params (interface=public, service_id=9318e0b771484be9b7de0c27e2ab0569, region_id=RegionOne) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:53.082938 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57dba9c-556f-4d6c-8f9d-2a38ddee99e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:53.084432 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57dba9c-556f-4d6c-8f9d-2a38ddee99e0 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:53.090250 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 483/943] 10.222.0.69 () {56 vars in 1251 bytes} [Mon Aug 29 21:26:52 2022] GET /identity/v3/endpoints?service_id=9318e0b771484be9b7de0c27e2ab0569&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:53.095785 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896abc1-cc02-4b95-b332-55a8317ad6cb None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:53.135792 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:53.212911 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896abc1-cc02-4b95-b332-55a8317ad6cb None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:53.249392 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de89e4-211a-4050-b7ef-e2180b60d653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:53.250001 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de89e4-211a-4050-b7ef-e2180b60d653 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:53.250279 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de89e4-211a-4050-b7ef-e2180b60d653 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:53.250547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de89e4-211a-4050-b7ef-e2180b60d653 None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:53.251148 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de89e4-211a-4050-b7ef-e2180b60d653 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:53.252554 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de89e4-211a-4050-b7ef-e2180b60d653 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:53.260285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 461/944] 10.222.0.69 () {56 vars in 1087 bytes} [Mon Aug 29 21:26:53 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:26:53.468610 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11510a69-3f20-4384-ac6b-dbdafc38b219 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:53.469223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11510a69-3f20-4384-ac6b-dbdafc38b219 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:53.469726 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11510a69-3f20-4384-ac6b-dbdafc38b219 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:53.471539 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 484/945] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:53.476624 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5bdb4-0318-40da-ab8d-917afd647034 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:53.477088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5bdb4-0318-40da-ab8d-917afd647034 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:53.477165 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5bdb4-0318-40da-ab8d-917afd647034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:53.501517 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-50e5bdb4-0318-40da-ab8d-917afd647034 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:53.503495 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-50e5bdb4-0318-40da-ab8d-917afd647034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:53.582481 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 462/946] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:26:53.860939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11510a69-3f20-4384-ac6b-dbdafc38b219 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:53.972721 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11510a69-3f20-4384-ac6b-dbdafc38b219 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:54.008888 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1aa1d0-22af-4c26-9268-1fd8d85c5888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:54.009505 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1aa1d0-22af-4c26-9268-1fd8d85c5888 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:54.009788 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1aa1d0-22af-4c26-9268-1fd8d85c5888 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:54.010060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1aa1d0-22af-4c26-9268-1fd8d85c5888 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:54.010747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1aa1d0-22af-4c26-9268-1fd8d85c5888 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:54.012212 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1aa1d0-22af-4c26-9268-1fd8d85c5888 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:54.014936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: WARNING keystone.server.flask.common [None req-ac1aa1d0-22af-4c26-9268-1fd8d85c5888 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 21:26:54.026206 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:54.034159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.sql.core [None req-ac1aa1d0-22af-4c26-9268-1fd8d85c5888 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 21:26:54.034159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 21:26:54.034159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [parameters: {'id': '8b20f6397d0b4be19a605b9a1d005609', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 21:26:54.034159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81658) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 21:26:54.042280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-ac1aa1d0-22af-4c26-9268-1fd8d85c5888 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8b20f6397d0b4be19a605b9a1d005609.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8b20f6397d0b4be19a605b9a1d005609. Aug 29 21:26:54.042280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:54.042280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 21:26:54.042280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 21:26:54.042280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 21:26:54.042280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 21:26:54.042280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 21:26:54.042280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 21:26:54.042280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 21:26:54.042280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application conn.query(q) Aug 29 21:26:54.042280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 21:26:54.042280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 21:26:54.042280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 21:26:54.043101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application result.read() Aug 29 21:26:54.043101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 21:26:54.043101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 21:26:54.043101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 21:26:54.043101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 21:26:54.043101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 21:26:54.043101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 21:26:54.043101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 21:26:54.043101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 21:26:54.043101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 21:26:54.043101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:54.043101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 21:26:54.043101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:54.043101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:54.043101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 21:26:54.043101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 21:26:54.043101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 29 21:26:54.043101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 29 21:26:54.044060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 21:26:54.044060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application next(self.gen) Aug 29 21:26:54.044060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 21:26:54.044060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application yield resource Aug 29 21:26:54.044060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 21:26:54.044060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application next(self.gen) Aug 29 21:26:54.044060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 21:26:54.044060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 21:26:54.044060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 21:26:54.044060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 21:26:54.044060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 21:26:54.044060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise self.value Aug 29 21:26:54.044060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 21:26:54.044060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 21:26:54.044060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 21:26:54.044060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application session.commit() Aug 29 21:26:54.044060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 21:26:54.045016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 21:26:54.045016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 21:26:54.045016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 21:26:54.045016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 21:26:54.045016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self.session.flush() Aug 29 21:26:54.045016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 21:26:54.045016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 21:26:54.045016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 21:26:54.045016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 21:26:54.045016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 21:26:54.045016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application compat.raise_( Aug 29 21:26:54.045016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 21:26:54.045016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception Aug 29 21:26:54.045016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 21:26:54.045016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 21:26:54.045016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 21:26:54.045016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 21:26:54.046596 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 21:26:54.046596 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 21:26:54.046596 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 21:26:54.046596 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 21:26:54.046596 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 21:26:54.046596 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 21:26:54.046596 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 21:26:54.046596 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 21:26:54.046596 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 21:26:54.046596 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 21:26:54.046596 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 21:26:54.046596 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 21:26:54.046596 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 21:26:54.046596 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 21:26:54.046596 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 21:26:54.047401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 21:26:54.047401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 21:26:54.047401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception Aug 29 21:26:54.047401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 21:26:54.047401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 21:26:54.047401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 21:26:54.047401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 21:26:54.047401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 21:26:54.047401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 21:26:54.047401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 21:26:54.047401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application conn.query(q) Aug 29 21:26:54.047401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 21:26:54.047401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 21:26:54.047401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 21:26:54.047401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application result.read() Aug 29 21:26:54.047401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 21:26:54.047401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 21:26:54.048313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 21:26:54.048313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 21:26:54.048313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 21:26:54.048313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 21:26:54.048313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 21:26:54.048313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 21:26:54.048313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 21:26:54.048313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 21:26:54.048313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [parameters: {'id': '8b20f6397d0b4be19a605b9a1d005609', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 21:26:54.048313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 21:26:54.048313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:54.048313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:26:54.048313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:54.048313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:54.048313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 29 21:26:54.050046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 29 21:26:54.050046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 21:26:54.050046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 21:26:54.050046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 29 21:26:54.050046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:54.050046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:26:54.050046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:54.050046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:54.050046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:54.050046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:54.050046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:54.050046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:54.050046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:54.050046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:54.050046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:54.050046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:54.050046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:54.051947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:54.051947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 29 21:26:54.051947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 29 21:26:54.051947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:54.051947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:54.051947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 29 21:26:54.051947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 29 21:26:54.051947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8b20f6397d0b4be19a605b9a1d005609. Aug 29 21:26:54.051947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:54.051947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 485/947] 10.222.0.69 () {60 vars in 1140 bytes} [Mon Aug 29 21:26:53 2022] POST /identity/v3/projects => generated 262 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:54.052732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5bdb4-0318-40da-ab8d-917afd647034 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:54.096620 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:54.162375 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5bdb4-0318-40da-ab8d-917afd647034 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:54.199087 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6026a-622c-4339-9d60-f6531649e1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:54.199729 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6026a-622c-4339-9d60-f6531649e1cf None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:54.200007 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6026a-622c-4339-9d60-f6531649e1cf None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:54.200311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6026a-622c-4339-9d60-f6531649e1cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:54.207451 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6026a-622c-4339-9d60-f6531649e1cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:54.209149 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6026a-622c-4339-9d60-f6531649e1cf None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:54.221847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-9dd6026a-622c-4339-9d60-f6531649e1cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:54.221847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:54.221847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:54.221847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:54.221847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:54.221847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:54.221847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:54.221847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:54.221847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:54.221847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:54.221847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:54.221847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:54.221847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:54.221847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:54.221847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:54.223918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:54.223918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:54.223918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:54.223918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:54.223918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:54.223918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:54.223918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:54.223918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:54.223918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:54.223918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:54.223918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:54.223918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:54.223918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:54.223918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:54.223918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:54.223918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:54.223918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:54.227171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:54.227171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:54.227171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:54.227171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:54.227171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:54.227171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:54.227171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:54.227171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:54.227171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 463/948] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:54.232205 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1aa1d0-22af-4c26-9268-1fd8d85c5888 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:54.338759 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1aa1d0-22af-4c26-9268-1fd8d85c5888 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:54.377748 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc359f77-83e0-4d0a-84dd-fed860b68362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:54.378369 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc359f77-83e0-4d0a-84dd-fed860b68362 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:54.378702 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc359f77-83e0-4d0a-84dd-fed860b68362 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:54.378981 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc359f77-83e0-4d0a-84dd-fed860b68362 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:54.379763 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc359f77-83e0-4d0a-84dd-fed860b68362 None admin] RBAC: Adding query filter params (name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:54.380073 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc359f77-83e0-4d0a-84dd-fed860b68362 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:54.381752 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc359f77-83e0-4d0a-84dd-fed860b68362 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:54.394277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ef8ee-e3f4-4f1d-a9df-243bd6ea7afe None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:54.394633 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ef8ee-e3f4-4f1d-a9df-243bd6ea7afe None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:54.394867 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ef8ee-e3f4-4f1d-a9df-243bd6ea7afe None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:54.396748 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 464/949] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:26:54.404614 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f1df4-5977-4668-adc1-f91de59042e7 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:54.405033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f1df4-5977-4668-adc1-f91de59042e7 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:54.405430 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f1df4-5977-4668-adc1-f91de59042e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:54.412624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 486/950] 10.222.0.69 () {56 vars in 1112 bytes} [Mon Aug 29 21:26:54 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:54.427037 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-9f4f1df4-5977-4668-adc1-f91de59042e7 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:54.428585 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-9f4f1df4-5977-4668-adc1-f91de59042e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:54.457267 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db94d7b-c4c1-4f9c-93f4-4f8f2de8d583 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:54.457540 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db94d7b-c4c1-4f9c-93f4-4f8f2de8d583 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:54.457938 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db94d7b-c4c1-4f9c-93f4-4f8f2de8d583 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:54.464701 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 487/951] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:26:54.467176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a81cd-87af-4d4d-8564-86b981a4c7a6 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:54.467567 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a81cd-87af-4d4d-8564-86b981a4c7a6 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:54.467854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a81cd-87af-4d4d-8564-86b981a4c7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:54.489071 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-3e5a81cd-87af-4d4d-8564-86b981a4c7a6 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:54.490789 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3e5a81cd-87af-4d4d-8564-86b981a4c7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:54.513708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 465/952] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:26:54.576599 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:54.579690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 488/953] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:26:54.798489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f1df4-5977-4668-adc1-f91de59042e7 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:54.817137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:54.854821 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a81cd-87af-4d4d-8564-86b981a4c7a6 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:54.931354 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f1df4-5977-4668-adc1-f91de59042e7 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:54.973350 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a81cd-87af-4d4d-8564-86b981a4c7a6 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:54.980348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9475ff5-e460-496c-b804-7a20c5fea8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:54.980990 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9475ff5-e460-496c-b804-7a20c5fea8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:54.981268 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9475ff5-e460-496c-b804-7a20c5fea8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:54.981539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9475ff5-e460-496c-b804-7a20c5fea8e1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:54.995078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9475ff5-e460-496c-b804-7a20c5fea8e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:54.999928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-e9475ff5-e460-496c-b804-7a20c5fea8e1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:26:54.999928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:54.999928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:54.999928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:54.999928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:54.999928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:54.999928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:54.999928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:54.999928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:54.999928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:54.999928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:54.999928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:54.999928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:54.999928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:54.999928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:54.999928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:55.000965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:55.000965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:55.000965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:55.000965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:55.000965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:55.000965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:55.000965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:55.000965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:55.000965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:55.000965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:55.000965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:55.000965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:55.000965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:55.000965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:55.000965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:55.000965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:55.001873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:55.001873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:55.001873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:55.001873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:55.001873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:55.001873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:55.001873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:55.001873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:55.001873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:55.001873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:55.001873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:26:55.001873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:55.006094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 466/954] 10.222.0.69 () {56 vars in 1120 bytes} [Mon Aug 29 21:26:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:55.007106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9475ff5-e460-496c-b804-7a20c5fea8e1 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:55.017097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88692d5c-4244-4bfd-af14-c3b721d536cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:55.018076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88692d5c-4244-4bfd-af14-c3b721d536cd None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:55.018562 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88692d5c-4244-4bfd-af14-c3b721d536cd None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:55.019038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88692d5c-4244-4bfd-af14-c3b721d536cd None admin] PATH_INFO: `/v3/services/compute` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:55.019824 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88692d5c-4244-4bfd-af14-c3b721d536cd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:55.021454 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88692d5c-4244-4bfd-af14-c3b721d536cd None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:55.031625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-88692d5c-4244-4bfd-af14-c3b721d536cd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:26:55.031625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:55.031625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:26:55.031625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:26:55.031625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:26:55.031625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:26:55.031625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:26:55.031625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:55.031625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:26:55.031625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:55.031625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:26:55.031625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:55.031625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:55.031625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:55.031625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:55.031625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:55.031625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:55.032874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:55.032874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:55.032874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:55.032874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:55.032874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:55.032874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:55.032874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:26:55.032874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:26:55.032874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:26:55.032874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:26:55.032874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:55.032874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:55.032874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:55.032874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:55.032874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:55.032874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:55.033797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:55.033797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:55.033797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:55.033797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:55.033797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:55.033797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:55.033797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:55.033797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:55.033797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:55.033797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:55.033797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:26:55.033797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:55.033797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:26:55.033797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:55.042017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 489/955] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:26:55.043155 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88692d5c-4244-4bfd-af14-c3b721d536cd None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:55.084511 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:55.097440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:55.125170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9475ff5-e460-496c-b804-7a20c5fea8e1 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:55.156482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88692d5c-4244-4bfd-af14-c3b721d536cd None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:55.164150 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffadbf2-a538-4612-8c88-0c99361aa9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:55.165013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffadbf2-a538-4612-8c88-0c99361aa9fd None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:55.165157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffadbf2-a538-4612-8c88-0c99361aa9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:55.165324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffadbf2-a538-4612-8c88-0c99361aa9fd None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:55.165983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffadbf2-a538-4612-8c88-0c99361aa9fd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:55.166283 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffadbf2-a538-4612-8c88-0c99361aa9fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:55.174116 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffadbf2-a538-4612-8c88-0c99361aa9fd None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:55.187564 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 467/956] 10.222.0.69 () {56 vars in 1115 bytes} [Mon Aug 29 21:26:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:55.188649 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffadbf2-a538-4612-8c88-0c99361aa9fd None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:55.198642 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54925e1c-a71e-4f93-be93-37b2092a8d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:55.199999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54925e1c-a71e-4f93-be93-37b2092a8d20 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:55.200536 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54925e1c-a71e-4f93-be93-37b2092a8d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:55.201012 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54925e1c-a71e-4f93-be93-37b2092a8d20 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:55.201849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54925e1c-a71e-4f93-be93-37b2092a8d20 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:55.202399 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54925e1c-a71e-4f93-be93-37b2092a8d20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:55.203984 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54925e1c-a71e-4f93-be93-37b2092a8d20 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:55.215773 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 490/957] 10.222.0.69 () {56 vars in 1112 bytes} [Mon Aug 29 21:26:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:55.217050 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54925e1c-a71e-4f93-be93-37b2092a8d20 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:55.301965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffadbf2-a538-4612-8c88-0c99361aa9fd None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:55.327715 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54925e1c-a71e-4f93-be93-37b2092a8d20 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:55.338213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc27d4-3fff-478a-967e-9cd910b4a026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:55.339229 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc27d4-3fff-478a-967e-9cd910b4a026 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:55.339512 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc27d4-3fff-478a-967e-9cd910b4a026 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:55.339782 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc27d4-3fff-478a-967e-9cd910b4a026 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:55.341817 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:55.345060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:55.354044 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc27d4-3fff-478a-967e-9cd910b4a026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:55.355204 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc27d4-3fff-478a-967e-9cd910b4a026 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:55.370164 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff66f3-dc12-41e4-afc5-08640492bde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:55.371143 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff66f3-dc12-41e4-afc5-08640492bde3 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:55.371630 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff66f3-dc12-41e4-afc5-08640492bde3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:55.371999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-5bcc27d4-3fff-478a-967e-9cd910b4a026 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:55.371999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:55.371999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:55.371999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:55.371999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:55.371999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:55.371999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:55.371999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:55.371999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:55.371999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:55.371999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:55.371999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:55.371999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:55.371999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:55.371999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:55.371999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:55.373026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:55.373026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:55.373026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:55.373026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:55.373026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:55.373026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:55.373026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:55.373026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:55.373026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:55.373026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:55.373026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:55.373026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:55.373026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:55.373026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:55.373026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:55.373026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:55.373026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:55.373933 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:55.373933 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:55.373933 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:55.374767 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff66f3-dc12-41e4-afc5-08640492bde3 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:55.375824 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff66f3-dc12-41e4-afc5-08640492bde3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:55.376402 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff66f3-dc12-41e4-afc5-08640492bde3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:55.377990 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff66f3-dc12-41e4-afc5-08640492bde3 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:55.378398 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 468/958] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:26:55.379170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc27d4-3fff-478a-967e-9cd910b4a026 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:55.384873 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 491/959] 10.222.0.69 () {56 vars in 1112 bytes} [Mon Aug 29 21:26:55 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:55.387032 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a646be-b7bb-4b33-84a4-78a95d2faf50 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:55.387032 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a646be-b7bb-4b33-84a4-78a95d2faf50 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:55.387226 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a646be-b7bb-4b33-84a4-78a95d2faf50 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:55.388538 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 492/960] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:55.397752 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c143789-cb94-49c7-a48e-609b856008ed None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:55.398283 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c143789-cb94-49c7-a48e-609b856008ed None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:55.398710 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c143789-cb94-49c7-a48e-609b856008ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:55.420816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-5c143789-cb94-49c7-a48e-609b856008ed None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:55.422304 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5c143789-cb94-49c7-a48e-609b856008ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:55.516133 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 493/961] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:26:55.516351 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc27d4-3fff-478a-967e-9cd910b4a026 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:55.553913 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413ab1f-cc7c-4ba9-ad55-c72d73f10693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:55.554530 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413ab1f-cc7c-4ba9-ad55-c72d73f10693 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:55.554804 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413ab1f-cc7c-4ba9-ad55-c72d73f10693 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:55.555073 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413ab1f-cc7c-4ba9-ad55-c72d73f10693 None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:55.555722 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413ab1f-cc7c-4ba9-ad55-c72d73f10693 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:55.556021 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413ab1f-cc7c-4ba9-ad55-c72d73f10693 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:55.557455 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413ab1f-cc7c-4ba9-ad55-c72d73f10693 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:55.571226 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 469/962] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:55.578903 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c143789-cb94-49c7-a48e-609b856008ed None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:55.690960 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c143789-cb94-49c7-a48e-609b856008ed None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:55.704265 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:55.734966 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f302bac-0635-40e5-8284-176aa9416f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:55.735946 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f302bac-0635-40e5-8284-176aa9416f76 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:55.736639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f302bac-0635-40e5-8284-176aa9416f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:55.737149 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f302bac-0635-40e5-8284-176aa9416f76 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:55.745278 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f302bac-0635-40e5-8284-176aa9416f76 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:55.746954 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f302bac-0635-40e5-8284-176aa9416f76 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:55.758976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-4f302bac-0635-40e5-8284-176aa9416f76 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:26:55.758976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:55.758976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:55.758976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:55.758976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:55.758976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:55.758976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:55.758976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:55.758976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:55.758976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:55.758976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:55.758976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:55.758976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:55.758976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:55.758976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:55.758976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:55.759973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:55.759973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:55.759973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:55.759973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:55.759973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:55.759973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:55.759973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:55.759973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:55.759973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:55.759973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:55.759973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:55.759973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:55.759973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:55.759973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:55.759973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:55.759973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:55.759973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:55.759973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:55.761975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:55.761975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:55.761975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:55.761975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:55.761975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:55.761975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:55.761975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:55.761975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:55.761975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:26:55.761975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:55.764651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 494/963] 10.222.0.69 () {56 vars in 1117 bytes} [Mon Aug 29 21:26:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:55.770842 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413ab1f-cc7c-4ba9-ad55-c72d73f10693 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:55.793312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f302bac-0635-40e5-8284-176aa9416f76 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:55.833800 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:55.904364 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f302bac-0635-40e5-8284-176aa9416f76 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:55.910306 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413ab1f-cc7c-4ba9-ad55-c72d73f10693 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:55.946172 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18c413-63db-4dd8-85e7-e2439155cfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:55.947164 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18c413-63db-4dd8-85e7-e2439155cfcc None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:55.948429 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18c413-63db-4dd8-85e7-e2439155cfcc None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:55.949022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18c413-63db-4dd8-85e7-e2439155cfcc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:55.949873 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18c413-63db-4dd8-85e7-e2439155cfcc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:55.951224 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248c33a-1bf5-4b4d-b329-5ab73a748b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:55.951769 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18c413-63db-4dd8-85e7-e2439155cfcc None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:55.951877 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248c33a-1bf5-4b4d-b329-5ab73a748b72 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:55.952101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248c33a-1bf5-4b4d-b329-5ab73a748b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:55.952407 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248c33a-1bf5-4b4d-b329-5ab73a748b72 None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:55.953331 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248c33a-1bf5-4b4d-b329-5ab73a748b72 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:55.953641 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248c33a-1bf5-4b4d-b329-5ab73a748b72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:55.955182 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248c33a-1bf5-4b4d-b329-5ab73a748b72 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:55.963089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-0a18c413-63db-4dd8-85e7-e2439155cfcc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:26:55.963089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:55.963089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:26:55.963089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:26:55.963089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:26:55.963089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:26:55.963089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:26:55.963089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:55.963089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:26:55.963089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:55.963089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:26:55.963089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:55.963089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:55.963089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:55.963089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:55.963089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:55.963089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:55.964331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:55.964331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:55.964331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:55.964331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:55.964331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:55.964331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:55.964331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:26:55.964331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:26:55.964331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:26:55.964331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:26:55.964331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:55.964331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:55.964331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:55.964331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:55.964331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:55.964331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:55.965177 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:55.965177 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:55.965177 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:55.965177 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:55.965177 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:55.965177 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:55.965177 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:55.965177 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:55.965177 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:55.965177 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:55.965177 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:26:55.965177 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:55.965177 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:26:55.965177 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:55.968130 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 495/964] 10.222.0.69 () {56 vars in 1126 bytes} [Mon Aug 29 21:26:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:26:55.976231 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 470/965] 10.222.0.69 () {56 vars in 1149 bytes} [Mon Aug 29 21:26:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:55.977395 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18c413-63db-4dd8-85e7-e2439155cfcc None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:55.979428 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248c33a-1bf5-4b4d-b329-5ab73a748b72 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:56.024217 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:56.095531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248c33a-1bf5-4b4d-b329-5ab73a748b72 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:56.098418 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:56.112941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18c413-63db-4dd8-85e7-e2439155cfcc None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:56.145899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6791c-4848-46f0-9595-2a9d1dd78962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:56.146747 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6791c-4848-46f0-9595-2a9d1dd78962 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:56.147031 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6791c-4848-46f0-9595-2a9d1dd78962 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:56.147308 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6791c-4848-46f0-9595-2a9d1dd78962 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:56.154730 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73c690-c2f2-48fa-989a-0c2e019ab472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:56.155707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73c690-c2f2-48fa-989a-0c2e019ab472 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:56.156211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73c690-c2f2-48fa-989a-0c2e019ab472 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:56.156702 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73c690-c2f2-48fa-989a-0c2e019ab472 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:56.157637 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73c690-c2f2-48fa-989a-0c2e019ab472 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:56.158150 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73c690-c2f2-48fa-989a-0c2e019ab472 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:56.159828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73c690-c2f2-48fa-989a-0c2e019ab472 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:56.165855 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 496/966] 10.222.0.69 () {56 vars in 1122 bytes} [Mon Aug 29 21:26:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:56.174525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73c690-c2f2-48fa-989a-0c2e019ab472 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:56.242812 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6791c-4848-46f0-9595-2a9d1dd78962 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:56.245362 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6791c-4848-46f0-9595-2a9d1dd78962 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:56.314382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:56.322178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73c690-c2f2-48fa-989a-0c2e019ab472 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:56.359200 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9519813-aeea-4dd6-b814-67b1e891adef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:56.359975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9519813-aeea-4dd6-b814-67b1e891adef None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:56.360386 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9519813-aeea-4dd6-b814-67b1e891adef None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:56.360759 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9519813-aeea-4dd6-b814-67b1e891adef None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:56.361500 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9519813-aeea-4dd6-b814-67b1e891adef None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:56.361899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9519813-aeea-4dd6-b814-67b1e891adef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:56.363558 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9519813-aeea-4dd6-b814-67b1e891adef None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:56.370387 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 497/967] 10.222.0.69 () {56 vars in 1122 bytes} [Mon Aug 29 21:26:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:56.377101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 471/968] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:26:55 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 21:26:56.380078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9519813-aeea-4dd6-b814-67b1e891adef None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:56.383906 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6791c-4848-46f0-9595-2a9d1dd78962 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:56.387206 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:56.495050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6791c-4848-46f0-9595-2a9d1dd78962 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:56.499218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9519813-aeea-4dd6-b814-67b1e891adef None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:56.537421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c34ac-8080-4f05-b7f8-214b5e1cf683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:56.538499 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c34ac-8080-4f05-b7f8-214b5e1cf683 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:56.539192 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c34ac-8080-4f05-b7f8-214b5e1cf683 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:56.539467 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c34ac-8080-4f05-b7f8-214b5e1cf683 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:56.544911 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6aad5-92fb-4332-bb80-ab3da6f964cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:56.545537 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6aad5-92fb-4332-bb80-ab3da6f964cd None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:56.545815 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6aad5-92fb-4332-bb80-ab3da6f964cd None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:56.546083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6aad5-92fb-4332-bb80-ab3da6f964cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:56.546752 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6aad5-92fb-4332-bb80-ab3da6f964cd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:56.549054 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6aad5-92fb-4332-bb80-ab3da6f964cd None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:56.550560 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c34ac-8080-4f05-b7f8-214b5e1cf683 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:56.552340 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c34ac-8080-4f05-b7f8-214b5e1cf683 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:56.570534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-1e4c34ac-8080-4f05-b7f8-214b5e1cf683 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:56.570534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:56.570534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:56.570534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:56.570534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:56.570534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:56.570534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:56.570534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:56.570534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:56.570534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:56.570534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:56.570534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:56.570534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:56.570534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:56.570534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:56.570534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:56.571655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:56.571655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:56.571655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:56.571655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:56.571655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:56.571655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:56.571655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:56.571655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:56.571655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:56.571655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:56.571655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:56.571655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:56.571655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:56.571655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:56.571655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:56.571655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:56.571655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:56.572725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:56.572725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:56.572725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:56.572725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 472/969] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:56.573395 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8c13e-6ac8-4055-aad5-d3c262512d80 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:56.573722 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8c13e-6ac8-4055-aad5-d3c262512d80 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:56.573935 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8c13e-6ac8-4055-aad5-d3c262512d80 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:56.580356 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 473/970] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:56.580356 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8c13e-6ac8-4055-aad5-d3c262512d80 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:56.584748 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 498/971] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:26:56 2022] POST /identity/v3/endpoints => generated 349 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:26:56.586332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a17f0d-c6b9-48aa-b3cb-e4c1f6c20d8f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:56.586830 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a17f0d-c6b9-48aa-b3cb-e4c1f6c20d8f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:56.587281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a17f0d-c6b9-48aa-b3cb-e4c1f6c20d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:56.610425 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-57a17f0d-c6b9-48aa-b3cb-e4c1f6c20d8f None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:56.612265 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-57a17f0d-c6b9-48aa-b3cb-e4c1f6c20d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:56.637455 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:56.649449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:56.702772 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 499/972] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:26:56.714597 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8c13e-6ac8-4055-aad5-d3c262512d80 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:56.754221 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1384697-2aa3-4be7-9201-f469e83826e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:56.754826 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1384697-2aa3-4be7-9201-f469e83826e6 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:56.755108 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1384697-2aa3-4be7-9201-f469e83826e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:56.755405 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1384697-2aa3-4be7-9201-f469e83826e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:56.756207 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1384697-2aa3-4be7-9201-f469e83826e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:56.756419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1384697-2aa3-4be7-9201-f469e83826e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:56.757788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1384697-2aa3-4be7-9201-f469e83826e6 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:56.771105 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 474/973] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:56.777320 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a17f0d-c6b9-48aa-b3cb-e4c1f6c20d8f None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:56.895839 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a17f0d-c6b9-48aa-b3cb-e4c1f6c20d8f None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:56.932198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b752ad8-6e6e-41cf-94ed-071a33c6d70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:56.932846 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b752ad8-6e6e-41cf-94ed-071a33c6d70d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:56.933127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b752ad8-6e6e-41cf-94ed-071a33c6d70d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:56.933401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b752ad8-6e6e-41cf-94ed-071a33c6d70d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:56.940550 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b752ad8-6e6e-41cf-94ed-071a33c6d70d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:56.942005 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b752ad8-6e6e-41cf-94ed-071a33c6d70d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:56.954262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-8b752ad8-6e6e-41cf-94ed-071a33c6d70d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:56.954262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:56.954262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:56.954262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:56.954262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:56.954262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:56.954262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:56.954262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:56.954262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:56.954262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:56.954262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:56.954262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:56.954262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:26:56.954262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:26:56.954262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:26:56.955293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:26:56.955293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:56.955293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:56.955293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:56.955293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:56.955293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:56.955293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:56.955293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:56.955293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:56.955293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:56.955293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:56.955293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:56.955293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:56.955293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:56.955293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:56.955293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:56.955293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:56.956202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:26:56.956202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:26:56.956202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:26:56.956202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:26:56.956202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:26:56.956202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:26:56.956202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:26:56.956202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:56.956202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 500/974] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:26:56.963059 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1384697-2aa3-4be7-9201-f469e83826e6 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:57.012824 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b752ad8-6e6e-41cf-94ed-071a33c6d70d None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:57.015833 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:57.085712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1384697-2aa3-4be7-9201-f469e83826e6 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:57.104130 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:57.125704 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e441d-52c9-41a6-9786-6d514153ce36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:57.126428 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e441d-52c9-41a6-9786-6d514153ce36 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:57.126714 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e441d-52c9-41a6-9786-6d514153ce36 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:57.126987 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e441d-52c9-41a6-9786-6d514153ce36 None admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:57.128046 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e441d-52c9-41a6-9786-6d514153ce36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:57.128449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e441d-52c9-41a6-9786-6d514153ce36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:57.130721 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e441d-52c9-41a6-9786-6d514153ce36 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:57.141379 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b752ad8-6e6e-41cf-94ed-071a33c6d70d None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:57.156227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 475/975] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:26:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:57.159813 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e441d-52c9-41a6-9786-6d514153ce36 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:57.200374 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9815025-b7c4-48a2-982a-009ac2179d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:57.201787 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9815025-b7c4-48a2-982a-009ac2179d3a None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:57.202069 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9815025-b7c4-48a2-982a-009ac2179d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:57.202341 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9815025-b7c4-48a2-982a-009ac2179d3a None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:57.203928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9815025-b7c4-48a2-982a-009ac2179d3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:57.207207 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9815025-b7c4-48a2-982a-009ac2179d3a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:57.227179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.sql.core [None req-a9815025-b7c4-48a2-982a-009ac2179d3a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 21:26:57.227179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 21:26:57.227179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [parameters: {'user_id': '135bfb7af55f4220b1206cd8fba7028e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 21:26:57.227179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81658) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 21:26:57.237696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-a9815025-b7c4-48a2-982a-009ac2179d3a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 21:26:57.237696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:57.237696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 21:26:57.237696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 21:26:57.237696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 21:26:57.237696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 21:26:57.237696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 21:26:57.237696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 21:26:57.237696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 21:26:57.237696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application conn.query(q) Aug 29 21:26:57.237696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 21:26:57.237696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 21:26:57.237696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 21:26:57.237696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application result.read() Aug 29 21:26:57.237696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 21:26:57.238658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 21:26:57.238658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 21:26:57.238658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 21:26:57.238658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 21:26:57.238658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 21:26:57.238658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 21:26:57.238658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 21:26:57.238658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 21:26:57.238658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:57.238658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 21:26:57.238658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:57.238658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:57.238658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 21:26:57.238658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 21:26:57.238658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 29 21:26:57.238658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 29 21:26:57.238658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 21:26:57.238658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application next(self.gen) Aug 29 21:26:57.239608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 21:26:57.239608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application yield resource Aug 29 21:26:57.239608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 21:26:57.239608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application next(self.gen) Aug 29 21:26:57.239608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 21:26:57.239608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 21:26:57.239608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 21:26:57.239608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 21:26:57.239608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 21:26:57.239608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise self.value Aug 29 21:26:57.239608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 21:26:57.239608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 21:26:57.239608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 21:26:57.239608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application session.commit() Aug 29 21:26:57.239608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 21:26:57.239608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 21:26:57.239608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 21:26:57.240554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 21:26:57.240554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 21:26:57.240554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self.session.flush() Aug 29 21:26:57.240554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 21:26:57.240554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 21:26:57.240554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 21:26:57.240554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 21:26:57.240554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 21:26:57.240554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application compat.raise_( Aug 29 21:26:57.240554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 21:26:57.240554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception Aug 29 21:26:57.240554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 21:26:57.240554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 21:26:57.240554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 21:26:57.240554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 21:26:57.240554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 21:26:57.240554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 21:26:57.242335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 21:26:57.242335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 21:26:57.242335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 21:26:57.242335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 29 21:26:57.242335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 21:26:57.242335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 21:26:57.242335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 21:26:57.242335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 21:26:57.242335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 21:26:57.242335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 21:26:57.242335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 21:26:57.242335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 21:26:57.242335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 21:26:57.242335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 21:26:57.242335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 21:26:57.242335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception Aug 29 21:26:57.243196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 21:26:57.243196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 21:26:57.243196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 21:26:57.243196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 21:26:57.243196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 21:26:57.243196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 21:26:57.243196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 21:26:57.243196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application conn.query(q) Aug 29 21:26:57.243196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 21:26:57.243196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 21:26:57.243196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 21:26:57.243196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application result.read() Aug 29 21:26:57.243196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 21:26:57.243196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 21:26:57.243196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 21:26:57.243196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 21:26:57.244061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 21:26:57.244061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 21:26:57.244061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 21:26:57.244061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 21:26:57.244061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 21:26:57.244061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 21:26:57.244061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [parameters: {'user_id': '135bfb7af55f4220b1206cd8fba7028e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 21:26:57.244061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 21:26:57.244061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:57.244061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:26:57.244061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:57.244061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:57.244061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:57.244061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:57.244061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:57.246437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:57.246437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:57.246437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:57.246437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:57.246437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:57.246437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:57.246437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:57.246437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 29 21:26:57.246437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 29 21:26:57.246437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:57.246437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:57.246437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:57.246437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:57.246437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:57.246437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:57.246437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 29 21:26:57.246437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 29 21:26:57.249666 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 29 21:26:57.249666 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 29 21:26:57.249666 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 21:26:57.249666 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 21:26:57.249666 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 21:26:57.249666 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:57.249666 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 501/976] 10.222.0.69 () {60 vars in 1131 bytes} [Mon Aug 29 21:26:57 2022] POST /identity/v3/users => generated 160 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:57.251874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9815025-b7c4-48a2-982a-009ac2179d3a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:57.294766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e441d-52c9-41a6-9786-6d514153ce36 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:57.338734 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:57.345199 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba371076-5e7b-4b80-8951-a4f592ff4f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:57.346353 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba371076-5e7b-4b80-8951-a4f592ff4f68 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:57.346854 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba371076-5e7b-4b80-8951-a4f592ff4f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:57.347618 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba371076-5e7b-4b80-8951-a4f592ff4f68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:57.348663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba371076-5e7b-4b80-8951-a4f592ff4f68 None admin] RBAC: Adding query filter params (role.id=5a3de60a67584f299df269bc459f952f, scope.project.id=a302406c548c43c983625c0d66da47cc, user.id=540e06e694524c4a9e84ebebd45956d6) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:57.349204 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba371076-5e7b-4b80-8951-a4f592ff4f68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:57.351054 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba371076-5e7b-4b80-8951-a4f592ff4f68 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:57.364828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 476/977] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:26:57 2022] GET /identity/v3/role_assignments?user.id=540e06e694524c4a9e84ebebd45956d6&scope.project.id=a302406c548c43c983625c0d66da47cc&role.id=5a3de60a67584f299df269bc459f952f => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:57.383195 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9815025-b7c4-48a2-982a-009ac2179d3a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:57.423448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c1a03-5064-4b76-947e-df0abf8a20a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:57.424432 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c1a03-5064-4b76-947e-df0abf8a20a9 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:57.424858 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c1a03-5064-4b76-947e-df0abf8a20a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:57.425275 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c1a03-5064-4b76-947e-df0abf8a20a9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:57.435230 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c1a03-5064-4b76-947e-df0abf8a20a9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:57.437242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c1a03-5064-4b76-947e-df0abf8a20a9 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:57.450882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-bd6c1a03-5064-4b76-947e-df0abf8a20a9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 21:26:57.450882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:57.450882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:57.450882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:57.450882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:57.450882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:57.450882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:57.450882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:57.450882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:57.450882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:57.450882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:57.450882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:57.450882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:26:57.450882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:26:57.450882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:26:57.450882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:26:57.452101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:57.452101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:57.452101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:26:57.452101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:57.452101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:26:57.452101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:26:57.452101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:57.452101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:57.452101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:57.452101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:57.452101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:57.452101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:57.452101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:57.452101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:57.452101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:57.452101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:57.452101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:57.452101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:57.453299 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:57.453299 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:57.453299 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:26:57.453299 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:26:57.453299 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:26:57.453299 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:26:57.453299 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:26:57.453299 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:26:57.453299 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 21:26:57.453299 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:26:57.455198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 502/978] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:26:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:57.461183 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba371076-5e7b-4b80-8951-a4f592ff4f68 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:57.469508 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520743c-f0fa-4179-b8ac-8ce805bc3a3b None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:57.470127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520743c-f0fa-4179-b8ac-8ce805bc3a3b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:57.470543 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520743c-f0fa-4179-b8ac-8ce805bc3a3b None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:57.475963 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 503/979] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:57.481735 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef22e63-760d-4cf1-b1e6-88261ac2e720 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:57.482048 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef22e63-760d-4cf1-b1e6-88261ac2e720 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:57.482318 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef22e63-760d-4cf1-b1e6-88261ac2e720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:57.503322 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-3ef22e63-760d-4cf1-b1e6-88261ac2e720 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:57.505007 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3ef22e63-760d-4cf1-b1e6-88261ac2e720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:57.523260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:57.595116 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 504/980] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:26:57.614181 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba371076-5e7b-4b80-8951-a4f592ff4f68 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:57.652248 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1f256-9dee-40fe-b1e6-deebf760fdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:57.653260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1f256-9dee-40fe-b1e6-deebf760fdfe None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:57.653744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1f256-9dee-40fe-b1e6-deebf760fdfe None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:57.654232 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1f256-9dee-40fe-b1e6-deebf760fdfe None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:57.655138 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1f256-9dee-40fe-b1e6-deebf760fdfe None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:57.655636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1f256-9dee-40fe-b1e6-deebf760fdfe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:57.657343 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1f256-9dee-40fe-b1e6-deebf760fdfe None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:57.695638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 477/981] 10.222.0.69 () {56 vars in 1101 bytes} [Mon Aug 29 21:26:57 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:57.876857 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef22e63-760d-4cf1-b1e6-88261ac2e720 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:57.938398 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:57.985937 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef22e63-760d-4cf1-b1e6-88261ac2e720 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:58.020069 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf492e0-724e-433e-baa9-655b70bdfd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:58.020755 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf492e0-724e-433e-baa9-655b70bdfd44 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:58.020976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf492e0-724e-433e-baa9-655b70bdfd44 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:58.021248 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf492e0-724e-433e-baa9-655b70bdfd44 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:58.021914 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf492e0-724e-433e-baa9-655b70bdfd44 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:58.023281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf492e0-724e-433e-baa9-655b70bdfd44 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:58.040222 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 505/982] 10.222.0.69 () {60 vars in 1141 bytes} [Mon Aug 29 21:26:57 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:26:58.689632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc67cd-3073-4b39-b1b9-d03f4e7aeeaa None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:58.690185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc67cd-3073-4b39-b1b9-d03f4e7aeeaa None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:58.690185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc67cd-3073-4b39-b1b9-d03f4e7aeeaa None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:58.691780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 478/983] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:58.696824 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e30138-42d5-4449-9cfe-06b4dbc439ac None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:58.697113 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e30138-42d5-4449-9cfe-06b4dbc439ac None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:58.697393 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e30138-42d5-4449-9cfe-06b4dbc439ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:58.716167 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-98e30138-42d5-4449-9cfe-06b4dbc439ac None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:58.717384 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-98e30138-42d5-4449-9cfe-06b4dbc439ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:58.796373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 506/984] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:58 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:26:59.069369 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc67cd-3073-4b39-b1b9-d03f4e7aeeaa None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:59.175901 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:59.182806 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc67cd-3073-4b39-b1b9-d03f4e7aeeaa None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:59.219993 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2620c-5e21-449d-a8d2-23225a98b3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:59.220673 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2620c-5e21-449d-a8d2-23225a98b3d4 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:59.220953 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2620c-5e21-449d-a8d2-23225a98b3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:59.221227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2620c-5e21-449d-a8d2-23225a98b3d4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:59.221813 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2620c-5e21-449d-a8d2-23225a98b3d4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:59.223290 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2620c-5e21-449d-a8d2-23225a98b3d4 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:59.233774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-b9e2620c-5e21-449d-a8d2-23225a98b3d4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:26:59.233774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:59.233774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:26:59.233774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:26:59.233774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:26:59.233774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:26:59.233774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:26:59.233774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:59.233774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:26:59.233774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:59.233774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:26:59.233774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:59.233774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:59.233774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:59.233774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:59.233774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:59.233774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:59.235082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:59.235082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:59.235082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:59.235082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:59.235082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:59.235082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:59.235082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:26:59.235082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:26:59.235082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:26:59.235082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:26:59.235082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:59.235082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:59.235082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:59.235082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:59.235082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:59.235082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:59.236050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:59.236050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:59.236050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:59.236050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:59.236050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:59.236050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:59.236050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:59.236050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:59.236050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:59.236050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:59.236050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:26:59.236050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:26:59.236050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:26:59.236050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:26:59.239945 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 479/985] 10.222.0.69 () {56 vars in 1126 bytes} [Mon Aug 29 21:26:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:59.240977 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e30138-42d5-4449-9cfe-06b4dbc439ac None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:59.287001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:59.352612 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e30138-42d5-4449-9cfe-06b4dbc439ac None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:59.390605 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0489f-3c4a-4682-a679-ee12c42e58cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:59.391218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0489f-3c4a-4682-a679-ee12c42e58cf None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:59.391498 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0489f-3c4a-4682-a679-ee12c42e58cf None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:59.391772 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0489f-3c4a-4682-a679-ee12c42e58cf None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:59.392434 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0489f-3c4a-4682-a679-ee12c42e58cf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:59.392740 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0489f-3c4a-4682-a679-ee12c42e58cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:59.394124 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0489f-3c4a-4682-a679-ee12c42e58cf None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:59.404255 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 507/986] 10.222.0.69 () {56 vars in 1122 bytes} [Mon Aug 29 21:26:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:59.406139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2620c-5e21-449d-a8d2-23225a98b3d4 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:59.425458 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13eb3d6-4401-49bf-bba7-27a115c22f0d None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:59.425458 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13eb3d6-4401-49bf-bba7-27a115c22f0d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:59.425458 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13eb3d6-4401-49bf-bba7-27a115c22f0d None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:59.427168 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 508/987] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:26:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:26:59.432677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8d877-34ee-4472-8b5d-de0693c0619b None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:59.433138 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8d877-34ee-4472-8b5d-de0693c0619b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:59.433587 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8d877-34ee-4472-8b5d-de0693c0619b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:59.456094 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-b9a8d877-34ee-4472-8b5d-de0693c0619b None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:59.457569 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b9a8d877-34ee-4472-8b5d-de0693c0619b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:59.518086 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2620c-5e21-449d-a8d2-23225a98b3d4 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:59.535032 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 509/988] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:59 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:26:59.556554 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43f07f-5f53-497e-9b48-99a0061691d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:59.557162 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43f07f-5f53-497e-9b48-99a0061691d1 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:59.557440 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43f07f-5f53-497e-9b48-99a0061691d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:59.557713 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43f07f-5f53-497e-9b48-99a0061691d1 None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:59.558368 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43f07f-5f53-497e-9b48-99a0061691d1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:59.558670 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43f07f-5f53-497e-9b48-99a0061691d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:59.560036 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43f07f-5f53-497e-9b48-99a0061691d1 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:59.565399 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 480/989] 10.222.0.69 () {56 vars in 1122 bytes} [Mon Aug 29 21:26:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:59.571083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8d877-34ee-4472-8b5d-de0693c0619b None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:59.610963 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:59.680719 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8d877-34ee-4472-8b5d-de0693c0619b None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:59.716119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26137957-d15b-4b8c-aa12-6dc845420428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:59.716840 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26137957-d15b-4b8c-aa12-6dc845420428 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:59.717131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26137957-d15b-4b8c-aa12-6dc845420428 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:59.717407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26137957-d15b-4b8c-aa12-6dc845420428 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:59.718543 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26137957-d15b-4b8c-aa12-6dc845420428 None admin] RBAC: Adding query filter params (interface=admin, service_id=9318e0b771484be9b7de0c27e2ab0569, region_id=RegionOne) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:59.718543 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26137957-d15b-4b8c-aa12-6dc845420428 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:59.719778 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26137957-d15b-4b8c-aa12-6dc845420428 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:59.728407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 510/990] 10.222.0.69 () {56 vars in 1249 bytes} [Mon Aug 29 21:26:59 2022] GET /identity/v3/endpoints?service_id=9318e0b771484be9b7de0c27e2ab0569&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:59.731591 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43f07f-5f53-497e-9b48-99a0061691d1 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:59.762762 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:59.803821 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26137957-d15b-4b8c-aa12-6dc845420428 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:59.847485 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43f07f-5f53-497e-9b48-99a0061691d1 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:59.885970 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b4cf3-5cbc-4996-8296-b05749c87692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:59.886539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b4cf3-5cbc-4996-8296-b05749c87692 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:59.886821 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b4cf3-5cbc-4996-8296-b05749c87692 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:59.887096 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b4cf3-5cbc-4996-8296-b05749c87692 None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:59.887710 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b4cf3-5cbc-4996-8296-b05749c87692 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:59.889108 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b4cf3-5cbc-4996-8296-b05749c87692 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:59.896115 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 481/991] 10.222.0.69 () {56 vars in 1087 bytes} [Mon Aug 29 21:26:59 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:26:59.929028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:59.935985 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26137957-d15b-4b8c-aa12-6dc845420428 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:00.003642 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcda8b1-b43b-468c-a0a5-9781a162691d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:00.004788 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcda8b1-b43b-468c-a0a5-9781a162691d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:00.005287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcda8b1-b43b-468c-a0a5-9781a162691d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:00.005752 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcda8b1-b43b-468c-a0a5-9781a162691d None admin] PATH_INFO: `/v3/services/image` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:00.006707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcda8b1-b43b-468c-a0a5-9781a162691d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:00.009358 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcda8b1-b43b-468c-a0a5-9781a162691d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:00.028223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-edcda8b1-b43b-468c-a0a5-9781a162691d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:27:00.028223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:00.028223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:27:00.028223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:27:00.028223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:27:00.028223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:27:00.028223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:27:00.028223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:27:00.028223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:27:00.028223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:00.028223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:27:00.028223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:00.028223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:00.028223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:00.028223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:00.028223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:00.028223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:00.029340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:00.029340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:00.029340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:00.029340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:00.029340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:00.029340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:00.029340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:27:00.029340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:27:00.029340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:27:00.029340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:27:00.029340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:00.029340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:00.029340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:00.029340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:00.029340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:00.029340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:00.030198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:00.030198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:00.030198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:00.030198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:00.030198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:00.030198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:00.030198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:00.030198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:00.030198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:00.030198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:00.030198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:27:00.030198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:27:00.030198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:27:00.030198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:00.030967 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 511/992] 10.222.0.69 () {56 vars in 1105 bytes} [Mon Aug 29 21:26:59 2022] GET /identity/v3/services/image => generated 86 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:27:00.036873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b4cf3-5cbc-4996-8296-b05749c87692 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:00.059095 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f158f-f092-43a7-8ed4-186c3e81dac0 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:00.059374 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f158f-f092-43a7-8ed4-186c3e81dac0 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:00.059653 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f158f-f092-43a7-8ed4-186c3e81dac0 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:00.061040 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 512/993] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:27:00.066871 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b08e7-0200-4f5b-a8a4-6917a8a1d85f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:00.067165 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b08e7-0200-4f5b-a8a4-6917a8a1d85f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:00.067437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b08e7-0200-4f5b-a8a4-6917a8a1d85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:00.087413 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-9c9b08e7-0200-4f5b-a8a4-6917a8a1d85f None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:00.089284 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9c9b08e7-0200-4f5b-a8a4-6917a8a1d85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:00.139713 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:00.150668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b4cf3-5cbc-4996-8296-b05749c87692 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:00.160225 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 513/994] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:27:00.192216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb1afd-24f9-4b44-b1ef-e6a639898a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:00.193532 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb1afd-24f9-4b44-b1ef-e6a639898a34 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:00.194992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb1afd-24f9-4b44-b1ef-e6a639898a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:00.195285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb1afd-24f9-4b44-b1ef-e6a639898a34 None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:00.196019 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb1afd-24f9-4b44-b1ef-e6a639898a34 None admin] RBAC: Adding query filter params (name=image) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:00.196406 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb1afd-24f9-4b44-b1ef-e6a639898a34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:00.198420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb1afd-24f9-4b44-b1ef-e6a639898a34 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:00.208327 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 482/995] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:27:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:00.212538 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b08e7-0200-4f5b-a8a4-6917a8a1d85f None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:00.310892 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:00.321582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b08e7-0200-4f5b-a8a4-6917a8a1d85f None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:00.356479 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1484b5-f6fc-463c-9167-27cca50ad1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:00.357096 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1484b5-f6fc-463c-9167-27cca50ad1e5 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:00.357375 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1484b5-f6fc-463c-9167-27cca50ad1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:00.359527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1484b5-f6fc-463c-9167-27cca50ad1e5 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:00.359527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1484b5-f6fc-463c-9167-27cca50ad1e5 None admin] RBAC: Adding query filter params (type=image) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:00.359527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1484b5-f6fc-463c-9167-27cca50ad1e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:00.360343 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1484b5-f6fc-463c-9167-27cca50ad1e5 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:00.366725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 514/996] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:27:00 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:00.430588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb1afd-24f9-4b44-b1ef-e6a639898a34 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:00.548915 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb1afd-24f9-4b44-b1ef-e6a639898a34 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:00.583097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779693f-e33c-4048-9052-5433e5e3ab48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:00.583721 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779693f-e33c-4048-9052-5433e5e3ab48 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:00.583997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779693f-e33c-4048-9052-5433e5e3ab48 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:00.584328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779693f-e33c-4048-9052-5433e5e3ab48 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:00.584914 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779693f-e33c-4048-9052-5433e5e3ab48 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:00.586289 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779693f-e33c-4048-9052-5433e5e3ab48 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:00.595294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-f779693f-e33c-4048-9052-5433e5e3ab48 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:27:00.595294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:00.595294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:27:00.595294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:27:00.595294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:27:00.595294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:27:00.595294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:27:00.595294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:27:00.595294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:27:00.595294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:27:00.595294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:27:00.595294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:27:00.595294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:00.595294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:00.595294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:00.595294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:00.595294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:00.596464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:00.596464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:00.596464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:00.596464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:00.596464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:00.596464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:00.596464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:27:00.596464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:27:00.596464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:27:00.596464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:27:00.596464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:00.596464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:00.596464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:00.596464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:00.596464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:00.596464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:00.597321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:00.597321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:00.597321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:00.597321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:00.597321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:00.597321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:00.597321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:00.597321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:00.597321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:00.597321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:00.597321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:27:00.597321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:27:00.597321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:27:00.597321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:27:00.597321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 483/997] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:27:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:00.602216 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1484b5-f6fc-463c-9167-27cca50ad1e5 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:00.717449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1484b5-f6fc-463c-9167-27cca50ad1e5 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:00.752849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588cd702-c0a1-4a85-b9a9-8f4240312c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:00.753464 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cd702-c0a1-4a85-b9a9-8f4240312c92 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:00.753742 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cd702-c0a1-4a85-b9a9-8f4240312c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:00.754017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cd702-c0a1-4a85-b9a9-8f4240312c92 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:00.754637 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588cd702-c0a1-4a85-b9a9-8f4240312c92 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:00.754953 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588cd702-c0a1-4a85-b9a9-8f4240312c92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:00.756299 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588cd702-c0a1-4a85-b9a9-8f4240312c92 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:00.761808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 515/998] 10.222.0.69 () {56 vars in 1112 bytes} [Mon Aug 29 21:27:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:00.767197 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779693f-e33c-4048-9052-5433e5e3ab48 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:00.787425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:00.878923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779693f-e33c-4048-9052-5433e5e3ab48 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:00.914740 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fcae3-17d3-4d9f-9191-fd1a4dc6c23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:00.915354 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fcae3-17d3-4d9f-9191-fd1a4dc6c23a None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:00.915633 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fcae3-17d3-4d9f-9191-fd1a4dc6c23a None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:00.915909 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fcae3-17d3-4d9f-9191-fd1a4dc6c23a None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:00.916592 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91fcae3-17d3-4d9f-9191-fd1a4dc6c23a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:00.917434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91fcae3-17d3-4d9f-9191-fd1a4dc6c23a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:00.918876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91fcae3-17d3-4d9f-9191-fd1a4dc6c23a None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:00.924422 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 484/999] 10.222.0.69 () {56 vars in 1112 bytes} [Mon Aug 29 21:27:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:00.929971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588cd702-c0a1-4a85-b9a9-8f4240312c92 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:00.952390 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:01.039687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588cd702-c0a1-4a85-b9a9-8f4240312c92 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:01.075387 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dab06-affd-4dae-a7b8-c2d955e24436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:01.075990 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dab06-affd-4dae-a7b8-c2d955e24436 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:01.076298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dab06-affd-4dae-a7b8-c2d955e24436 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:01.076573 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dab06-affd-4dae-a7b8-c2d955e24436 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:01.077260 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57dab06-affd-4dae-a7b8-c2d955e24436 None admin] RBAC: Adding query filter params (interface=public, service_id=0dc491a6e1774478866b5998c2cbb9ee, region_id=RegionOne) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:01.077567 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57dab06-affd-4dae-a7b8-c2d955e24436 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:01.078909 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57dab06-affd-4dae-a7b8-c2d955e24436 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:01.084355 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 516/1000] 10.222.0.69 () {56 vars in 1251 bytes} [Mon Aug 29 21:27:00 2022] GET /identity/v3/endpoints?service_id=0dc491a6e1774478866b5998c2cbb9ee&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:01.090080 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fcae3-17d3-4d9f-9191-fd1a4dc6c23a None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:01.178239 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:01.198461 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fcae3-17d3-4d9f-9191-fd1a4dc6c23a None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:01.236753 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5d6dc-8b5b-4b63-b1d8-755bcf253f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:01.237365 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5d6dc-8b5b-4b63-b1d8-755bcf253f53 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:01.237642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5d6dc-8b5b-4b63-b1d8-755bcf253f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:01.237913 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5d6dc-8b5b-4b63-b1d8-755bcf253f53 None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:01.238515 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5d6dc-8b5b-4b63-b1d8-755bcf253f53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:01.239874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5d6dc-8b5b-4b63-b1d8-755bcf253f53 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:01.247253 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 485/1001] 10.222.0.69 () {56 vars in 1087 bytes} [Mon Aug 29 21:27:01 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:27:01.843938 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04220e5f-2274-4a82-a7b3-a055c2a603ba None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:01.844497 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04220e5f-2274-4a82-a7b3-a055c2a603ba None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:01.844578 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04220e5f-2274-4a82-a7b3-a055c2a603ba None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:01.845871 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 517/1002] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:01.851349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60774cd9-0789-42a0-b222-835583f7ac8f None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:01.851965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60774cd9-0789-42a0-b222-835583f7ac8f None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:01.851965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60774cd9-0789-42a0-b222-835583f7ac8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:01.871721 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-60774cd9-0789-42a0-b222-835583f7ac8f None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:01.872955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-60774cd9-0789-42a0-b222-835583f7ac8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:01.946890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 486/1003] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:01 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:27:02.217386 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04220e5f-2274-4a82-a7b3-a055c2a603ba None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:02.284658 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1f972-931a-4ca7-b8c3-bbffc0ef40eb None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:02.284937 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1f972-931a-4ca7-b8c3-bbffc0ef40eb None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:02.285465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1f972-931a-4ca7-b8c3-bbffc0ef40eb None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:02.287117 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 487/1004] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:27:02.292750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88912932-8069-4f69-98fa-7bf5f4fbcd7d None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:02.293318 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88912932-8069-4f69-98fa-7bf5f4fbcd7d None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:02.293797 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88912932-8069-4f69-98fa-7bf5f4fbcd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:02.316395 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:02.316849 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-88912932-8069-4f69-98fa-7bf5f4fbcd7d None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:02.318310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-88912932-8069-4f69-98fa-7bf5f4fbcd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:02.340418 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04220e5f-2274-4a82-a7b3-a055c2a603ba None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:02.379600 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bae04-dd20-4a5c-8abd-a129d6842fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:02.380266 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bae04-dd20-4a5c-8abd-a129d6842fcc None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:02.380554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bae04-dd20-4a5c-8abd-a129d6842fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:02.380889 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bae04-dd20-4a5c-8abd-a129d6842fcc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:02.381420 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7bae04-dd20-4a5c-8abd-a129d6842fcc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:02.382794 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7bae04-dd20-4a5c-8abd-a129d6842fcc None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:02.392687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-bc7bae04-dd20-4a5c-8abd-a129d6842fcc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:27:02.392687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:02.392687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:27:02.392687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:27:02.392687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:27:02.392687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:27:02.392687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:27:02.392687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:27:02.392687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:27:02.392687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:02.392687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:27:02.392687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:02.392687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:02.392687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:02.392687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:02.392687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:02.392687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:02.393743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:02.393743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:02.393743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:02.393743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:02.393743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:02.393743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:02.393743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:27:02.393743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:27:02.393743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:27:02.393743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:27:02.393743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:02.393743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:02.393743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:02.393743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:02.393743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:02.393743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:02.394614 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:02.394614 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:02.394614 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:02.394614 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:02.394614 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:02.394614 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:02.394614 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:02.394614 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:02.394614 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:02.394614 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:02.394614 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:27:02.394614 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:27:02.394614 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:27:02.394614 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:02.394614 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 518/1005] 10.222.0.69 () {56 vars in 1126 bytes} [Mon Aug 29 21:27:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:02.399919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bae04-dd20-4a5c-8abd-a129d6842fcc None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:02.404238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 488/1006] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:27:02.513771 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bae04-dd20-4a5c-8abd-a129d6842fcc None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:02.549935 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff762d0d-c254-4021-bbd2-e86c3460e393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:02.550839 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff762d0d-c254-4021-bbd2-e86c3460e393 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:02.551297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff762d0d-c254-4021-bbd2-e86c3460e393 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:02.551733 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff762d0d-c254-4021-bbd2-e86c3460e393 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:02.552539 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff762d0d-c254-4021-bbd2-e86c3460e393 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:02.552992 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff762d0d-c254-4021-bbd2-e86c3460e393 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:02.554513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff762d0d-c254-4021-bbd2-e86c3460e393 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:02.559984 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 519/1007] 10.222.0.69 () {56 vars in 1122 bytes} [Mon Aug 29 21:27:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:02.565360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88912932-8069-4f69-98fa-7bf5f4fbcd7d None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:02.574187 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:02.670563 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88912932-8069-4f69-98fa-7bf5f4fbcd7d None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:02.683908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff762d0d-c254-4021-bbd2-e86c3460e393 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:02.701432 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:02.718990 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d9144-e106-4010-9afe-b08776f8b7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:02.719660 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d9144-e106-4010-9afe-b08776f8b7e4 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:02.719949 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d9144-e106-4010-9afe-b08776f8b7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:02.720319 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d9144-e106-4010-9afe-b08776f8b7e4 None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:02.720960 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d9144-e106-4010-9afe-b08776f8b7e4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:02.721264 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d9144-e106-4010-9afe-b08776f8b7e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:02.722649 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d9144-e106-4010-9afe-b08776f8b7e4 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:02.728262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 489/1008] 10.222.0.69 () {56 vars in 1122 bytes} [Mon Aug 29 21:27:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:02.734559 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d9144-e106-4010-9afe-b08776f8b7e4 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:02.807835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff762d0d-c254-4021-bbd2-e86c3460e393 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:02.814004 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:02.846400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e62ad-49ad-44b0-9cec-0daccd9a2117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:02.847729 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e62ad-49ad-44b0-9cec-0daccd9a2117 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:02.848215 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e62ad-49ad-44b0-9cec-0daccd9a2117 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:02.848676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e62ad-49ad-44b0-9cec-0daccd9a2117 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:02.849521 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e62ad-49ad-44b0-9cec-0daccd9a2117 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:02.850819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d9144-e106-4010-9afe-b08776f8b7e4 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:02.851254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e62ad-49ad-44b0-9cec-0daccd9a2117 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:02.868305 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 520/1009] 10.222.0.69 () {60 vars in 1141 bytes} [Mon Aug 29 21:27:02 2022] POST /identity/v3/services => generated 242 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:27:02.906122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e524c7-9048-4bb7-9fc0-8b5a3b13b0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:02.906828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e524c7-9048-4bb7-9fc0-8b5a3b13b0a2 None admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:02.907055 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e524c7-9048-4bb7-9fc0-8b5a3b13b0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:02.907275 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e524c7-9048-4bb7-9fc0-8b5a3b13b0a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:02.907943 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e524c7-9048-4bb7-9fc0-8b5a3b13b0a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:02.909667 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e524c7-9048-4bb7-9fc0-8b5a3b13b0a2 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:02.930546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 490/1010] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:27:02 2022] POST /identity/v3/endpoints => generated 325 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:27:03.194423 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a684ad8-a2c1-41f3-8b52-8a51aa698499 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:03.194756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a684ad8-a2c1-41f3-8b52-8a51aa698499 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:03.194986 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a684ad8-a2c1-41f3-8b52-8a51aa698499 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:03.196513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 521/1011] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:03.204671 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8093e-e7f4-4c6b-9a9b-844d904a5859 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:03.204671 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8093e-e7f4-4c6b-9a9b-844d904a5859 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:03.204671 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8093e-e7f4-4c6b-9a9b-844d904a5859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:03.224170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-1fd8093e-e7f4-4c6b-9a9b-844d904a5859 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:03.225424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-1fd8093e-e7f4-4c6b-9a9b-844d904a5859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:03.304080 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 491/1012] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:03 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:27:03.765973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a684ad8-a2c1-41f3-8b52-8a51aa698499 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:03.861965 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:03.897220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a684ad8-a2c1-41f3-8b52-8a51aa698499 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:03.934804 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef8174-5c28-4249-b225-c862cf643012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:03.935438 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef8174-5c28-4249-b225-c862cf643012 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:03.935720 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef8174-5c28-4249-b225-c862cf643012 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:03.935993 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef8174-5c28-4249-b225-c862cf643012 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:03.936605 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef8174-5c28-4249-b225-c862cf643012 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:03.937988 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef8174-5c28-4249-b225-c862cf643012 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:03.947332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-bbef8174-5c28-4249-b225-c862cf643012 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:27:03.947332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:03.947332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:27:03.947332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:27:03.947332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:27:03.947332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:27:03.947332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:27:03.947332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:27:03.947332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:27:03.947332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:03.947332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:27:03.947332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:03.947332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:03.947332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:03.947332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:03.947332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:03.947332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:03.948475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:03.948475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:03.948475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:03.948475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:03.948475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:03.948475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:03.948475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:27:03.948475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:27:03.948475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:27:03.948475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:27:03.948475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:03.948475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:03.948475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:03.948475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:03.948475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:03.948475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:03.949428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:03.949428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:03.949428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:03.949428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:03.949428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:03.949428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:03.949428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:03.949428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:03.949428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:03.949428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:03.949428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:27:03.949428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:27:03.949428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:27:03.949428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:03.952507 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 522/1013] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:27:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:03.954560 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8093e-e7f4-4c6b-9a9b-844d904a5859 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:04.013748 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:04.065293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8093e-e7f4-4c6b-9a9b-844d904a5859 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:04.099579 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d873b-980c-44ca-981e-53bc6fa89d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:04.100223 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d873b-980c-44ca-981e-53bc6fa89d10 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:04.100494 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d873b-980c-44ca-981e-53bc6fa89d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:04.100774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d873b-980c-44ca-981e-53bc6fa89d10 None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:04.101407 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d873b-980c-44ca-981e-53bc6fa89d10 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:04.101716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d873b-980c-44ca-981e-53bc6fa89d10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:04.103109 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d873b-980c-44ca-981e-53bc6fa89d10 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:04.112431 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 492/1014] 10.222.0.69 () {56 vars in 1112 bytes} [Mon Aug 29 21:27:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:04.115126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef8174-5c28-4249-b225-c862cf643012 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:04.224485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef8174-5c28-4249-b225-c862cf643012 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:04.265551 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667ea9f-7f9a-4ffe-8b3c-962d0ee67052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:04.266554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667ea9f-7f9a-4ffe-8b3c-962d0ee67052 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:04.267047 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667ea9f-7f9a-4ffe-8b3c-962d0ee67052 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:04.267520 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667ea9f-7f9a-4ffe-8b3c-962d0ee67052 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:04.268377 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667ea9f-7f9a-4ffe-8b3c-962d0ee67052 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:04.268876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667ea9f-7f9a-4ffe-8b3c-962d0ee67052 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:04.270418 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667ea9f-7f9a-4ffe-8b3c-962d0ee67052 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:04.272785 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:04.277471 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 523/1015] 10.222.0.69 () {56 vars in 1112 bytes} [Mon Aug 29 21:27:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:04.283387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d873b-980c-44ca-981e-53bc6fa89d10 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:04.388477 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d873b-980c-44ca-981e-53bc6fa89d10 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:04.408117 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:04.427905 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a9533-e50c-4647-b1dc-f519982b425a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:04.428764 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a9533-e50c-4647-b1dc-f519982b425a None admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:04.429204 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a9533-e50c-4647-b1dc-f519982b425a None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:04.429605 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a9533-e50c-4647-b1dc-f519982b425a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:04.430444 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a9533-e50c-4647-b1dc-f519982b425a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:04.431999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a9533-e50c-4647-b1dc-f519982b425a None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:04.468211 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 493/1016] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:27:04 2022] POST /identity/v3/endpoints => generated 334 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:27:04.845110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a5ab1-de2a-4fc6-abd0-b3f9e3fc5422 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:04.845410 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a5ab1-de2a-4fc6-abd0-b3f9e3fc5422 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:04.845577 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a5ab1-de2a-4fc6-abd0-b3f9e3fc5422 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:04.847067 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 524/1017] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:04.852149 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37048e8a-e913-4f94-ac43-0db13d6facb2 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:04.852479 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37048e8a-e913-4f94-ac43-0db13d6facb2 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:04.852759 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37048e8a-e913-4f94-ac43-0db13d6facb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:04.872046 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-37048e8a-e913-4f94-ac43-0db13d6facb2 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:04.873280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-37048e8a-e913-4f94-ac43-0db13d6facb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:04.953280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 494/1018] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:27:05.088645 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e960b-2d4e-4770-94d2-a70641f8a204 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:05.089165 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e960b-2d4e-4770-94d2-a70641f8a204 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:05.089165 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e960b-2d4e-4770-94d2-a70641f8a204 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:05.090843 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 525/1019] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:05.096218 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274db9a-c7e5-4adb-beda-0398144c46bb None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:05.096919 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274db9a-c7e5-4adb-beda-0398144c46bb None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:05.096919 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274db9a-c7e5-4adb-beda-0398144c46bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:05.115873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-d274db9a-c7e5-4adb-beda-0398144c46bb None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:05.117113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-d274db9a-c7e5-4adb-beda-0398144c46bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:05.190766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 495/1020] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:27:05.227316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e960b-2d4e-4770-94d2-a70641f8a204 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:05.340877 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e960b-2d4e-4770-94d2-a70641f8a204 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:05.378771 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c49d1a-585b-4e7a-8879-174e5e2bbc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:05.379316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c49d1a-585b-4e7a-8879-174e5e2bbc4f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:05.379600 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c49d1a-585b-4e7a-8879-174e5e2bbc4f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:05.379872 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c49d1a-585b-4e7a-8879-174e5e2bbc4f None admin] PATH_INFO: `/v3/services/image` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:05.380526 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c49d1a-585b-4e7a-8879-174e5e2bbc4f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:05.381843 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c49d1a-585b-4e7a-8879-174e5e2bbc4f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:05.390697 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-76c49d1a-585b-4e7a-8879-174e5e2bbc4f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:27:05.390697 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:05.390697 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:27:05.390697 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:27:05.390697 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:27:05.390697 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:27:05.390697 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:27:05.390697 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:27:05.390697 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:27:05.390697 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:05.390697 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:27:05.390697 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:05.390697 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:05.390697 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:05.390697 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:05.390697 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:05.390697 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:05.391692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:05.391692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:05.391692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:05.391692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:05.391692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:05.391692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:05.391692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:27:05.391692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:27:05.391692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:27:05.391692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:27:05.391692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:05.391692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:05.391692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:05.391692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:05.391692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:05.391692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:05.392624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:05.392624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:05.392624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:05.392624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:05.392624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:05.392624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:05.392624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:05.392624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:05.392624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:05.392624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:05.392624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:27:05.392624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:27:05.392624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:27:05.392624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:05.396628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 526/1021] 10.222.0.69 () {56 vars in 1105 bytes} [Mon Aug 29 21:27:05 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:05.397692 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274db9a-c7e5-4adb-beda-0398144c46bb None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:05.428429 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:05.463392 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c49d1a-585b-4e7a-8879-174e5e2bbc4f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:05.513801 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274db9a-c7e5-4adb-beda-0398144c46bb None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:05.536585 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:05.556569 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f560c3-1aae-4363-a921-fed8f862d399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:05.557373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f560c3-1aae-4363-a921-fed8f862d399 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:05.557652 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f560c3-1aae-4363-a921-fed8f862d399 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:05.557923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f560c3-1aae-4363-a921-fed8f862d399 None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:05.558593 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f560c3-1aae-4363-a921-fed8f862d399 None admin] RBAC: Adding query filter params (name=image) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:05.558852 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f560c3-1aae-4363-a921-fed8f862d399 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:05.560239 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f560c3-1aae-4363-a921-fed8f862d399 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:05.565599 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 496/1022] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:27:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:05.571362 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f560c3-1aae-4363-a921-fed8f862d399 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:05.578510 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c49d1a-585b-4e7a-8879-174e5e2bbc4f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:05.618307 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dcd12-1465-4938-8222-8b4edd1f5b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:05.618948 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dcd12-1465-4938-8222-8b4edd1f5b15 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:05.619227 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dcd12-1465-4938-8222-8b4edd1f5b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:05.619495 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dcd12-1465-4938-8222-8b4edd1f5b15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:05.620682 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6dcd12-1465-4938-8222-8b4edd1f5b15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:05.622792 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6dcd12-1465-4938-8222-8b4edd1f5b15 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:05.624400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 527/1023] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:27:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:05.630075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dcd12-1465-4938-8222-8b4edd1f5b15 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:05.684654 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:05.695205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f560c3-1aae-4363-a921-fed8f862d399 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:05.735010 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a5895-b110-45d1-b592-454c4700f3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:05.736018 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a5895-b110-45d1-b592-454c4700f3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:05.736418 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a5895-b110-45d1-b592-454c4700f3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:05.736787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a5895-b110-45d1-b592-454c4700f3d5 None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:05.737423 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a5895-b110-45d1-b592-454c4700f3d5 None admin] RBAC: Adding query filter params (type=image) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:05.737725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a5895-b110-45d1-b592-454c4700f3d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:05.738422 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dcd12-1465-4938-8222-8b4edd1f5b15 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:05.739080 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a5895-b110-45d1-b592-454c4700f3d5 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:05.749557 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 497/1024] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:27:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:05.750549 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a5895-b110-45d1-b592-454c4700f3d5 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:05.772982 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:05.780474 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19e034-95e6-4f9c-b7a8-1bc5fe64850f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:05.781087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19e034-95e6-4f9c-b7a8-1bc5fe64850f None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:05.781364 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19e034-95e6-4f9c-b7a8-1bc5fe64850f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:05.781635 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19e034-95e6-4f9c-b7a8-1bc5fe64850f None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:05.782280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19e034-95e6-4f9c-b7a8-1bc5fe64850f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:05.783693 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19e034-95e6-4f9c-b7a8-1bc5fe64850f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:05.814407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 528/1025] 10.222.0.69 () {60 vars in 1141 bytes} [Mon Aug 29 21:27:05 2022] POST /identity/v3/projects => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:27:05.862531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a5895-b110-45d1-b592-454c4700f3d5 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:05.901176 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf1195-ab71-47be-82cb-b6d4b5b3854a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:05.902109 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf1195-ab71-47be-82cb-b6d4b5b3854a None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:05.902293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf1195-ab71-47be-82cb-b6d4b5b3854a None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:05.902536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf1195-ab71-47be-82cb-b6d4b5b3854a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:05.903281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf1195-ab71-47be-82cb-b6d4b5b3854a None admin] RBAC: Adding query filter params (interface=public, service_id=1e7698c7d8424a4eb420bc98c99bb9b4, region_id=RegionOne) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:05.903589 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf1195-ab71-47be-82cb-b6d4b5b3854a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:05.905055 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf1195-ab71-47be-82cb-b6d4b5b3854a None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:05.911162 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 498/1026] 10.222.0.69 () {56 vars in 1251 bytes} [Mon Aug 29 21:27:05 2022] GET /identity/v3/endpoints?service_id=1e7698c7d8424a4eb420bc98c99bb9b4&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:05.920224 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19e034-95e6-4f9c-b7a8-1bc5fe64850f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:06.041553 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19e034-95e6-4f9c-b7a8-1bc5fe64850f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:06.083166 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917486c-0f25-416a-99ee-4974f0c94b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:06.085699 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917486c-0f25-416a-99ee-4974f0c94b89 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:06.085699 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917486c-0f25-416a-99ee-4974f0c94b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:06.085699 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917486c-0f25-416a-99ee-4974f0c94b89 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:06.085699 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917486c-0f25-416a-99ee-4974f0c94b89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:06.086312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917486c-0f25-416a-99ee-4974f0c94b89 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:06.094595 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 529/1027] 10.222.0.69 () {56 vars in 1087 bytes} [Mon Aug 29 21:27:05 2022] GET /identity/v3/services => generated 1957 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:27:06.526785 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93fbd4-6871-4fd7-9624-2a408dc5cfd4 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:06.527315 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93fbd4-6871-4fd7-9624-2a408dc5cfd4 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:06.527315 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93fbd4-6871-4fd7-9624-2a408dc5cfd4 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:06.528668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 499/1028] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:06.533770 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882040d-2a40-4123-87d4-40534f27751c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:06.534062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882040d-2a40-4123-87d4-40534f27751c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:06.534340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882040d-2a40-4123-87d4-40534f27751c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:06.553110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-b882040d-2a40-4123-87d4-40534f27751c None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:06.554299 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b882040d-2a40-4123-87d4-40534f27751c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:06.600560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:06.627162 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 530/1029] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:06 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:27:06.896937 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93fbd4-6871-4fd7-9624-2a408dc5cfd4 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:06.921176 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:07.007517 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93fbd4-6871-4fd7-9624-2a408dc5cfd4 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:07.044108 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0368fd-2a5a-416d-b28a-da5ac4d46548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:07.044808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0368fd-2a5a-416d-b28a-da5ac4d46548 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:07.045142 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0368fd-2a5a-416d-b28a-da5ac4d46548 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:07.045426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0368fd-2a5a-416d-b28a-da5ac4d46548 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:07.058024 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0368fd-2a5a-416d-b28a-da5ac4d46548 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:07.063026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-7f0368fd-2a5a-416d-b28a-da5ac4d46548 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:27:07.063026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:07.063026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:07.063026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:07.063026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:07.063026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:07.063026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:07.063026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:07.063026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:07.063026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:07.063026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:07.063026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:07.063026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:07.063026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:07.063026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:07.063026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:07.064088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:07.064088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:07.064088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:07.064088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:07.064088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:07.064088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:07.064088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:07.064088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:07.064088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:07.064088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:07.064088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:07.064088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:07.064088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:07.064088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:07.064088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:07.064088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:07.065281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:07.065281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:07.065281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:07.065281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:07.065281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:07.065281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:07.065281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:07.065281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:07.065281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:07.065281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:07.065281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:27:07.065281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:27:07.072278 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 500/1030] 10.222.0.69 () {56 vars in 1120 bytes} [Mon Aug 29 21:27:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:27:07.072418 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882040d-2a40-4123-87d4-40534f27751c None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:07.181241 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882040d-2a40-4123-87d4-40534f27751c None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:07.220965 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d516e0-ad05-4152-b4ea-b3291c6eff93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:07.221582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d516e0-ad05-4152-b4ea-b3291c6eff93 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:07.221866 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d516e0-ad05-4152-b4ea-b3291c6eff93 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:07.222141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d516e0-ad05-4152-b4ea-b3291c6eff93 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:07.222810 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d516e0-ad05-4152-b4ea-b3291c6eff93 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:07.223116 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d516e0-ad05-4152-b4ea-b3291c6eff93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:07.224519 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d516e0-ad05-4152-b4ea-b3291c6eff93 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:07.233263 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 531/1031] 10.222.0.69 () {56 vars in 1115 bytes} [Mon Aug 29 21:27:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:07.240306 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0368fd-2a5a-416d-b28a-da5ac4d46548 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:07.326661 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:07.347007 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0368fd-2a5a-416d-b28a-da5ac4d46548 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:07.384441 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03288d-7a99-4477-a28b-8f87ad9dad5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:07.385083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03288d-7a99-4477-a28b-8f87ad9dad5d None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:07.385363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03288d-7a99-4477-a28b-8f87ad9dad5d None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:07.385670 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03288d-7a99-4477-a28b-8f87ad9dad5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:07.396389 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03288d-7a99-4477-a28b-8f87ad9dad5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:07.397869 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03288d-7a99-4477-a28b-8f87ad9dad5d None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:07.413185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-bb03288d-7a99-4477-a28b-8f87ad9dad5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:27:07.413185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:07.413185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:07.413185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:07.413185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:07.413185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:07.413185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:07.413185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:07.413185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:07.413185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:07.413185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:07.413185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:07.413185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:27:07.413185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:27:07.413185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:27:07.413185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:27:07.414244 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:07.414244 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:07.414244 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:07.414244 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:07.414244 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:07.414244 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:07.414244 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:07.414244 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:07.414244 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:07.414244 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:07.414244 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:07.414244 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:07.414244 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:07.414244 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:07.414244 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:07.414244 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:07.414244 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:27:07.420962 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:27:07.420962 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:27:07.420962 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:27:07.420962 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 501/1032] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:07.421198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d516e0-ad05-4152-b4ea-b3291c6eff93 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:07.467828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:07.529445 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d516e0-ad05-4152-b4ea-b3291c6eff93 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:07.564251 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696932ca-2992-4f5a-b456-f996931f5f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:07.564879 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696932ca-2992-4f5a-b456-f996931f5f83 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:07.565165 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696932ca-2992-4f5a-b456-f996931f5f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:07.565436 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696932ca-2992-4f5a-b456-f996931f5f83 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:07.566084 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696932ca-2992-4f5a-b456-f996931f5f83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:07.566388 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696932ca-2992-4f5a-b456-f996931f5f83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:07.567762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696932ca-2992-4f5a-b456-f996931f5f83 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:07.580841 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 532/1033] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:07.590316 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03288d-7a99-4477-a28b-8f87ad9dad5d None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:07.695994 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03288d-7a99-4477-a28b-8f87ad9dad5d None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:07.726897 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:07.733075 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb44c9f-d78a-4f20-9019-aeb739091c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:07.733978 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb44c9f-d78a-4f20-9019-aeb739091c74 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:07.734267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb44c9f-d78a-4f20-9019-aeb739091c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:07.734541 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb44c9f-d78a-4f20-9019-aeb739091c74 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:07.742604 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb44c9f-d78a-4f20-9019-aeb739091c74 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:07.744072 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb44c9f-d78a-4f20-9019-aeb739091c74 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:07.756465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-2cb44c9f-d78a-4f20-9019-aeb739091c74 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:27:07.756465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:07.756465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:07.756465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:07.756465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:07.756465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:07.756465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:07.756465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:07.756465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:07.756465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:07.756465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:07.756465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:07.756465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:27:07.756465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:27:07.756465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:27:07.756465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:27:07.757489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:07.757489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:07.757489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:27:07.757489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:27:07.757489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:27:07.757489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:27:07.757489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:07.757489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:07.757489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:07.757489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:07.757489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:07.757489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:07.757489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:07.757489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:07.757489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:07.757489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:07.757489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:07.757489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:07.764749 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:07.764749 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:07.764749 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:27:07.764749 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:27:07.764749 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:27:07.764749 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:27:07.764749 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:27:07.764749 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:27:07.764749 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:27:07.764749 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:27:07.764749 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 502/1034] 10.222.0.69 () {56 vars in 1093 bytes} [Mon Aug 29 21:27:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:07.765445 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696932ca-2992-4f5a-b456-f996931f5f83 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:07.865360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:07.869192 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696932ca-2992-4f5a-b456-f996931f5f83 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:07.900383 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e614b-d045-40f0-a544-45044ea8de76 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:07.900699 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e614b-d045-40f0-a544-45044ea8de76 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:07.900966 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e614b-d045-40f0-a544-45044ea8de76 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:07.902360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 503/1035] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:27:07.907781 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f92bc-e15d-4346-b94b-78716f271402 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:07.908130 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f92bc-e15d-4346-b94b-78716f271402 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:07.908360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f92bc-e15d-4346-b94b-78716f271402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:07.908785 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab625f9e-ebb5-4f07-b048-7f30d2b31662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:07.909409 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab625f9e-ebb5-4f07-b048-7f30d2b31662 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:07.909692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab625f9e-ebb5-4f07-b048-7f30d2b31662 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:07.909967 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab625f9e-ebb5-4f07-b048-7f30d2b31662 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:07.910707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab625f9e-ebb5-4f07-b048-7f30d2b31662 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:07.911026 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab625f9e-ebb5-4f07-b048-7f30d2b31662 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:07.912488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab625f9e-ebb5-4f07-b048-7f30d2b31662 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:07.926865 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-635f92bc-e15d-4346-b94b-78716f271402 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:07.928060 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-635f92bc-e15d-4346-b94b-78716f271402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:07.937388 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 533/1036] 10.222.0.69 () {56 vars in 1133 bytes} [Mon Aug 29 21:27:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:07.938500 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab625f9e-ebb5-4f07-b048-7f30d2b31662 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:08.007683 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 504/1037] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:27:08.056321 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab625f9e-ebb5-4f07-b048-7f30d2b31662 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:08.067882 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4bdc2-bd64-4525-a8df-add7ba460d6c None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:08.068256 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4bdc2-bd64-4525-a8df-add7ba460d6c None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:08.068988 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4bdc2-bd64-4525-a8df-add7ba460d6c None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:08.070441 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 505/1038] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:27:08.075217 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f7006-9678-4ea2-94c6-97ffd57e6e50 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:08.075568 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f7006-9678-4ea2-94c6-97ffd57e6e50 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:08.075900 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f7006-9678-4ea2-94c6-97ffd57e6e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:08.093132 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60536d8-55b1-487e-b2d1-c3df0822e24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:08.093740 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60536d8-55b1-487e-b2d1-c3df0822e24b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:08.094030 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60536d8-55b1-487e-b2d1-c3df0822e24b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:08.094300 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60536d8-55b1-487e-b2d1-c3df0822e24b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:08.095058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-031f7006-9678-4ea2-94c6-97ffd57e6e50 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:08.096259 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-031f7006-9678-4ea2-94c6-97ffd57e6e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:08.125492 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:08.171861 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60536d8-55b1-487e-b2d1-c3df0822e24b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:08.173375 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60536d8-55b1-487e-b2d1-c3df0822e24b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:08.178292 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 506/1039] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:27:08.281103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f7006-9678-4ea2-94c6-97ffd57e6e50 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:08.282756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 534/1040] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:07 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:27:08.289679 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60536d8-55b1-487e-b2d1-c3df0822e24b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:08.340842 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:08.365975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:08.393056 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f7006-9678-4ea2-94c6-97ffd57e6e50 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:08.415471 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60536d8-55b1-487e-b2d1-c3df0822e24b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:08.430993 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec3bcb-0dbe-4639-a8e1-89e5d7752ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:08.431631 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec3bcb-0dbe-4639-a8e1-89e5d7752ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:08.431911 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec3bcb-0dbe-4639-a8e1-89e5d7752ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:08.432275 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec3bcb-0dbe-4639-a8e1-89e5d7752ec9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:08.434036 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec3bcb-0dbe-4639-a8e1-89e5d7752ec9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:08.435469 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec3bcb-0dbe-4639-a8e1-89e5d7752ec9 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:08.437074 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 507/1041] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:27:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:08.442694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec3bcb-0dbe-4639-a8e1-89e5d7752ec9 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:08.462737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cf611-559e-47a8-92d0-b112a634520b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:08.463367 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cf611-559e-47a8-92d0-b112a634520b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:08.463669 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cf611-559e-47a8-92d0-b112a634520b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:08.463939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cf611-559e-47a8-92d0-b112a634520b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:08.474342 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515cf611-559e-47a8-92d0-b112a634520b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:08.475782 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515cf611-559e-47a8-92d0-b112a634520b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:08.490638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-515cf611-559e-47a8-92d0-b112a634520b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:27:08.490638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:08.490638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:08.490638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:08.490638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:08.490638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:08.490638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:08.490638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:08.490638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:08.490638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:08.490638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:08.490638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:08.490638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:27:08.490638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:27:08.490638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:27:08.490638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:27:08.491711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:08.491711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:08.491711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:08.491711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:08.491711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:08.491711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:08.491711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:08.491711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:08.491711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:08.491711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:08.491711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:08.491711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:08.491711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:08.491711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:08.491711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:08.491711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:08.491711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:27:08.492694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:27:08.492694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:27:08.492694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:08.492694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 535/1042] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:27:08.492694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cf611-559e-47a8-92d0-b112a634520b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:08.549723 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec3bcb-0dbe-4639-a8e1-89e5d7752ec9 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:08.570174 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:08.585204 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f2f09-2ee1-43db-b980-241e2c735617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:08.585815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f2f09-2ee1-43db-b980-241e2c735617 None admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:08.586098 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f2f09-2ee1-43db-b980-241e2c735617 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:08.586374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f2f09-2ee1-43db-b980-241e2c735617 None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:08.587025 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f2f09-2ee1-43db-b980-241e2c735617 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:08.588491 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f2f09-2ee1-43db-b980-241e2c735617 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:08.595272 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cf611-559e-47a8-92d0-b112a634520b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:08.606993 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:08.610002 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 508/1043] 10.222.0.69 () {60 vars in 1132 bytes} [Mon Aug 29 21:27:08 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:27:08.610828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f2f09-2ee1-43db-b980-241e2c735617 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:08.642481 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e50000-9930-4e32-922c-0cd8835b8833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:08.643252 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e50000-9930-4e32-922c-0cd8835b8833 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:08.643612 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e50000-9930-4e32-922c-0cd8835b8833 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:08.643900 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e50000-9930-4e32-922c-0cd8835b8833 None admin] PATH_INFO: `/v3/services/image` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:08.644604 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e50000-9930-4e32-922c-0cd8835b8833 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:08.646076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e50000-9930-4e32-922c-0cd8835b8833 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:08.659218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-07e50000-9930-4e32-922c-0cd8835b8833 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:27:08.659218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:08.659218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:27:08.659218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:27:08.659218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:27:08.659218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:27:08.659218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:27:08.659218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:27:08.659218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:27:08.659218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:08.659218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:27:08.659218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:08.659218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:08.659218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:08.659218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:08.659218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:08.659218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:08.660400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:08.660400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:08.660400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:08.660400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:08.660400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:08.660400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:08.660400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:27:08.660400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:27:08.660400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:27:08.660400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:27:08.660400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:08.660400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:08.660400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:08.660400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:08.660400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:08.660400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:08.661511 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:08.661511 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:08.661511 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:08.661511 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:08.661511 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:08.661511 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:08.661511 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:08.661511 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:08.661511 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:08.661511 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:08.661511 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:27:08.661511 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:27:08.661511 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:27:08.661511 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:08.665849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 536/1044] 10.222.0.69 () {56 vars in 1105 bytes} [Mon Aug 29 21:27:08 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:08.666988 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e50000-9930-4e32-922c-0cd8835b8833 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:08.744748 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f2f09-2ee1-43db-b980-241e2c735617 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:08.786931 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e50000-9930-4e32-922c-0cd8835b8833 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:08.787132 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9df21-c10c-49cd-9298-6025a3ece5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:08.787714 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9df21-c10c-49cd-9298-6025a3ece5ee None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:08.787972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9df21-c10c-49cd-9298-6025a3ece5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:08.788313 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9df21-c10c-49cd-9298-6025a3ece5ee None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:08.788967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9df21-c10c-49cd-9298-6025a3ece5ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:08.789269 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9df21-c10c-49cd-9298-6025a3ece5ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:08.790646 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9df21-c10c-49cd-9298-6025a3ece5ee None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:08.804063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 509/1045] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:08.809944 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9df21-c10c-49cd-9298-6025a3ece5ee None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:08.826513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c445e0-232d-44a3-90b4-e041922ded92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:08.827129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c445e0-232d-44a3-90b4-e041922ded92 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:08.827412 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c445e0-232d-44a3-90b4-e041922ded92 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:08.827681 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c445e0-232d-44a3-90b4-e041922ded92 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:08.828745 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c445e0-232d-44a3-90b4-e041922ded92 None admin] RBAC: Adding query filter params (name=image) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:08.828745 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c445e0-232d-44a3-90b4-e041922ded92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:08.830045 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c445e0-232d-44a3-90b4-e041922ded92 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:08.836081 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 537/1046] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:27:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:08.842225 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c445e0-232d-44a3-90b4-e041922ded92 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:08.851451 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:08.887283 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:08.924701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9df21-c10c-49cd-9298-6025a3ece5ee None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:08.959951 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c445e0-232d-44a3-90b4-e041922ded92 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:08.971031 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bc8d0-9d3f-435b-9b9c-9a8d04dc82fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:08.971720 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bc8d0-9d3f-435b-9b9c-9a8d04dc82fa None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:08.972067 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bc8d0-9d3f-435b-9b9c-9a8d04dc82fa None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:08.972434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bc8d0-9d3f-435b-9b9c-9a8d04dc82fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:08.980631 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18bc8d0-9d3f-435b-9b9c-9a8d04dc82fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:08.982140 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18bc8d0-9d3f-435b-9b9c-9a8d04dc82fa None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:08.994005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-b18bc8d0-9d3f-435b-9b9c-9a8d04dc82fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:27:08.994005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:08.994005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:08.994005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:08.994005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:08.994005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:08.994005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:08.994005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:08.994005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:08.994005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:08.994005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:08.994005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:08.994005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:27:08.994005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:27:08.994005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:27:08.995708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:27:08.995708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:08.995708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:08.995708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:08.995708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:08.995708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:08.995708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:08.995708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:08.995708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:08.995708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:08.995708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:08.995708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:08.995708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:08.995708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:08.995708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:08.995708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:08.995708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:08.996995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:27:08.996995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:27:08.996995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:27:08.996995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:27:08.996995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:27:08.996995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:27:08.996995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:27:08.996995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:27:08.996995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 510/1047] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:27:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:27:09.001393 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bc8d0-9d3f-435b-9b9c-9a8d04dc82fa None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:09.001815 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f886c6-db4a-48df-a614-705459fe475d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:09.002438 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f886c6-db4a-48df-a614-705459fe475d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:09.002725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f886c6-db4a-48df-a614-705459fe475d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:09.002998 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f886c6-db4a-48df-a614-705459fe475d None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:09.003954 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f886c6-db4a-48df-a614-705459fe475d None admin] RBAC: Adding query filter params (type=image) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:09.004143 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f886c6-db4a-48df-a614-705459fe475d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:09.006487 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f886c6-db4a-48df-a614-705459fe475d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:09.016335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 538/1048] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:27:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:09.019115 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f886c6-db4a-48df-a614-705459fe475d None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:09.119327 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:09.126687 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bc8d0-9d3f-435b-9b9c-9a8d04dc82fa None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:09.137621 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f886c6-db4a-48df-a614-705459fe475d None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:09.139344 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:09.163880 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e706a7-0b25-46d7-92f0-37b1249f999c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:09.164520 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e706a7-0b25-46d7-92f0-37b1249f999c None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:09.164792 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e706a7-0b25-46d7-92f0-37b1249f999c None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:09.165061 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e706a7-0b25-46d7-92f0-37b1249f999c None admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:09.165744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e706a7-0b25-46d7-92f0-37b1249f999c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:09.166046 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e706a7-0b25-46d7-92f0-37b1249f999c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:09.168639 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e706a7-0b25-46d7-92f0-37b1249f999c None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:09.176359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f65bb-d98d-4425-ba77-ad98fc4aa500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:09.177001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f65bb-d98d-4425-ba77-ad98fc4aa500 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:09.177278 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f65bb-d98d-4425-ba77-ad98fc4aa500 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:09.177549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f65bb-d98d-4425-ba77-ad98fc4aa500 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:09.178225 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f65bb-d98d-4425-ba77-ad98fc4aa500 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:09.179803 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f65bb-d98d-4425-ba77-ad98fc4aa500 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:09.185641 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 511/1049] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:27:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:09.192047 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e706a7-0b25-46d7-92f0-37b1249f999c None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:09.204441 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 539/1050] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:27:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:27:09.313537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e706a7-0b25-46d7-92f0-37b1249f999c None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:09.360718 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cc877-aa5f-4087-a79c-a89bb747e849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:09.361323 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cc877-aa5f-4087-a79c-a89bb747e849 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:09.361601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cc877-aa5f-4087-a79c-a89bb747e849 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:09.361870 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cc877-aa5f-4087-a79c-a89bb747e849 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:09.362628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cc877-aa5f-4087-a79c-a89bb747e849 None admin] RBAC: Adding query filter params (role.id=5a3de60a67584f299df269bc459f952f, scope.project.id=a302406c548c43c983625c0d66da47cc, user.id=96c35c544cae4ad187f1a1be723e0d21) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:09.362902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cc877-aa5f-4087-a79c-a89bb747e849 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:09.364713 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cc877-aa5f-4087-a79c-a89bb747e849 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:09.371233 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 512/1051] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:27:09 2022] GET /identity/v3/role_assignments?user.id=96c35c544cae4ad187f1a1be723e0d21&scope.project.id=a302406c548c43c983625c0d66da47cc&role.id=5a3de60a67584f299df269bc459f952f => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:10.653801 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6974e3-f520-46d0-9a79-79054a422b06 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:10.654341 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6974e3-f520-46d0-9a79-79054a422b06 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:10.654341 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6974e3-f520-46d0-9a79-79054a422b06 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:10.655694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 540/1052] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:10.661137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b94ae5-2616-44c5-9740-a9f29bd78a32 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:10.661554 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b94ae5-2616-44c5-9740-a9f29bd78a32 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:10.661719 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b94ae5-2616-44c5-9740-a9f29bd78a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:10.680694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-10b94ae5-2616-44c5-9740-a9f29bd78a32 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:10.681883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-10b94ae5-2616-44c5-9740-a9f29bd78a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:10.694333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:10.768231 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 513/1053] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:27:11.037203 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6974e3-f520-46d0-9a79-79054a422b06 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:11.146854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6974e3-f520-46d0-9a79-79054a422b06 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:11.165440 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3830ca1-a274-47a5-b111-db61bfb8d36e None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:11.165964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3830ca1-a274-47a5-b111-db61bfb8d36e None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:11.166259 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3830ca1-a274-47a5-b111-db61bfb8d36e None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:11.170571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 514/1054] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:27:11.177868 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2600a5-8e79-4c65-9228-e4489f659a71 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:11.178249 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2600a5-8e79-4c65-9228-e4489f659a71 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:11.178604 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2600a5-8e79-4c65-9228-e4489f659a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:11.189251 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201436f-49d7-46d4-b5da-73330b4f4b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:11.190092 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201436f-49d7-46d4-b5da-73330b4f4b92 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:11.190519 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201436f-49d7-46d4-b5da-73330b4f4b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:11.190961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201436f-49d7-46d4-b5da-73330b4f4b92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:11.198354 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-cc2600a5-8e79-4c65-9228-e4489f659a71 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:11.199555 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-cc2600a5-8e79-4c65-9228-e4489f659a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:11.205481 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201436f-49d7-46d4-b5da-73330b4f4b92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:11.212083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-7201436f-49d7-46d4-b5da-73330b4f4b92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:11.212083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:11.212083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:11.212083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:11.212083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:11.212083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:11.212083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:11.212083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:11.212083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:11.212083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:11.212083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:11.212083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:11.212083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:11.212083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:11.212083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:11.212083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:11.213148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:11.213148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:11.213148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:11.213148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:11.213148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:11.213148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:11.213148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:11.213148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:11.213148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:11.213148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:11.213148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:11.213148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:11.213148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:11.213148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:11.213148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:11.213148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:11.214058 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:11.214058 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:11.214058 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:11.214058 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:11.214058 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:11.214058 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:11.214058 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:11.214058 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:11.214058 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:11.214058 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:11.214058 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:11.214058 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:11.214939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 541/1055] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:27:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:11.219298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201436f-49d7-46d4-b5da-73330b4f4b92 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:11.240453 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:11.279984 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 515/1056] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:27:11.293473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84940e75-f6ff-482e-a5e5-a4d842f5c738 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:11.293756 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84940e75-f6ff-482e-a5e5-a4d842f5c738 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:11.294029 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84940e75-f6ff-482e-a5e5-a4d842f5c738 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:11.295356 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 516/1057] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:27:11.301561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb2ac8-2a31-4eac-9e92-bb2ba8729d09 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:11.301561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb2ac8-2a31-4eac-9e92-bb2ba8729d09 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:11.301874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb2ac8-2a31-4eac-9e92-bb2ba8729d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:11.321131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-60fb2ac8-2a31-4eac-9e92-bb2ba8729d09 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:11.322381 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-60fb2ac8-2a31-4eac-9e92-bb2ba8729d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:11.346075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201436f-49d7-46d4-b5da-73330b4f4b92 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:11.386067 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2290d-5d57-4a97-b927-29c394e4b962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:11.386816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2290d-5d57-4a97-b927-29c394e4b962 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:11.387097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2290d-5d57-4a97-b927-29c394e4b962 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:11.387372 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2290d-5d57-4a97-b927-29c394e4b962 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:11.388031 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2290d-5d57-4a97-b927-29c394e4b962 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:11.388368 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2290d-5d57-4a97-b927-29c394e4b962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:11.389725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2290d-5d57-4a97-b927-29c394e4b962 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:11.392338 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 517/1058] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:27:11.403143 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 542/1059] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:11.408964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb2ac8-2a31-4eac-9e92-bb2ba8729d09 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:11.418647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:11.517699 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb2ac8-2a31-4eac-9e92-bb2ba8729d09 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:11.552483 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2290d-5d57-4a97-b927-29c394e4b962 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:11.553565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d370f2-ebe0-41ba-b81a-f0051bc5fe4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:11.554206 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d370f2-ebe0-41ba-b81a-f0051bc5fe4d None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:11.554539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d370f2-ebe0-41ba-b81a-f0051bc5fe4d None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:11.554751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d370f2-ebe0-41ba-b81a-f0051bc5fe4d None admin] PATH_INFO: `/v3/users/2e3946ab9d044cefb62e5849fd58d50f` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:11.574428 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d370f2-ebe0-41ba-b81a-f0051bc5fe4d None admin] RBAC: Authorizing `identity:get_user(user_id=2e3946ab9d044cefb62e5849fd58d50f)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:11.575890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d370f2-ebe0-41ba-b81a-f0051bc5fe4d None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:11.577607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 518/1060] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:11 2022] GET /identity/v3/users/2e3946ab9d044cefb62e5849fd58d50f => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:11.583287 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d370f2-ebe0-41ba-b81a-f0051bc5fe4d None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:11.644615 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:11.653028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:11.670250 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2290d-5d57-4a97-b927-29c394e4b962 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:11.694873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d370f2-ebe0-41ba-b81a-f0051bc5fe4d None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:11.707743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758e16d-29ab-4be8-8a35-419be8db0e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:11.708380 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758e16d-29ab-4be8-8a35-419be8db0e6a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:11.708664 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758e16d-29ab-4be8-8a35-419be8db0e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:11.708944 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758e16d-29ab-4be8-8a35-419be8db0e6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:11.729986 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05712b-9530-4a67-9225-cc548f1ccdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:11.730959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05712b-9530-4a67-9225-cc548f1ccdbd None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:11.731442 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05712b-9530-4a67-9225-cc548f1ccdbd None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:11.731925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05712b-9530-4a67-9225-cc548f1ccdbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:11.781718 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758e16d-29ab-4be8-8a35-419be8db0e6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:11.783170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758e16d-29ab-4be8-8a35-419be8db0e6a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:11.802762 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05712b-9530-4a67-9225-cc548f1ccdbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:11.804135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05712b-9530-4a67-9225-cc548f1ccdbd None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:11.864944 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:11.867142 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:11.888619 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 543/1061] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 21:27:11.889468 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758e16d-29ab-4be8-8a35-419be8db0e6a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:11.906652 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 519/1062] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 21:27:11.909218 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05712b-9530-4a67-9225-cc548f1ccdbd None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:11.993310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758e16d-29ab-4be8-8a35-419be8db0e6a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:12.012811 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05712b-9530-4a67-9225-cc548f1ccdbd None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:12.038412 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6df5c-14ec-40c4-9128-b9acfaa89271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:12.039040 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6df5c-14ec-40c4-9128-b9acfaa89271 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:12.039324 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6df5c-14ec-40c4-9128-b9acfaa89271 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:12.039600 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6df5c-14ec-40c4-9128-b9acfaa89271 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:12.050686 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82cc57-39a5-4875-8a2b-9c09982f441e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:12.050993 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6df5c-14ec-40c4-9128-b9acfaa89271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:12.051331 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82cc57-39a5-4875-8a2b-9c09982f441e None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:12.051617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82cc57-39a5-4875-8a2b-9c09982f441e None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:12.051954 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82cc57-39a5-4875-8a2b-9c09982f441e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:12.055859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-6ba6df5c-14ec-40c4-9128-b9acfaa89271 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:27:12.055859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:12.055859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:12.055859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:12.055859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:12.055859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:12.055859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:12.055859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:12.055859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:12.055859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:12.055859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:12.055859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:12.055859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:12.055859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:12.055859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:12.055859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:12.057229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:12.057229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:12.057229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:12.057229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:12.057229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:12.057229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:12.057229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:12.057229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:12.057229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:12.057229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:12.057229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:12.057229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:12.057229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:12.057229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:12.057229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:12.057229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:12.058731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:12.058731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:12.058731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:12.058731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:12.058731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:12.058731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:12.058731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:12.058731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:12.058731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:12.058731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:12.058731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:27:12.058731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:12.058731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 544/1063] 10.222.0.69 () {56 vars in 1120 bytes} [Mon Aug 29 21:27:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:12.058731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6df5c-14ec-40c4-9128-b9acfaa89271 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:12.065043 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82cc57-39a5-4875-8a2b-9c09982f441e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:12.066496 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82cc57-39a5-4875-8a2b-9c09982f441e None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:12.082277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-ac82cc57-39a5-4875-8a2b-9c09982f441e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:27:12.082277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:12.082277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:12.082277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:12.082277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:12.082277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:12.082277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:12.082277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:12.082277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:12.082277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:12.082277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:12.082277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:12.082277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:27:12.082277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:27:12.082277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:27:12.082277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:27:12.083311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:12.083311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:12.083311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:12.083311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:12.083311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:12.083311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:12.083311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:12.083311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:12.083311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:12.083311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:12.083311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:12.083311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:12.083311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:12.083311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:12.083311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:12.083311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:12.083311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:27:12.084337 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:27:12.084337 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:27:12.084337 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:27:12.084337 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 520/1064] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:12.084337 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82cc57-39a5-4875-8a2b-9c09982f441e None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:12.102170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:12.109996 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:12.171536 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6df5c-14ec-40c4-9128-b9acfaa89271 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:12.197178 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82cc57-39a5-4875-8a2b-9c09982f441e None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:12.206101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8aed2f-94b8-4ace-b745-c994e8eb1046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:12.206739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8aed2f-94b8-4ace-b745-c994e8eb1046 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:12.207030 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8aed2f-94b8-4ace-b745-c994e8eb1046 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:12.207306 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8aed2f-94b8-4ace-b745-c994e8eb1046 None admin] PATH_INFO: `/v3/projects/c277d1ab3feb4a08b0deed15c6627f6c` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:12.208472 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8aed2f-94b8-4ace-b745-c994e8eb1046 None admin] RBAC: Authorizing `identity:get_project(project_id=c277d1ab3feb4a08b0deed15c6627f6c)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:12.209906 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8aed2f-94b8-4ace-b745-c994e8eb1046 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:12.211546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 545/1065] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:12 2022] GET /identity/v3/projects/c277d1ab3feb4a08b0deed15c6627f6c => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:12.212331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8aed2f-94b8-4ace-b745-c994e8eb1046 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:12.234779 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f8a78-bb59-4840-94c3-cfce14e42a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:12.235388 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f8a78-bb59-4840-94c3-cfce14e42a57 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:12.235667 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f8a78-bb59-4840-94c3-cfce14e42a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:12.235942 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f8a78-bb59-4840-94c3-cfce14e42a57 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:12.236631 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f8a78-bb59-4840-94c3-cfce14e42a57 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:12.236935 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f8a78-bb59-4840-94c3-cfce14e42a57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:12.238297 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f8a78-bb59-4840-94c3-cfce14e42a57 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:12.248015 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 521/1066] 10.222.0.69 () {56 vars in 1115 bytes} [Mon Aug 29 21:27:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:12.248978 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f8a78-bb59-4840-94c3-cfce14e42a57 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:12.315844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8aed2f-94b8-4ace-b745-c994e8eb1046 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:12.326195 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:12.329525 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:12.358520 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625fbc6-3688-4f01-a347-9958e8300e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:12.359398 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625fbc6-3688-4f01-a347-9958e8300e9a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:12.359691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625fbc6-3688-4f01-a347-9958e8300e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:12.359960 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625fbc6-3688-4f01-a347-9958e8300e9a None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:12.360643 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8625fbc6-3688-4f01-a347-9958e8300e9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:12.360950 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8625fbc6-3688-4f01-a347-9958e8300e9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:12.362315 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8625fbc6-3688-4f01-a347-9958e8300e9a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:12.364991 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f8a78-bb59-4840-94c3-cfce14e42a57 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:12.375303 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 546/1067] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:12.377120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625fbc6-3688-4f01-a347-9958e8300e9a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:12.418656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57e9cd-8fcc-46e6-8d98-b718cd243226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:12.419274 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57e9cd-8fcc-46e6-8d98-b718cd243226 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:12.419551 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57e9cd-8fcc-46e6-8d98-b718cd243226 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:12.419819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57e9cd-8fcc-46e6-8d98-b718cd243226 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:12.420596 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57e9cd-8fcc-46e6-8d98-b718cd243226 None admin] RBAC: Adding query filter params (role.id=69369872661e4179bb51cd1ca76e28c3, scope.project.id=c277d1ab3feb4a08b0deed15c6627f6c, user.id=2e3946ab9d044cefb62e5849fd58d50f) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:12.420916 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57e9cd-8fcc-46e6-8d98-b718cd243226 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:12.422380 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57e9cd-8fcc-46e6-8d98-b718cd243226 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:12.429350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 522/1068] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:27:12 2022] GET /identity/v3/role_assignments?user.id=2e3946ab9d044cefb62e5849fd58d50f&scope.project.id=c277d1ab3feb4a08b0deed15c6627f6c&role.id=69369872661e4179bb51cd1ca76e28c3 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:12.501298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625fbc6-3688-4f01-a347-9958e8300e9a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:12.543093 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda11a31-7307-4240-ae45-ef5a82c6153a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:12.543752 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda11a31-7307-4240-ae45-ef5a82c6153a None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:12.544035 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda11a31-7307-4240-ae45-ef5a82c6153a None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:12.544346 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda11a31-7307-4240-ae45-ef5a82c6153a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:12.558260 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda11a31-7307-4240-ae45-ef5a82c6153a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:12.560063 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda11a31-7307-4240-ae45-ef5a82c6153a None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:12.577256 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-dda11a31-7307-4240-ae45-ef5a82c6153a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:27:12.577256 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:12.577256 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:12.577256 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:12.577256 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:12.577256 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:12.577256 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:12.577256 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:12.577256 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:12.577256 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:12.577256 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:12.577256 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:12.577256 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:27:12.577256 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:27:12.577256 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:27:12.577256 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:27:12.578360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:12.578360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:12.578360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:12.578360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:12.578360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:12.578360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:12.578360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:12.578360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:12.578360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:12.578360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:12.578360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:12.578360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:12.578360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:12.578360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:12.578360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:12.578360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:12.578360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:27:12.579370 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:27:12.579370 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:27:12.579370 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:12.579370 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 547/1069] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:12.585184 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57e9cd-8fcc-46e6-8d98-b718cd243226 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:12.703513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57e9cd-8fcc-46e6-8d98-b718cd243226 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:12.738461 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eacbb8-d100-418b-8467-1b79ca9a09c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:12.739077 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eacbb8-d100-418b-8467-1b79ca9a09c7 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:12.739360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eacbb8-d100-418b-8467-1b79ca9a09c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:12.739635 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eacbb8-d100-418b-8467-1b79ca9a09c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:12.740314 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eacbb8-d100-418b-8467-1b79ca9a09c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:12.740623 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eacbb8-d100-418b-8467-1b79ca9a09c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:12.741999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eacbb8-d100-418b-8467-1b79ca9a09c7 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:12.757352 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 523/1070] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:12.763598 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda11a31-7307-4240-ae45-ef5a82c6153a None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:12.789904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:12.870115 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda11a31-7307-4240-ae45-ef5a82c6153a None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:12.906773 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a8df6-1a45-4ae1-95f8-84b6cb61aa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:12.907405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a8df6-1a45-4ae1-95f8-84b6cb61aa9d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:12.907691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a8df6-1a45-4ae1-95f8-84b6cb61aa9d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:12.907968 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a8df6-1a45-4ae1-95f8-84b6cb61aa9d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:12.915731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a8df6-1a45-4ae1-95f8-84b6cb61aa9d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:12.917232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a8df6-1a45-4ae1-95f8-84b6cb61aa9d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:12.928582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-a55a8df6-1a45-4ae1-95f8-84b6cb61aa9d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:27:12.928582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:12.928582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:12.928582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:12.928582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:12.928582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:12.928582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:12.928582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:12.928582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:12.928582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:12.928582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:12.928582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:12.928582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:27:12.928582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:27:12.928582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:27:12.928582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:27:12.929876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:12.929876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:12.929876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:27:12.929876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:27:12.929876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:27:12.929876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:27:12.929876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:12.929876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:12.929876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:12.929876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:12.929876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:12.929876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:12.929876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:12.929876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:12.929876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:12.929876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:12.929876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:12.929876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:12.930971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:12.930971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:12.930971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:27:12.930971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:27:12.930971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:27:12.930971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:27:12.930971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:27:12.930971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:27:12.930971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:27:12.930971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:12.930971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 548/1071] 10.222.0.69 () {56 vars in 1093 bytes} [Mon Aug 29 21:27:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:12.936592 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eacbb8-d100-418b-8467-1b79ca9a09c7 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:12.939529 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:13.044328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eacbb8-d100-418b-8467-1b79ca9a09c7 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:13.080249 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de484f65-ea82-4b02-be07-5ab47034279c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:13.080858 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de484f65-ea82-4b02-be07-5ab47034279c None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:13.081133 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de484f65-ea82-4b02-be07-5ab47034279c None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:13.081404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de484f65-ea82-4b02-be07-5ab47034279c None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:13.082135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de484f65-ea82-4b02-be07-5ab47034279c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:13.082436 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de484f65-ea82-4b02-be07-5ab47034279c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:13.083850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de484f65-ea82-4b02-be07-5ab47034279c None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:13.101192 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 524/1072] 10.222.0.69 () {56 vars in 1133 bytes} [Mon Aug 29 21:27:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:13.106773 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a8df6-1a45-4ae1-95f8-84b6cb61aa9d None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:13.188307 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:13.211707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a8df6-1a45-4ae1-95f8-84b6cb61aa9d None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:13.244500 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b963e6-c2ca-4a03-aaf7-8f2f8f856eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:13.245648 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b963e6-c2ca-4a03-aaf7-8f2f8f856eae None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:13.245899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b963e6-c2ca-4a03-aaf7-8f2f8f856eae None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:13.246242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b963e6-c2ca-4a03-aaf7-8f2f8f856eae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:13.257143 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b963e6-c2ca-4a03-aaf7-8f2f8f856eae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:13.258585 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b963e6-c2ca-4a03-aaf7-8f2f8f856eae None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:13.273109 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-71b963e6-c2ca-4a03-aaf7-8f2f8f856eae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:27:13.273109 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:13.273109 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:13.273109 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:13.273109 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:13.273109 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:13.273109 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:13.273109 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:13.273109 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:13.273109 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:13.273109 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:13.273109 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:13.273109 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:27:13.273109 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:27:13.273109 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:27:13.273109 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:27:13.274122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:13.274122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:13.274122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:13.274122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:13.274122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:13.274122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:13.274122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:13.274122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:13.274122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:13.274122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:13.274122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:13.274122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:13.274122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:13.274122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:13.274122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:13.274122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:13.274122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:27:13.275063 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:27:13.275063 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:27:13.275063 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:13.275063 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 549/1073] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:13.280146 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de484f65-ea82-4b02-be07-5ab47034279c None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:13.340693 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:13.391050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de484f65-ea82-4b02-be07-5ab47034279c None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:13.429699 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd032da-81c7-4b45-a53d-ffe08d06d968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:13.430316 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd032da-81c7-4b45-a53d-ffe08d06d968 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:13.430599 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd032da-81c7-4b45-a53d-ffe08d06d968 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:13.430873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd032da-81c7-4b45-a53d-ffe08d06d968 None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:13.431515 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd032da-81c7-4b45-a53d-ffe08d06d968 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:13.431824 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd032da-81c7-4b45-a53d-ffe08d06d968 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:13.433920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd032da-81c7-4b45-a53d-ffe08d06d968 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:13.445900 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 525/1074] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:13.451435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b963e6-c2ca-4a03-aaf7-8f2f8f856eae None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:13.553607 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b963e6-c2ca-4a03-aaf7-8f2f8f856eae None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:13.581986 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:13.588304 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0977f5a-aa3b-4dbe-a8ef-6fed70ff1e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:13.588968 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0977f5a-aa3b-4dbe-a8ef-6fed70ff1e56 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:13.589243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0977f5a-aa3b-4dbe-a8ef-6fed70ff1e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:13.589517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0977f5a-aa3b-4dbe-a8ef-6fed70ff1e56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:13.596371 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0977f5a-aa3b-4dbe-a8ef-6fed70ff1e56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:13.597795 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0977f5a-aa3b-4dbe-a8ef-6fed70ff1e56 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:13.610021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-a0977f5a-aa3b-4dbe-a8ef-6fed70ff1e56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:27:13.610021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:13.610021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:13.610021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:13.610021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:13.610021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:13.610021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:13.610021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:13.610021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:13.610021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:13.610021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:13.610021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:13.610021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:27:13.610021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:27:13.610021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:27:13.611120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:27:13.611120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:13.611120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:13.611120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:13.611120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:13.611120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:13.611120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:13.611120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:13.611120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:13.611120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:13.611120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:13.611120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:13.611120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:13.611120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:13.611120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:13.611120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:13.611120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:13.612033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:27:13.612033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:27:13.612033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:27:13.612033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:27:13.612033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:27:13.612033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:27:13.612033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:27:13.612033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:13.612033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 550/1075] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:27:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:27:13.616892 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd032da-81c7-4b45-a53d-ffe08d06d968 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:13.717908 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd032da-81c7-4b45-a53d-ffe08d06d968 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:13.738272 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:13.754097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e9a2f-a208-4698-bde6-444be0b398cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:13.755135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e9a2f-a208-4698-bde6-444be0b398cd None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:13.755639 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e9a2f-a208-4698-bde6-444be0b398cd None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:13.756126 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e9a2f-a208-4698-bde6-444be0b398cd None admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:13.757447 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e9a2f-a208-4698-bde6-444be0b398cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:13.757984 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e9a2f-a208-4698-bde6-444be0b398cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:13.760736 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e9a2f-a208-4698-bde6-444be0b398cd None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:13.778069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 526/1076] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:27:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:13.783830 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0977f5a-aa3b-4dbe-a8ef-6fed70ff1e56 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:13.885277 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0977f5a-aa3b-4dbe-a8ef-6fed70ff1e56 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:13.924629 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a4d38-c34e-4018-b7de-21cf6eed87b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:13.925291 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a4d38-c34e-4018-b7de-21cf6eed87b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:13.925570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a4d38-c34e-4018-b7de-21cf6eed87b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:13.925841 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a4d38-c34e-4018-b7de-21cf6eed87b3 None admin] PATH_INFO: `/v3/projects/a302406c548c43c983625c0d66da47cc/users/96c35c544cae4ad187f1a1be723e0d21/roles/5a3de60a67584f299df269bc459f952f` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:13.927944 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a4d38-c34e-4018-b7de-21cf6eed87b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a302406c548c43c983625c0d66da47cc, user_id=96c35c544cae4ad187f1a1be723e0d21, role_id=5a3de60a67584f299df269bc459f952f)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:13.929547 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a4d38-c34e-4018-b7de-21cf6eed87b3 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:13.942706 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 551/1077] 10.222.0.69 () {58 vars in 1439 bytes} [Mon Aug 29 21:27:13 2022] PUT /identity/v3/projects/a302406c548c43c983625c0d66da47cc/users/96c35c544cae4ad187f1a1be723e0d21/roles/5a3de60a67584f299df269bc459f952f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:27:14.374563 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c4034-a387-4ede-8678-4e3e2c2df968 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:14.374959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c4034-a387-4ede-8678-4e3e2c2df968 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:14.375266 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c4034-a387-4ede-8678-4e3e2c2df968 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:14.376677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 527/1078] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:14.382245 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3ae8d-225c-4ce6-94bd-ef8a721e8e2f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:14.382536 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3ae8d-225c-4ce6-94bd-ef8a721e8e2f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:14.382816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3ae8d-225c-4ce6-94bd-ef8a721e8e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:14.401113 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-48a3ae8d-225c-4ce6-94bd-ef8a721e8e2f None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:14.402999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-48a3ae8d-225c-4ce6-94bd-ef8a721e8e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:14.454985 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:14.482704 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 552/1079] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:27:14.749089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c4034-a387-4ede-8678-4e3e2c2df968 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:14.858027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c4034-a387-4ede-8678-4e3e2c2df968 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:14.892271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ea091-4f4f-4c34-914a-486ce11ace45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:14.892903 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ea091-4f4f-4c34-914a-486ce11ace45 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:14.893181 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ea091-4f4f-4c34-914a-486ce11ace45 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:14.893464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ea091-4f4f-4c34-914a-486ce11ace45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:14.904373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ea091-4f4f-4c34-914a-486ce11ace45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:14.909135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-106ea091-4f4f-4c34-914a-486ce11ace45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:14.909135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:14.909135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:14.909135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:14.909135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:14.909135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:14.909135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:14.909135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:14.909135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:14.909135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:14.909135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:14.909135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:14.909135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:14.909135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:14.909135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:14.909135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:14.910321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:14.910321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:14.910321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:14.910321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:14.910321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:14.910321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:14.910321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:14.910321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:14.910321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:14.910321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:14.910321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:14.910321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:14.910321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:14.910321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:14.910321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:14.910321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:14.911235 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:14.911235 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:14.911235 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:14.911235 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:14.911235 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:14.911235 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:14.911235 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:14.911235 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:14.911235 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:14.911235 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:14.911235 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:14.911235 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:27:14.911235 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 528/1080] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:27:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:14.916194 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3ae8d-225c-4ce6-94bd-ef8a721e8e2f None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:15.019221 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3ae8d-225c-4ce6-94bd-ef8a721e8e2f None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:15.052934 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fecd9-9601-4431-8f88-946ad300ef08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:15.053537 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fecd9-9601-4431-8f88-946ad300ef08 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:15.053816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fecd9-9601-4431-8f88-946ad300ef08 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:15.054088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fecd9-9601-4431-8f88-946ad300ef08 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:15.054752 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fecd9-9601-4431-8f88-946ad300ef08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:15.055057 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fecd9-9601-4431-8f88-946ad300ef08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:15.056448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fecd9-9601-4431-8f88-946ad300ef08 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:15.065039 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 553/1081] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:15.071274 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ea091-4f4f-4c34-914a-486ce11ace45 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:15.117789 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:15.177469 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ea091-4f4f-4c34-914a-486ce11ace45 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:15.213651 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22c361-9449-441c-b284-7d710e58e323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:15.214290 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22c361-9449-441c-b284-7d710e58e323 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:15.214577 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22c361-9449-441c-b284-7d710e58e323 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:15.214856 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22c361-9449-441c-b284-7d710e58e323 None admin] PATH_INFO: `/v3/users/2e3946ab9d044cefb62e5849fd58d50f` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:15.215990 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22c361-9449-441c-b284-7d710e58e323 None admin] RBAC: Authorizing `identity:get_user(user_id=2e3946ab9d044cefb62e5849fd58d50f)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:15.217477 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22c361-9449-441c-b284-7d710e58e323 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:15.219077 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 529/1082] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:15 2022] GET /identity/v3/users/2e3946ab9d044cefb62e5849fd58d50f => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:15.224856 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fecd9-9601-4431-8f88-946ad300ef08 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:15.271781 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:15.326725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fecd9-9601-4431-8f88-946ad300ef08 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:15.359933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a50e47-80c6-49ae-8f31-0803186169c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:15.360605 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a50e47-80c6-49ae-8f31-0803186169c3 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:15.360890 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a50e47-80c6-49ae-8f31-0803186169c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:15.361166 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a50e47-80c6-49ae-8f31-0803186169c3 None admin] PATH_INFO: `/v3/projects/c277d1ab3feb4a08b0deed15c6627f6c` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:15.362288 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a50e47-80c6-49ae-8f31-0803186169c3 None admin] RBAC: Authorizing `identity:get_project(project_id=c277d1ab3feb4a08b0deed15c6627f6c)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:15.363754 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a50e47-80c6-49ae-8f31-0803186169c3 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:15.365742 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 554/1083] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:15 2022] GET /identity/v3/projects/c277d1ab3feb4a08b0deed15c6627f6c => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:15.372245 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22c361-9449-441c-b284-7d710e58e323 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:15.481640 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22c361-9449-441c-b284-7d710e58e323 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:15.491674 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:15.519405 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e40f9-a56e-4ad0-92b8-d9e2fcdc2f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:15.520107 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e40f9-a56e-4ad0-92b8-d9e2fcdc2f30 None admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:15.520376 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e40f9-a56e-4ad0-92b8-d9e2fcdc2f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:15.520650 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e40f9-a56e-4ad0-92b8-d9e2fcdc2f30 None admin] PATH_INFO: `/v3/projects/c277d1ab3feb4a08b0deed15c6627f6c/users/2e3946ab9d044cefb62e5849fd58d50f/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:15.522618 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e40f9-a56e-4ad0-92b8-d9e2fcdc2f30 None admin] RBAC: Authorizing `identity:create_grant(project_id=c277d1ab3feb4a08b0deed15c6627f6c, user_id=2e3946ab9d044cefb62e5849fd58d50f, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:15.523991 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e40f9-a56e-4ad0-92b8-d9e2fcdc2f30 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:15.537361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 530/1084] 10.222.0.69 () {58 vars in 1439 bytes} [Mon Aug 29 21:27:15 2022] PUT /identity/v3/projects/c277d1ab3feb4a08b0deed15c6627f6c/users/2e3946ab9d044cefb62e5849fd58d50f/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:27:15.832505 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ebe9b-b093-46f1-a19b-e557c8cdfdfb None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:15.832710 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ebe9b-b093-46f1-a19b-e557c8cdfdfb None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:15.832988 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ebe9b-b093-46f1-a19b-e557c8cdfdfb None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:15.834336 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 555/1085] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:15.839672 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bc312-89e5-474a-a3f3-b4bfb7883a73 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:15.840142 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bc312-89e5-474a-a3f3-b4bfb7883a73 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:15.840340 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bc312-89e5-474a-a3f3-b4bfb7883a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:15.859854 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-d25bc312-89e5-474a-a3f3-b4bfb7883a73 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:15.861056 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-d25bc312-89e5-474a-a3f3-b4bfb7883a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:15.930163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 531/1086] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:27:16.196542 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ebe9b-b093-46f1-a19b-e557c8cdfdfb None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:16.299918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ebe9b-b093-46f1-a19b-e557c8cdfdfb None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:16.312557 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:16.334690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f21aa-77af-457a-8e8a-3a8b05d65581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:16.335311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f21aa-77af-457a-8e8a-3a8b05d65581 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:16.335587 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f21aa-77af-457a-8e8a-3a8b05d65581 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:16.335852 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f21aa-77af-457a-8e8a-3a8b05d65581 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:16.346792 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f21aa-77af-457a-8e8a-3a8b05d65581 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:16.351517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-942f21aa-77af-457a-8e8a-3a8b05d65581 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:27:16.351517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:16.351517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:16.351517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:16.351517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:16.351517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:16.351517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:16.351517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:16.351517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:16.351517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:16.351517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:16.351517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:16.351517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:16.351517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:16.351517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:16.351517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:16.352574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:16.352574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:16.352574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:16.352574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:16.352574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:16.352574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:16.352574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:16.352574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:16.352574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:16.352574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:16.352574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:16.352574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:16.352574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:16.352574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:16.352574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:16.352574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:16.353446 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:16.353446 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:16.353446 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:16.353446 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:16.353446 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:16.353446 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:16.353446 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:16.353446 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:16.353446 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:16.353446 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:16.353446 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:27:16.353446 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:16.353446 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 556/1087] 10.222.0.69 () {56 vars in 1120 bytes} [Mon Aug 29 21:27:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:16.358579 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bc312-89e5-474a-a3f3-b4bfb7883a73 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:16.457856 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:16.462726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bc312-89e5-474a-a3f3-b4bfb7883a73 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:16.499856 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68395069-3576-46b2-93c4-7ac137d77480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:16.500496 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68395069-3576-46b2-93c4-7ac137d77480 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:16.500798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68395069-3576-46b2-93c4-7ac137d77480 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:16.501054 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68395069-3576-46b2-93c4-7ac137d77480 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:16.501720 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68395069-3576-46b2-93c4-7ac137d77480 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:16.502026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68395069-3576-46b2-93c4-7ac137d77480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:16.503389 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68395069-3576-46b2-93c4-7ac137d77480 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:16.512109 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 532/1088] 10.222.0.69 () {56 vars in 1115 bytes} [Mon Aug 29 21:27:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:16.517903 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f21aa-77af-457a-8e8a-3a8b05d65581 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:16.627830 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f21aa-77af-457a-8e8a-3a8b05d65581 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:16.661981 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10f5e1-a6a7-494a-a4ad-8440ca710db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:16.662611 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10f5e1-a6a7-494a-a4ad-8440ca710db3 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:16.662887 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10f5e1-a6a7-494a-a4ad-8440ca710db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:16.663165 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10f5e1-a6a7-494a-a4ad-8440ca710db3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:16.674006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10f5e1-a6a7-494a-a4ad-8440ca710db3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:16.675446 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10f5e1-a6a7-494a-a4ad-8440ca710db3 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:16.689958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-9b10f5e1-a6a7-494a-a4ad-8440ca710db3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:27:16.689958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:16.689958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:16.689958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:16.689958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:16.689958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:16.689958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:16.689958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:16.689958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:16.689958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:16.689958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:16.689958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:16.689958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:27:16.689958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:27:16.689958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:27:16.689958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:27:16.696006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:16.696006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:16.696006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:16.696006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:16.696006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:16.696006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:16.696006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:16.696006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:16.696006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:16.696006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:16.696006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:16.696006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:16.696006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:16.696006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:16.696006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:16.696006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:16.696006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:27:16.697197 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:27:16.697197 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:27:16.697197 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:16.697197 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 557/1089] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:27:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:16.698034 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68395069-3576-46b2-93c4-7ac137d77480 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:16.797835 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68395069-3576-46b2-93c4-7ac137d77480 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:16.833762 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c62eb4-4eb2-4c31-9b3f-d3a8605214ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:16.834365 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c62eb4-4eb2-4c31-9b3f-d3a8605214ab None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:16.834639 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c62eb4-4eb2-4c31-9b3f-d3a8605214ab None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:16.834906 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c62eb4-4eb2-4c31-9b3f-d3a8605214ab None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:16.835626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c62eb4-4eb2-4c31-9b3f-d3a8605214ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:16.836339 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c62eb4-4eb2-4c31-9b3f-d3a8605214ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:16.837227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c62eb4-4eb2-4c31-9b3f-d3a8605214ab None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:16.848788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 533/1090] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:16.854430 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10f5e1-a6a7-494a-a4ad-8440ca710db3 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:16.881480 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:16.955999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10f5e1-a6a7-494a-a4ad-8440ca710db3 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:16.990072 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbf5ce-7833-47f7-8379-a04cbd93116c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:16.990688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbf5ce-7833-47f7-8379-a04cbd93116c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:16.990963 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbf5ce-7833-47f7-8379-a04cbd93116c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:16.991230 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbf5ce-7833-47f7-8379-a04cbd93116c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:16.999394 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bbf5ce-7833-47f7-8379-a04cbd93116c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:17.000888 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bbf5ce-7833-47f7-8379-a04cbd93116c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:17.012584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-21bbf5ce-7833-47f7-8379-a04cbd93116c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:27:17.012584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:17.012584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:17.012584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:17.012584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:17.012584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:17.012584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:17.012584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:17.012584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:17.012584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:17.012584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:17.012584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:17.012584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:27:17.012584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:27:17.012584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:27:17.012584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:27:17.013747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:17.013747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:17.013747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:27:17.013747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:27:17.013747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:27:17.013747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:27:17.013747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:17.013747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:17.013747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:17.013747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:17.013747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:17.013747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:17.013747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:17.013747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:17.013747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:17.013747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:17.013747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:17.013747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:17.015181 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:17.015181 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:17.015181 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:27:17.015181 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:27:17.015181 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:27:17.015181 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:27:17.015181 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:27:17.015181 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:27:17.015181 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:27:17.015181 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:17.015181 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 558/1091] 10.222.0.69 () {56 vars in 1093 bytes} [Mon Aug 29 21:27:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:27:17.019645 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c62eb4-4eb2-4c31-9b3f-d3a8605214ab None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:17.041766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:17.126650 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c62eb4-4eb2-4c31-9b3f-d3a8605214ab None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:17.160272 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53b856-9260-4f12-9787-b75ad2965363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:17.160879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53b856-9260-4f12-9787-b75ad2965363 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:17.161155 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53b856-9260-4f12-9787-b75ad2965363 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:17.161425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53b856-9260-4f12-9787-b75ad2965363 None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:17.162175 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53b856-9260-4f12-9787-b75ad2965363 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:17.162641 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53b856-9260-4f12-9787-b75ad2965363 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:17.164061 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53b856-9260-4f12-9787-b75ad2965363 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:17.181922 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 534/1092] 10.222.0.69 () {56 vars in 1133 bytes} [Mon Aug 29 21:27:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:17.188409 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbf5ce-7833-47f7-8379-a04cbd93116c None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:17.272538 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:17.288356 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbf5ce-7833-47f7-8379-a04cbd93116c None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:17.322614 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5960f-b0cc-4477-b4db-84146227f6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:17.323249 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5960f-b0cc-4477-b4db-84146227f6da None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:17.323536 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5960f-b0cc-4477-b4db-84146227f6da None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:17.323810 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5960f-b0cc-4477-b4db-84146227f6da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:17.392673 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5960f-b0cc-4477-b4db-84146227f6da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:17.394124 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5960f-b0cc-4477-b4db-84146227f6da None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:17.467631 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458d7ee-1a60-4d47-bb3d-acd3fdeea7db None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:17.468046 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458d7ee-1a60-4d47-bb3d-acd3fdeea7db None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:17.468435 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458d7ee-1a60-4d47-bb3d-acd3fdeea7db None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:17.469850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 535/1093] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:27:17.474841 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf0673-4b73-4ffd-aa32-b9638e148141 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:17.475269 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf0673-4b73-4ffd-aa32-b9638e148141 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:17.475553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf0673-4b73-4ffd-aa32-b9638e148141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:17.481220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:17.494928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-ccdf0673-4b73-4ffd-aa32-b9638e148141 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:17.496208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-ccdf0673-4b73-4ffd-aa32-b9638e148141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:17.498459 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 559/1094] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:27:17.504286 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5960f-b0cc-4477-b4db-84146227f6da None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:17.569649 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 536/1095] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:27:17.603671 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5960f-b0cc-4477-b4db-84146227f6da None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:17.641190 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185662c3-5b50-4dd5-98e0-ff142a6d90cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:17.641818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185662c3-5b50-4dd5-98e0-ff142a6d90cc None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:17.642097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185662c3-5b50-4dd5-98e0-ff142a6d90cc None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:17.642370 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185662c3-5b50-4dd5-98e0-ff142a6d90cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:17.653015 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185662c3-5b50-4dd5-98e0-ff142a6d90cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:17.654378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185662c3-5b50-4dd5-98e0-ff142a6d90cc None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:17.670078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-185662c3-5b50-4dd5-98e0-ff142a6d90cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:27:17.670078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:17.670078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:17.670078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:17.670078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:17.670078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:17.670078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:17.670078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:17.670078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:17.670078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:17.670078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:17.670078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:17.670078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:27:17.670078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:27:17.670078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:27:17.670078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:27:17.671141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:17.671141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:17.671141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:17.671141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:17.671141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:17.671141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:17.671141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:17.671141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:17.671141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:17.671141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:17.671141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:17.671141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:17.671141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:17.671141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:17.671141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:17.671141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:17.671141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:27:17.672071 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:27:17.672071 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:27:17.672071 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:17.672071 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 560/1096] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:27:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:27:17.677120 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf0673-4b73-4ffd-aa32-b9638e148141 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:17.687705 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:17.777419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf0673-4b73-4ffd-aa32-b9638e148141 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:17.810917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c332e9b-164b-4eec-915d-daa811315e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:17.811838 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c332e9b-164b-4eec-915d-daa811315e8f None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:17.812131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c332e9b-164b-4eec-915d-daa811315e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:17.812645 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c332e9b-164b-4eec-915d-daa811315e8f None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:17.813748 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c332e9b-164b-4eec-915d-daa811315e8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:17.814300 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c332e9b-164b-4eec-915d-daa811315e8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:17.816002 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c332e9b-164b-4eec-915d-daa811315e8f None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:17.828843 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 537/1097] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:17.836398 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185662c3-5b50-4dd5-98e0-ff142a6d90cc None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:17.840807 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c332e9b-164b-4eec-915d-daa811315e8f None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:17.873915 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:17.909759 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:17.942175 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185662c3-5b50-4dd5-98e0-ff142a6d90cc None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:17.947641 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c332e9b-164b-4eec-915d-daa811315e8f None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:17.978080 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ab128-dd42-4569-a64f-d70c2561be60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:17.978713 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ab128-dd42-4569-a64f-d70c2561be60 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:17.978992 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ab128-dd42-4569-a64f-d70c2561be60 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:17.979266 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ab128-dd42-4569-a64f-d70c2561be60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:17.983058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ff0f9-32c5-40eb-b4a7-5fd760486885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:17.983677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ff0f9-32c5-40eb-b4a7-5fd760486885 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:17.983954 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ff0f9-32c5-40eb-b4a7-5fd760486885 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:17.984505 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ff0f9-32c5-40eb-b4a7-5fd760486885 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:17.986206 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ab128-dd42-4569-a64f-d70c2561be60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:17.987637 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ab128-dd42-4569-a64f-d70c2561be60 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:17.994843 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ff0f9-32c5-40eb-b4a7-5fd760486885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:17.999317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-c47ab128-dd42-4569-a64f-d70c2561be60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:27:17.999317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:17.999317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:17.999317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:17.999317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:17.999317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:17.999317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:17.999317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:17.999317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:17.999317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:17.999317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:17.999317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:17.999317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:27:17.999317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:27:17.999317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:27:18.000448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:27:18.000448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:18.000448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:18.000448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:18.000448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:18.000448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:18.000448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:18.000448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:18.000448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:18.000448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:18.000448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:18.000448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:18.000448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:18.000448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:18.000448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:18.000448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:18.000448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:18.001584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:27:18.001584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:27:18.001584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:27:18.001584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:27:18.001584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:27:18.001584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:27:18.001584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:27:18.001584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:18.002034 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-db0ff0f9-32c5-40eb-b4a7-5fd760486885 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:18.002034 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:18.002034 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:18.002034 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:18.002034 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:18.002034 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:18.002034 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:18.002034 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:18.002034 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:18.002034 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:18.002034 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:18.002034 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:18.002034 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:18.002034 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:18.002034 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:18.002034 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:18.002902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:18.002902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:18.002902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:18.002902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:18.002902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:18.002902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:18.002902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:18.002902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:18.002902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:18.002902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:18.002902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:18.002902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:18.002902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:18.002902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:18.002902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:18.002902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:18.003766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:18.003766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:18.003766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:18.003766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:18.003766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:18.003766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:18.003766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:18.003766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:18.003766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:18.003766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:18.003766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:18.003766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:27:18.004451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 561/1098] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:27:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:18.004537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 538/1099] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:27:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:27:18.006519 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ab128-dd42-4569-a64f-d70c2561be60 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:18.006961 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ff0f9-32c5-40eb-b4a7-5fd760486885 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:18.105012 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:18.109768 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ff0f9-32c5-40eb-b4a7-5fd760486885 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:18.111530 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ab128-dd42-4569-a64f-d70c2561be60 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:18.137212 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:18.145725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e59359-2dfd-4160-abd7-2be21685408e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:18.145952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14287c66-89e3-4541-bd6e-431de98d1c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:18.146336 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e59359-2dfd-4160-abd7-2be21685408e None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:18.146560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14287c66-89e3-4541-bd6e-431de98d1c2f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:18.146662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e59359-2dfd-4160-abd7-2be21685408e None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:18.146835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14287c66-89e3-4541-bd6e-431de98d1c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:18.146932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e59359-2dfd-4160-abd7-2be21685408e None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:18.147098 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14287c66-89e3-4541-bd6e-431de98d1c2f None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:18.147526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e59359-2dfd-4160-abd7-2be21685408e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:18.147813 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14287c66-89e3-4541-bd6e-431de98d1c2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:18.147909 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e59359-2dfd-4160-abd7-2be21685408e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:18.148116 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14287c66-89e3-4541-bd6e-431de98d1c2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:18.149218 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e59359-2dfd-4160-abd7-2be21685408e None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:18.149580 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14287c66-89e3-4541-bd6e-431de98d1c2f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:18.162374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 539/1100] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:18.162534 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 562/1101] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:27:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:18.165385 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e59359-2dfd-4160-abd7-2be21685408e None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:18.168367 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14287c66-89e3-4541-bd6e-431de98d1c2f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:18.269886 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e59359-2dfd-4160-abd7-2be21685408e None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:18.271746 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14287c66-89e3-4541-bd6e-431de98d1c2f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:18.303613 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5956e-e419-462a-bde3-4bfbea2da94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:18.304276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5956e-e419-462a-bde3-4bfbea2da94e None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:18.304557 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5956e-e419-462a-bde3-4bfbea2da94e None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:18.304833 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5956e-e419-462a-bde3-4bfbea2da94e None admin] PATH_INFO: `/v3/users/2e3946ab9d044cefb62e5849fd58d50f` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:18.304938 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed7682-2cbb-4795-953a-00d8ec8580bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:18.305546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed7682-2cbb-4795-953a-00d8ec8580bb None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:18.305725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed7682-2cbb-4795-953a-00d8ec8580bb None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:18.306001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed7682-2cbb-4795-953a-00d8ec8580bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:18.306171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5956e-e419-462a-bde3-4bfbea2da94e None admin] RBAC: Authorizing `identity:get_user(user_id=2e3946ab9d044cefb62e5849fd58d50f)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:18.306721 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed7682-2cbb-4795-953a-00d8ec8580bb None admin] RBAC: Adding query filter params (role.id=5a3de60a67584f299df269bc459f952f, scope.project.id=a302406c548c43c983625c0d66da47cc, user.id=96c35c544cae4ad187f1a1be723e0d21) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:18.307029 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed7682-2cbb-4795-953a-00d8ec8580bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:18.307581 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5956e-e419-462a-bde3-4bfbea2da94e None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:18.309000 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed7682-2cbb-4795-953a-00d8ec8580bb None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:18.309817 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 540/1102] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:18 2022] GET /identity/v3/users/2e3946ab9d044cefb62e5849fd58d50f => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:18.315569 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5956e-e419-462a-bde3-4bfbea2da94e None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:18.316806 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 563/1103] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:27:18 2022] GET /identity/v3/role_assignments?user.id=96c35c544cae4ad187f1a1be723e0d21&scope.project.id=a302406c548c43c983625c0d66da47cc&role.id=5a3de60a67584f299df269bc459f952f => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:18.379649 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:18.428976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5956e-e419-462a-bde3-4bfbea2da94e None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:18.466209 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331dbb0a-87bb-4f3d-8b8f-d628aa0ab7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:18.466826 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331dbb0a-87bb-4f3d-8b8f-d628aa0ab7ba None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:18.467098 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331dbb0a-87bb-4f3d-8b8f-d628aa0ab7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:18.467374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331dbb0a-87bb-4f3d-8b8f-d628aa0ab7ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:18.538716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331dbb0a-87bb-4f3d-8b8f-d628aa0ab7ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:18.540234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331dbb0a-87bb-4f3d-8b8f-d628aa0ab7ba None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:18.600387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:18.654921 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 541/1104] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 21:27:18.661954 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed7682-2cbb-4795-953a-00d8ec8580bb None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:18.685687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:18.769927 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed7682-2cbb-4795-953a-00d8ec8580bb None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:18.808173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf7458-2dd8-497f-8320-c8a29c61266d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:18.808857 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf7458-2dd8-497f-8320-c8a29c61266d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:18.809150 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf7458-2dd8-497f-8320-c8a29c61266d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:18.809408 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf7458-2dd8-497f-8320-c8a29c61266d None admin] PATH_INFO: `/v3/projects/c277d1ab3feb4a08b0deed15c6627f6c` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:18.811817 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf7458-2dd8-497f-8320-c8a29c61266d None admin] RBAC: Authorizing `identity:get_project(project_id=c277d1ab3feb4a08b0deed15c6627f6c)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:18.816021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf7458-2dd8-497f-8320-c8a29c61266d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:18.817833 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 564/1105] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:18 2022] GET /identity/v3/projects/c277d1ab3feb4a08b0deed15c6627f6c => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:18.824860 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331dbb0a-87bb-4f3d-8b8f-d628aa0ab7ba None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:18.939395 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331dbb0a-87bb-4f3d-8b8f-d628aa0ab7ba None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:18.977142 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d148d3-30ed-4286-a486-abb7e7df9cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:18.977752 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d148d3-30ed-4286-a486-abb7e7df9cab None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:18.978030 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d148d3-30ed-4286-a486-abb7e7df9cab None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:18.978303 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d148d3-30ed-4286-a486-abb7e7df9cab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:18.979022 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d148d3-30ed-4286-a486-abb7e7df9cab None admin] RBAC: Adding query filter params (role.id=69369872661e4179bb51cd1ca76e28c3, scope.project.id=c277d1ab3feb4a08b0deed15c6627f6c, user.id=2e3946ab9d044cefb62e5849fd58d50f) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:18.979380 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d148d3-30ed-4286-a486-abb7e7df9cab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:18.980854 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d148d3-30ed-4286-a486-abb7e7df9cab None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:18.987428 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 542/1106] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:27:18 2022] GET /identity/v3/role_assignments?user.id=2e3946ab9d044cefb62e5849fd58d50f&scope.project.id=c277d1ab3feb4a08b0deed15c6627f6c&role.id=69369872661e4179bb51cd1ca76e28c3 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:20.945988 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361de13b-8f3a-473a-a5b3-349cb639647d None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:20.946558 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361de13b-8f3a-473a-a5b3-349cb639647d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:20.946558 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361de13b-8f3a-473a-a5b3-349cb639647d None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:20.947871 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 565/1107] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:20.953652 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a3a81-3ba0-47c0-87d1-7e21387f40fa None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:20.954057 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a3a81-3ba0-47c0-87d1-7e21387f40fa None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:20.954214 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a3a81-3ba0-47c0-87d1-7e21387f40fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:20.972503 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-eb9a3a81-3ba0-47c0-87d1-7e21387f40fa None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:20.973683 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-eb9a3a81-3ba0-47c0-87d1-7e21387f40fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:20.990120 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:21.039533 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 543/1108] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:27:21.306368 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361de13b-8f3a-473a-a5b3-349cb639647d None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:21.402469 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:21.415974 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361de13b-8f3a-473a-a5b3-349cb639647d None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:21.450939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f45ab-2e00-41bb-87d4-8fb40854a56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:21.451576 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f45ab-2e00-41bb-87d4-8fb40854a56c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:21.451855 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f45ab-2e00-41bb-87d4-8fb40854a56c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:21.452127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f45ab-2e00-41bb-87d4-8fb40854a56c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:21.453250 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f45ab-2e00-41bb-87d4-8fb40854a56c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:21.454683 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f45ab-2e00-41bb-87d4-8fb40854a56c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:21.456352 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 566/1109] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:27:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:21.462043 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a3a81-3ba0-47c0-87d1-7e21387f40fa None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:21.560651 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a3a81-3ba0-47c0-87d1-7e21387f40fa None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:21.594319 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d85ce9-8ee8-4bc7-ab0b-f0b64f336af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:21.594935 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d85ce9-8ee8-4bc7-ab0b-f0b64f336af3 None admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:21.595216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d85ce9-8ee8-4bc7-ab0b-f0b64f336af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:21.595488 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d85ce9-8ee8-4bc7-ab0b-f0b64f336af3 None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:21.596165 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d85ce9-8ee8-4bc7-ab0b-f0b64f336af3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:21.597629 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d85ce9-8ee8-4bc7-ab0b-f0b64f336af3 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:21.619041 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 544/1110] 10.222.0.69 () {60 vars in 1132 bytes} [Mon Aug 29 21:27:21 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:27:23.577812 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66d582-4b11-43d2-80e0-6453f984edef None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:23.578323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66d582-4b11-43d2-80e0-6453f984edef None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:23.578323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66d582-4b11-43d2-80e0-6453f984edef None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:23.579625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 567/1111] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:23.584974 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31dfc9-60ba-4a58-8093-97a65c15615f None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:23.585414 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31dfc9-60ba-4a58-8093-97a65c15615f None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:23.585510 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31dfc9-60ba-4a58-8093-97a65c15615f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:23.603512 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-3a31dfc9-60ba-4a58-8093-97a65c15615f None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:23.604728 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-3a31dfc9-60ba-4a58-8093-97a65c15615f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:23.606676 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:23.672923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 545/1112] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:27:23.948125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66d582-4b11-43d2-80e0-6453f984edef None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:24.048689 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66d582-4b11-43d2-80e0-6453f984edef None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:24.081906 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e34bd-f7f3-4aad-a9fb-90f9c53ab143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:24.082533 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e34bd-f7f3-4aad-a9fb-90f9c53ab143 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:24.082815 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e34bd-f7f3-4aad-a9fb-90f9c53ab143 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:24.083176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e34bd-f7f3-4aad-a9fb-90f9c53ab143 None admin] PATH_INFO: `/v3/roles/ecbc0b9f55214a93a2016b3625d94764` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:24.084600 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e34bd-f7f3-4aad-a9fb-90f9c53ab143 None admin] RBAC: Authorizing `identity:get_role(role_id=ecbc0b9f55214a93a2016b3625d94764)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:24.085974 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e34bd-f7f3-4aad-a9fb-90f9c53ab143 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:24.087301 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 568/1113] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:23 2022] GET /identity/v3/roles/ecbc0b9f55214a93a2016b3625d94764 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:24.093708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31dfc9-60ba-4a58-8093-97a65c15615f None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:24.192090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31dfc9-60ba-4a58-8093-97a65c15615f None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:24.226443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a20c97-9c66-4b8f-8c0e-1d369b0bb48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:24.227076 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a20c97-9c66-4b8f-8c0e-1d369b0bb48f None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:24.227349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a20c97-9c66-4b8f-8c0e-1d369b0bb48f None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:24.227622 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a20c97-9c66-4b8f-8c0e-1d369b0bb48f None admin] PATH_INFO: `/v3/users/46220b6a74b54b00bd2d22026cf01453` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:24.235646 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:24.241635 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a20c97-9c66-4b8f-8c0e-1d369b0bb48f None admin] RBAC: Authorizing `identity:get_user(user_id=46220b6a74b54b00bd2d22026cf01453)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:24.243095 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a20c97-9c66-4b8f-8c0e-1d369b0bb48f None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:24.244984 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 546/1114] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:24 2022] GET /identity/v3/users/46220b6a74b54b00bd2d22026cf01453 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:24.251043 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e34bd-f7f3-4aad-a9fb-90f9c53ab143 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:24.276646 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:24.348645 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e34bd-f7f3-4aad-a9fb-90f9c53ab143 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:24.384129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a896ea0-6ff3-41e3-8876-0e1a3061fd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:24.384763 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a896ea0-6ff3-41e3-8876-0e1a3061fd4b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:24.385131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a896ea0-6ff3-41e3-8876-0e1a3061fd4b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:24.385317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a896ea0-6ff3-41e3-8876-0e1a3061fd4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:24.461903 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a896ea0-6ff3-41e3-8876-0e1a3061fd4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:24.463633 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a896ea0-6ff3-41e3-8876-0e1a3061fd4b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:24.491429 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:24.564850 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 569/1115] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:27:24.570804 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a20c97-9c66-4b8f-8c0e-1d369b0bb48f None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:24.669750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a20c97-9c66-4b8f-8c0e-1d369b0bb48f None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:24.704533 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c3877-ecc7-420c-ad7a-17f516310d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:24.705160 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c3877-ecc7-420c-ad7a-17f516310d69 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:24.705441 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c3877-ecc7-420c-ad7a-17f516310d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:24.705714 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c3877-ecc7-420c-ad7a-17f516310d69 None admin] PATH_INFO: `/v3/projects/c277d1ab3feb4a08b0deed15c6627f6c` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:24.706828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c3877-ecc7-420c-ad7a-17f516310d69 None admin] RBAC: Authorizing `identity:get_project(project_id=c277d1ab3feb4a08b0deed15c6627f6c)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:24.708282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c3877-ecc7-420c-ad7a-17f516310d69 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:24.709904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 547/1116] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:24 2022] GET /identity/v3/projects/c277d1ab3feb4a08b0deed15c6627f6c => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:24.716818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a896ea0-6ff3-41e3-8876-0e1a3061fd4b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:24.816573 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a896ea0-6ff3-41e3-8876-0e1a3061fd4b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:24.842036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:24.853019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf735dd-c32e-4f51-a525-d5332a0e892d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:24.853619 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf735dd-c32e-4f51-a525-d5332a0e892d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:24.853904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf735dd-c32e-4f51-a525-d5332a0e892d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:24.854174 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf735dd-c32e-4f51-a525-d5332a0e892d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:24.854930 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf735dd-c32e-4f51-a525-d5332a0e892d None admin] RBAC: Adding query filter params (role.id=ecbc0b9f55214a93a2016b3625d94764, scope.project.id=c277d1ab3feb4a08b0deed15c6627f6c, user.id=46220b6a74b54b00bd2d22026cf01453) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:24.855235 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf735dd-c32e-4f51-a525-d5332a0e892d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:24.856695 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf735dd-c32e-4f51-a525-d5332a0e892d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:24.862394 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 570/1117] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:27:24 2022] GET /identity/v3/role_assignments?user.id=46220b6a74b54b00bd2d22026cf01453&scope.project.id=c277d1ab3feb4a08b0deed15c6627f6c&role.id=ecbc0b9f55214a93a2016b3625d94764 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:26.746176 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df853f0-fb0d-4603-a71d-ac0ec387d3ab None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:26.746708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df853f0-fb0d-4603-a71d-ac0ec387d3ab None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:26.746708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df853f0-fb0d-4603-a71d-ac0ec387d3ab None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:26.748063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 548/1118] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:26.753333 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77325b-adec-4155-be8d-6192a517eb01 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:26.753730 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77325b-adec-4155-be8d-6192a517eb01 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:26.753883 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77325b-adec-4155-be8d-6192a517eb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:26.772204 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ad77325b-adec-4155-be8d-6192a517eb01 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:26.773393 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ad77325b-adec-4155-be8d-6192a517eb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:26.839200 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 571/1119] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:27:27.115213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df853f0-fb0d-4603-a71d-ac0ec387d3ab None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:27.183730 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:27.231955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df853f0-fb0d-4603-a71d-ac0ec387d3ab None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:27.274322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b4730-97c4-4295-aeb5-6b991b1a6f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:27.274963 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b4730-97c4-4295-aeb5-6b991b1a6f85 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:27.275246 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b4730-97c4-4295-aeb5-6b991b1a6f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:27.275518 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b4730-97c4-4295-aeb5-6b991b1a6f85 None admin] PATH_INFO: `/v3/roles/ecbc0b9f55214a93a2016b3625d94764` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:27.276991 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b4730-97c4-4295-aeb5-6b991b1a6f85 None admin] RBAC: Authorizing `identity:get_role(role_id=ecbc0b9f55214a93a2016b3625d94764)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:27.278357 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b4730-97c4-4295-aeb5-6b991b1a6f85 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:27.279695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 549/1120] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:27 2022] GET /identity/v3/roles/ecbc0b9f55214a93a2016b3625d94764 => generated 223 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:27.285917 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77325b-adec-4155-be8d-6192a517eb01 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:27.389300 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77325b-adec-4155-be8d-6192a517eb01 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:27.406858 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:27.424495 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b8ea0-52f7-4ba3-85da-3abaf14d9a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:27.425132 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b8ea0-52f7-4ba3-85da-3abaf14d9a0d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:27.425419 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b8ea0-52f7-4ba3-85da-3abaf14d9a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:27.425688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b8ea0-52f7-4ba3-85da-3abaf14d9a0d None admin] PATH_INFO: `/v3/users/46220b6a74b54b00bd2d22026cf01453` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:27.426859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b8ea0-52f7-4ba3-85da-3abaf14d9a0d None admin] RBAC: Authorizing `identity:get_user(user_id=46220b6a74b54b00bd2d22026cf01453)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:27.428311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b8ea0-52f7-4ba3-85da-3abaf14d9a0d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:27.429905 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 572/1121] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:27 2022] GET /identity/v3/users/46220b6a74b54b00bd2d22026cf01453 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:27.436373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b4730-97c4-4295-aeb5-6b991b1a6f85 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:27.538968 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b4730-97c4-4295-aeb5-6b991b1a6f85 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:27.569689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:27.575402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3da308-c3bc-45f3-91c9-8d0e86fc4a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:27.576036 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3da308-c3bc-45f3-91c9-8d0e86fc4a70 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:27.576345 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3da308-c3bc-45f3-91c9-8d0e86fc4a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:27.576620 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3da308-c3bc-45f3-91c9-8d0e86fc4a70 None admin] PATH_INFO: `/v3/projects/c277d1ab3feb4a08b0deed15c6627f6c` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:27.577731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3da308-c3bc-45f3-91c9-8d0e86fc4a70 None admin] RBAC: Authorizing `identity:get_project(project_id=c277d1ab3feb4a08b0deed15c6627f6c)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:27.579159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3da308-c3bc-45f3-91c9-8d0e86fc4a70 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:27.580825 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 550/1122] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:27 2022] GET /identity/v3/projects/c277d1ab3feb4a08b0deed15c6627f6c => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:27.586768 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b8ea0-52f7-4ba3-85da-3abaf14d9a0d None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:27.688432 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b8ea0-52f7-4ba3-85da-3abaf14d9a0d None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:27.721996 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940231f2-aa06-4dac-abed-39592e0e6ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:27.722657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940231f2-aa06-4dac-abed-39592e0e6ada None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:27.722943 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940231f2-aa06-4dac-abed-39592e0e6ada None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:27.723223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940231f2-aa06-4dac-abed-39592e0e6ada None admin] PATH_INFO: `/v3/projects/c277d1ab3feb4a08b0deed15c6627f6c/users/46220b6a74b54b00bd2d22026cf01453/roles/ecbc0b9f55214a93a2016b3625d94764` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:27.725758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940231f2-aa06-4dac-abed-39592e0e6ada None admin] RBAC: Authorizing `identity:create_grant(project_id=c277d1ab3feb4a08b0deed15c6627f6c, user_id=46220b6a74b54b00bd2d22026cf01453, role_id=ecbc0b9f55214a93a2016b3625d94764)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:27.727201 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940231f2-aa06-4dac-abed-39592e0e6ada None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:27.748822 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 573/1123] 10.222.0.69 () {58 vars in 1439 bytes} [Mon Aug 29 21:27:27 2022] PUT /identity/v3/projects/c277d1ab3feb4a08b0deed15c6627f6c/users/46220b6a74b54b00bd2d22026cf01453/roles/ecbc0b9f55214a93a2016b3625d94764 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:27:29.705475 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695e010-fbbe-476f-9bb8-b63bea6d1aa5 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:29.706048 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695e010-fbbe-476f-9bb8-b63bea6d1aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:29.706048 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695e010-fbbe-476f-9bb8-b63bea6d1aa5 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:29.707361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 551/1124] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:29.712674 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fa4f3-2911-4209-ae2b-9b45becdcbfc None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:29.713104 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fa4f3-2911-4209-ae2b-9b45becdcbfc None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:29.713255 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fa4f3-2911-4209-ae2b-9b45becdcbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:29.732284 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-2b1fa4f3-2911-4209-ae2b-9b45becdcbfc None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:29.733470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2b1fa4f3-2911-4209-ae2b-9b45becdcbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:29.775146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:29.801048 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 574/1125] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:27:30.098082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695e010-fbbe-476f-9bb8-b63bea6d1aa5 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:30.217947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695e010-fbbe-476f-9bb8-b63bea6d1aa5 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:30.257033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3468f0-1b1d-4a45-be55-9f8abab37f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:30.257665 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3468f0-1b1d-4a45-be55-9f8abab37f50 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:30.257942 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3468f0-1b1d-4a45-be55-9f8abab37f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:30.258215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3468f0-1b1d-4a45-be55-9f8abab37f50 None admin] PATH_INFO: `/v3/roles/ecbc0b9f55214a93a2016b3625d94764` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:30.259633 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3468f0-1b1d-4a45-be55-9f8abab37f50 None admin] RBAC: Authorizing `identity:get_role(role_id=ecbc0b9f55214a93a2016b3625d94764)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:30.261034 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3468f0-1b1d-4a45-be55-9f8abab37f50 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:30.262388 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 552/1126] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:30 2022] GET /identity/v3/roles/ecbc0b9f55214a93a2016b3625d94764 => generated 223 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:30.270238 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fa4f3-2911-4209-ae2b-9b45becdcbfc None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:30.386226 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fa4f3-2911-4209-ae2b-9b45becdcbfc None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:30.421794 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a28cc-1564-44a6-8f80-dd7a264a5230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:30.422425 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a28cc-1564-44a6-8f80-dd7a264a5230 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:30.422706 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a28cc-1564-44a6-8f80-dd7a264a5230 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:30.422983 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a28cc-1564-44a6-8f80-dd7a264a5230 None admin] PATH_INFO: `/v3/users/46220b6a74b54b00bd2d22026cf01453` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:30.424107 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a28cc-1564-44a6-8f80-dd7a264a5230 None admin] RBAC: Authorizing `identity:get_user(user_id=46220b6a74b54b00bd2d22026cf01453)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:30.425571 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a28cc-1564-44a6-8f80-dd7a264a5230 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:30.427170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 575/1127] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:30 2022] GET /identity/v3/users/46220b6a74b54b00bd2d22026cf01453 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:30.433361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3468f0-1b1d-4a45-be55-9f8abab37f50 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:30.516050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:30.558239 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3468f0-1b1d-4a45-be55-9f8abab37f50 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:30.601388 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eef6f9-b8e7-4add-8f5b-9b62ef6ffe97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:30.601999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eef6f9-b8e7-4add-8f5b-9b62ef6ffe97 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:30.602281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eef6f9-b8e7-4add-8f5b-9b62ef6ffe97 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:30.602554 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eef6f9-b8e7-4add-8f5b-9b62ef6ffe97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:30.675261 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eef6f9-b8e7-4add-8f5b-9b62ef6ffe97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:30.677057 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eef6f9-b8e7-4add-8f5b-9b62ef6ffe97 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:30.748198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:30.786591 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 553/1128] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:27:30.793006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a28cc-1564-44a6-8f80-dd7a264a5230 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:30.851837 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:30.916489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a28cc-1564-44a6-8f80-dd7a264a5230 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:30.969799 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd23867-eb47-4095-9bc4-62296cda8620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:30.970368 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd23867-eb47-4095-9bc4-62296cda8620 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:30.970651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd23867-eb47-4095-9bc4-62296cda8620 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:30.971030 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd23867-eb47-4095-9bc4-62296cda8620 None admin] PATH_INFO: `/v3/projects/c277d1ab3feb4a08b0deed15c6627f6c` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:30.972067 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd23867-eb47-4095-9bc4-62296cda8620 None admin] RBAC: Authorizing `identity:get_project(project_id=c277d1ab3feb4a08b0deed15c6627f6c)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:30.973558 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd23867-eb47-4095-9bc4-62296cda8620 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:30.975275 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 576/1129] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:30 2022] GET /identity/v3/projects/c277d1ab3feb4a08b0deed15c6627f6c => generated 311 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:30.981485 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eef6f9-b8e7-4add-8f5b-9b62ef6ffe97 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:31.096624 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eef6f9-b8e7-4add-8f5b-9b62ef6ffe97 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:31.130101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbccc22-21f8-422e-b742-6fe22c64af89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:31.130709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbccc22-21f8-422e-b742-6fe22c64af89 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:31.130989 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbccc22-21f8-422e-b742-6fe22c64af89 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:31.131262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbccc22-21f8-422e-b742-6fe22c64af89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:31.131980 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbccc22-21f8-422e-b742-6fe22c64af89 None admin] RBAC: Adding query filter params (role.id=ecbc0b9f55214a93a2016b3625d94764, scope.project.id=c277d1ab3feb4a08b0deed15c6627f6c, user.id=46220b6a74b54b00bd2d22026cf01453) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:31.132320 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbccc22-21f8-422e-b742-6fe22c64af89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:31.133753 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbccc22-21f8-422e-b742-6fe22c64af89 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:31.140477 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 554/1130] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:27:30 2022] GET /identity/v3/role_assignments?user.id=46220b6a74b54b00bd2d22026cf01453&scope.project.id=c277d1ab3feb4a08b0deed15c6627f6c&role.id=ecbc0b9f55214a93a2016b3625d94764 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:33.125193 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a160cb-c64c-4f7b-9344-cf3a3483012f None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:33.125762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a160cb-c64c-4f7b-9344-cf3a3483012f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:33.126156 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a160cb-c64c-4f7b-9344-cf3a3483012f None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:33.128510 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 577/1131] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:33.134198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cb5c6-d68c-480a-af02-e151f4375a78 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:33.134653 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cb5c6-d68c-480a-af02-e151f4375a78 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:33.134780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cb5c6-d68c-480a-af02-e151f4375a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:33.153819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-487cb5c6-d68c-480a-af02-e151f4375a78 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:33.154997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-487cb5c6-d68c-480a-af02-e151f4375a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:33.181543 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:33.225404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 555/1132] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:27:33.501499 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a160cb-c64c-4f7b-9344-cf3a3483012f None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:33.614885 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a160cb-c64c-4f7b-9344-cf3a3483012f None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:33.629840 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:33.652726 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174d511-325b-4c01-b66c-e1c4c3ed83ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:33.653371 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174d511-325b-4c01-b66c-e1c4c3ed83ec None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:33.653656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174d511-325b-4c01-b66c-e1c4c3ed83ec None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:33.653931 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174d511-325b-4c01-b66c-e1c4c3ed83ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:33.655098 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174d511-325b-4c01-b66c-e1c4c3ed83ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:33.656557 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174d511-325b-4c01-b66c-e1c4c3ed83ec None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:33.658145 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 578/1133] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:27:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:33.664287 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cb5c6-d68c-480a-af02-e151f4375a78 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:33.781683 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cb5c6-d68c-480a-af02-e151f4375a78 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:33.816742 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d69325-cc33-4a6e-a2ed-be447244b62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:33.817346 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d69325-cc33-4a6e-a2ed-be447244b62f None admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:33.817626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d69325-cc33-4a6e-a2ed-be447244b62f None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:33.817889 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d69325-cc33-4a6e-a2ed-be447244b62f None admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:33.818538 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d69325-cc33-4a6e-a2ed-be447244b62f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:33.819958 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d69325-cc33-4a6e-a2ed-be447244b62f None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:33.849061 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 556/1134] 10.222.0.69 () {60 vars in 1141 bytes} [Mon Aug 29 21:27:33 2022] POST /identity/v3/projects => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:27:36.033127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea83945-5f36-4fec-a5c4-c411b45583ab None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:36.033663 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea83945-5f36-4fec-a5c4-c411b45583ab None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:36.033663 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea83945-5f36-4fec-a5c4-c411b45583ab None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:36.035014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 579/1135] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:36.040380 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce7716-42a2-4064-9d77-45368f94a329 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:36.040827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce7716-42a2-4064-9d77-45368f94a329 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:36.041010 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce7716-42a2-4064-9d77-45368f94a329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:36.062051 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-e3ce7716-42a2-4064-9d77-45368f94a329 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:36.063272 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-e3ce7716-42a2-4064-9d77-45368f94a329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:36.072790 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:36.132011 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 557/1136] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:27:36.405893 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea83945-5f36-4fec-a5c4-c411b45583ab None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:36.510084 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea83945-5f36-4fec-a5c4-c411b45583ab None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:36.548875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bc668-6f62-4b5a-932c-3f97bb472234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:36.549511 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bc668-6f62-4b5a-932c-3f97bb472234 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:36.549789 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bc668-6f62-4b5a-932c-3f97bb472234 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:36.550208 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bc668-6f62-4b5a-932c-3f97bb472234 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:36.551387 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96bc668-6f62-4b5a-932c-3f97bb472234 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:36.552884 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96bc668-6f62-4b5a-932c-3f97bb472234 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:36.554445 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 580/1137] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:27:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:36.561234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce7716-42a2-4064-9d77-45368f94a329 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:36.661483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce7716-42a2-4064-9d77-45368f94a329 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:36.695285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6de46-34ad-4ccc-8f36-f246de90298d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:36.695891 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6de46-34ad-4ccc-8f36-f246de90298d None admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:36.696169 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6de46-34ad-4ccc-8f36-f246de90298d None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:36.696472 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6de46-34ad-4ccc-8f36-f246de90298d None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:36.697123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6de46-34ad-4ccc-8f36-f246de90298d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:36.698550 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6de46-34ad-4ccc-8f36-f246de90298d None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:36.714931 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:36.720865 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 558/1138] 10.222.0.69 () {60 vars in 1132 bytes} [Mon Aug 29 21:27:36 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:27:38.690647 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0897d03-d15d-4b99-8d48-7ff449f95ca6 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:38.691189 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0897d03-d15d-4b99-8d48-7ff449f95ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:38.691189 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0897d03-d15d-4b99-8d48-7ff449f95ca6 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:38.692573 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 581/1139] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:38.698159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99697c34-9360-4f7c-92b6-79b9a14ceec7 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:38.699037 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99697c34-9360-4f7c-92b6-79b9a14ceec7 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:38.699295 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99697c34-9360-4f7c-92b6-79b9a14ceec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:38.718721 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-99697c34-9360-4f7c-92b6-79b9a14ceec7 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:38.719941 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-99697c34-9360-4f7c-92b6-79b9a14ceec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:38.791729 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 559/1140] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:27:39.062619 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0897d03-d15d-4b99-8d48-7ff449f95ca6 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:39.116993 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:39.170542 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0897d03-d15d-4b99-8d48-7ff449f95ca6 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:39.206788 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdcfb9-3221-40b3-9bba-eca71e4b931f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:39.206788 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdcfb9-3221-40b3-9bba-eca71e4b931f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:39.207075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdcfb9-3221-40b3-9bba-eca71e4b931f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:39.207343 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdcfb9-3221-40b3-9bba-eca71e4b931f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:39.218169 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bdcfb9-3221-40b3-9bba-eca71e4b931f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:39.223176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-26bdcfb9-3221-40b3-9bba-eca71e4b931f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:39.223176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:39.223176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:39.223176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:39.223176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:39.223176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:39.223176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:39.223176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:39.223176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:39.223176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:39.223176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:39.223176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:39.223176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:39.223176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:39.223176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:39.223176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:39.224449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:39.224449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:39.224449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:39.224449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:39.224449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:39.224449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:39.224449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:39.224449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:39.224449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:39.224449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:39.224449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:39.224449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:39.224449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:39.224449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:39.224449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:39.224449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:39.225726 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:39.225726 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:39.225726 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:39.225726 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:39.225726 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:39.225726 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:39.225726 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:39.225726 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:39.225726 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:39.225726 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:39.225726 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:39.225726 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:39.225726 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 582/1141] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:27:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:39.230957 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99697c34-9360-4f7c-92b6-79b9a14ceec7 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:39.335215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99697c34-9360-4f7c-92b6-79b9a14ceec7 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:39.363754 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:39.372202 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec084e50-ae93-49be-8162-fae5c3bdbe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:39.372825 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec084e50-ae93-49be-8162-fae5c3bdbe77 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:39.373106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec084e50-ae93-49be-8162-fae5c3bdbe77 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:39.373407 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec084e50-ae93-49be-8162-fae5c3bdbe77 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:39.374065 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec084e50-ae93-49be-8162-fae5c3bdbe77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:39.374361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec084e50-ae93-49be-8162-fae5c3bdbe77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:39.375746 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec084e50-ae93-49be-8162-fae5c3bdbe77 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:39.384195 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 560/1142] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:39.390663 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdcfb9-3221-40b3-9bba-eca71e4b931f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:39.510798 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdcfb9-3221-40b3-9bba-eca71e4b931f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:39.523535 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:39.552758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53569753-2f44-45fc-9383-ce13d6df9814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:39.553387 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53569753-2f44-45fc-9383-ce13d6df9814 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:39.553661 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53569753-2f44-45fc-9383-ce13d6df9814 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:39.553932 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53569753-2f44-45fc-9383-ce13d6df9814 None admin] PATH_INFO: `/v3/users/6215ed1509de45c0905e1b6c8402a01b` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:39.568775 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53569753-2f44-45fc-9383-ce13d6df9814 None admin] RBAC: Authorizing `identity:get_user(user_id=6215ed1509de45c0905e1b6c8402a01b)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:39.570257 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53569753-2f44-45fc-9383-ce13d6df9814 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:39.571966 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 583/1143] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:39 2022] GET /identity/v3/users/6215ed1509de45c0905e1b6c8402a01b => generated 286 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:39.578104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec084e50-ae93-49be-8162-fae5c3bdbe77 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:39.697844 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec084e50-ae93-49be-8162-fae5c3bdbe77 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:39.732615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06648b1-3e72-42df-8b1e-e35026763d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:39.733305 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06648b1-3e72-42df-8b1e-e35026763d4a None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:39.733496 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06648b1-3e72-42df-8b1e-e35026763d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:39.733768 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06648b1-3e72-42df-8b1e-e35026763d4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:39.794918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:39.805072 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06648b1-3e72-42df-8b1e-e35026763d4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:39.806522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06648b1-3e72-42df-8b1e-e35026763d4a None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:39.909222 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 561/1144] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 21:27:39.915606 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53569753-2f44-45fc-9383-ce13d6df9814 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:40.030730 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53569753-2f44-45fc-9383-ce13d6df9814 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:40.064964 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687067c-6c6c-443c-b3e1-a6c60fe297a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:40.065594 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687067c-6c6c-443c-b3e1-a6c60fe297a1 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:40.065873 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687067c-6c6c-443c-b3e1-a6c60fe297a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:40.066140 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687067c-6c6c-443c-b3e1-a6c60fe297a1 None admin] PATH_INFO: `/v3/projects/ec0f75803598472091c51b3006e0a105` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:40.067255 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687067c-6c6c-443c-b3e1-a6c60fe297a1 None admin] RBAC: Authorizing `identity:get_project(project_id=ec0f75803598472091c51b3006e0a105)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:40.068703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687067c-6c6c-443c-b3e1-a6c60fe297a1 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:40.070336 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 584/1145] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:39 2022] GET /identity/v3/projects/ec0f75803598472091c51b3006e0a105 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:40.077312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06648b1-3e72-42df-8b1e-e35026763d4a None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:40.168898 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:40.178847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06648b1-3e72-42df-8b1e-e35026763d4a None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:40.214753 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ca548-9e84-4244-b8e5-21b36ceb9fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:40.215366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ca548-9e84-4244-b8e5-21b36ceb9fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:40.215650 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ca548-9e84-4244-b8e5-21b36ceb9fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:40.215930 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ca548-9e84-4244-b8e5-21b36ceb9fe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:40.216701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ca548-9e84-4244-b8e5-21b36ceb9fe0 None admin] RBAC: Adding query filter params (role.id=69369872661e4179bb51cd1ca76e28c3, scope.project.id=ec0f75803598472091c51b3006e0a105, user.id=6215ed1509de45c0905e1b6c8402a01b) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:40.217016 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ca548-9e84-4244-b8e5-21b36ceb9fe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:40.218448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ca548-9e84-4244-b8e5-21b36ceb9fe0 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:40.223983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 562/1146] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:27:40 2022] GET /identity/v3/role_assignments?user.id=6215ed1509de45c0905e1b6c8402a01b&scope.project.id=ec0f75803598472091c51b3006e0a105&role.id=69369872661e4179bb51cd1ca76e28c3 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:42.141855 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f3abb-3368-4fb1-9576-9f1f005a3708 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:42.142429 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f3abb-3368-4fb1-9576-9f1f005a3708 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:42.142429 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f3abb-3368-4fb1-9576-9f1f005a3708 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:42.143723 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 585/1147] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:42.149077 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d8422-740f-48c7-bf8d-54d923373fe3 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:42.149486 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d8422-740f-48c7-bf8d-54d923373fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:42.149641 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d8422-740f-48c7-bf8d-54d923373fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:42.168801 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-473d8422-740f-48c7-bf8d-54d923373fe3 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:42.170028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-473d8422-740f-48c7-bf8d-54d923373fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:42.239678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 563/1148] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:27:42.513984 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f3abb-3368-4fb1-9576-9f1f005a3708 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:42.554676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:42.627747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f3abb-3368-4fb1-9576-9f1f005a3708 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:42.668113 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00b937-ae9a-49f3-8c82-8a00f9a868d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:42.668862 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00b937-ae9a-49f3-8c82-8a00f9a868d7 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:42.669143 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00b937-ae9a-49f3-8c82-8a00f9a868d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:42.669422 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00b937-ae9a-49f3-8c82-8a00f9a868d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:42.679998 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00b937-ae9a-49f3-8c82-8a00f9a868d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:42.684902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-fb00b937-ae9a-49f3-8c82-8a00f9a868d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:42.684902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:42.684902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:42.684902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:42.684902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:42.684902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:42.684902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:42.684902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:42.684902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:42.684902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:42.684902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:42.684902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:42.684902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:42.684902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:42.684902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:42.684902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:42.686025 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:42.686025 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:42.686025 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:42.686025 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:42.686025 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:42.686025 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:42.686025 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:42.686025 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:42.686025 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:42.686025 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:42.686025 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:42.686025 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:42.686025 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:42.686025 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:42.686025 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:42.686025 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:42.686957 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:42.686957 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:42.686957 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:42.686957 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:42.686957 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:42.686957 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:42.686957 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:42.686957 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:42.686957 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:42.686957 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:42.686957 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:42.686957 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:42.686957 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 586/1149] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:27:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:42.692702 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d8422-740f-48c7-bf8d-54d923373fe3 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:42.788589 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:42.806019 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d8422-740f-48c7-bf8d-54d923373fe3 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:42.844057 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33923e4b-bcd4-4d05-9f73-c76795a6c98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:42.844696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33923e4b-bcd4-4d05-9f73-c76795a6c98b None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:42.844978 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33923e4b-bcd4-4d05-9f73-c76795a6c98b None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:42.845255 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33923e4b-bcd4-4d05-9f73-c76795a6c98b None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:42.845921 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33923e4b-bcd4-4d05-9f73-c76795a6c98b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:42.846226 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33923e4b-bcd4-4d05-9f73-c76795a6c98b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:42.847596 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33923e4b-bcd4-4d05-9f73-c76795a6c98b None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:42.855561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 564/1150] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:42.861727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00b937-ae9a-49f3-8c82-8a00f9a868d7 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:42.956513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:42.963883 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00b937-ae9a-49f3-8c82-8a00f9a868d7 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:43.000914 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189caa3-f10a-46c8-8185-e35aa9a4c661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:43.001565 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189caa3-f10a-46c8-8185-e35aa9a4c661 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:43.001855 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189caa3-f10a-46c8-8185-e35aa9a4c661 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:43.002127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189caa3-f10a-46c8-8185-e35aa9a4c661 None admin] PATH_INFO: `/v3/users/6215ed1509de45c0905e1b6c8402a01b` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:43.003280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189caa3-f10a-46c8-8185-e35aa9a4c661 None admin] RBAC: Authorizing `identity:get_user(user_id=6215ed1509de45c0905e1b6c8402a01b)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:43.004749 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189caa3-f10a-46c8-8185-e35aa9a4c661 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:43.006343 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 587/1151] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:42 2022] GET /identity/v3/users/6215ed1509de45c0905e1b6c8402a01b => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:43.012787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33923e4b-bcd4-4d05-9f73-c76795a6c98b None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:43.116903 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33923e4b-bcd4-4d05-9f73-c76795a6c98b None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:43.152255 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cafaa8-b3b6-4eb3-ac62-65e95a23783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:43.152922 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cafaa8-b3b6-4eb3-ac62-65e95a23783a None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:43.153158 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cafaa8-b3b6-4eb3-ac62-65e95a23783a None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:43.153433 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cafaa8-b3b6-4eb3-ac62-65e95a23783a None admin] PATH_INFO: `/v3/projects/ec0f75803598472091c51b3006e0a105` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:43.154558 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cafaa8-b3b6-4eb3-ac62-65e95a23783a None admin] RBAC: Authorizing `identity:get_project(project_id=ec0f75803598472091c51b3006e0a105)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:43.155988 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cafaa8-b3b6-4eb3-ac62-65e95a23783a None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:43.157666 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 565/1152] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:43 2022] GET /identity/v3/projects/ec0f75803598472091c51b3006e0a105 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:43.163893 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189caa3-f10a-46c8-8185-e35aa9a4c661 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:43.263864 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189caa3-f10a-46c8-8185-e35aa9a4c661 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:43.297252 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b69ea-211f-4578-ae4d-9cbfa67eeb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:43.297904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b69ea-211f-4578-ae4d-9cbfa67eeb82 None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:43.298184 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b69ea-211f-4578-ae4d-9cbfa67eeb82 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:43.298457 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b69ea-211f-4578-ae4d-9cbfa67eeb82 None admin] PATH_INFO: `/v3/projects/ec0f75803598472091c51b3006e0a105/users/6215ed1509de45c0905e1b6c8402a01b/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:43.300377 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b69ea-211f-4578-ae4d-9cbfa67eeb82 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec0f75803598472091c51b3006e0a105, user_id=6215ed1509de45c0905e1b6c8402a01b, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:43.301795 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b69ea-211f-4578-ae4d-9cbfa67eeb82 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:43.315585 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 588/1153] 10.222.0.69 () {58 vars in 1439 bytes} [Mon Aug 29 21:27:43 2022] PUT /identity/v3/projects/ec0f75803598472091c51b3006e0a105/users/6215ed1509de45c0905e1b6c8402a01b/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:27:45.214768 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e54b1-d084-4b52-ae14-d030239d8afd None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:45.215264 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e54b1-d084-4b52-ae14-d030239d8afd None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:45.215356 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e54b1-d084-4b52-ae14-d030239d8afd None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:45.216692 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 566/1154] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:45.221789 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf394a1-bd00-432c-8533-70121b75ff66 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:45.222184 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf394a1-bd00-432c-8533-70121b75ff66 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:45.222341 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf394a1-bd00-432c-8533-70121b75ff66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:45.241010 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-6cf394a1-bd00-432c-8533-70121b75ff66 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:45.242199 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-6cf394a1-bd00-432c-8533-70121b75ff66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:45.259432 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:45.310695 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 589/1155] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:27:45.582231 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e54b1-d084-4b52-ae14-d030239d8afd None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:45.600773 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:45.687324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e54b1-d084-4b52-ae14-d030239d8afd None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:45.720561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac93c4-5cbd-4970-8895-0fd10069789c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:45.721182 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac93c4-5cbd-4970-8895-0fd10069789c None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:45.721463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac93c4-5cbd-4970-8895-0fd10069789c None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:45.721740 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac93c4-5cbd-4970-8895-0fd10069789c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:45.732307 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac93c4-5cbd-4970-8895-0fd10069789c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:45.737334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-97ac93c4-5cbd-4970-8895-0fd10069789c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:45.737334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:45.737334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:45.737334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:45.737334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:45.737334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:45.737334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:45.737334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:45.737334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:45.737334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:45.737334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:45.737334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:45.737334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:45.737334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:45.737334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:45.737334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:45.738526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:45.738526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:45.738526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:45.738526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:45.738526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:45.738526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:45.738526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:45.738526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:45.738526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:45.738526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:45.738526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:45.738526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:45.738526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:45.738526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:45.738526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:45.738526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:45.739839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:45.739839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:45.739839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:45.739839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:45.739839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:45.739839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:45.739839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:45.739839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:45.739839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:45.739839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:45.739839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:45.739839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:27:45.739839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 567/1156] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:27:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:45.744539 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf394a1-bd00-432c-8533-70121b75ff66 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:45.841979 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf394a1-bd00-432c-8533-70121b75ff66 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:45.875932 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f537eb-d607-40c5-8317-095d2d126c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:45.876539 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f537eb-d607-40c5-8317-095d2d126c71 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:45.876818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f537eb-d607-40c5-8317-095d2d126c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:45.877086 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f537eb-d607-40c5-8317-095d2d126c71 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:45.877736 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f537eb-d607-40c5-8317-095d2d126c71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:45.878034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f537eb-d607-40c5-8317-095d2d126c71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:45.879378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f537eb-d607-40c5-8317-095d2d126c71 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:45.887463 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 590/1157] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:45.894475 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac93c4-5cbd-4970-8895-0fd10069789c None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:45.969934 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:45.993665 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac93c4-5cbd-4970-8895-0fd10069789c None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:46.026511 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e072d9c-ed96-41fd-bb5e-7fc6020e916e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:46.027640 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e072d9c-ed96-41fd-bb5e-7fc6020e916e None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:46.027926 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e072d9c-ed96-41fd-bb5e-7fc6020e916e None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:46.028221 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e072d9c-ed96-41fd-bb5e-7fc6020e916e None admin] PATH_INFO: `/v3/users/6215ed1509de45c0905e1b6c8402a01b` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:46.029341 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e072d9c-ed96-41fd-bb5e-7fc6020e916e None admin] RBAC: Authorizing `identity:get_user(user_id=6215ed1509de45c0905e1b6c8402a01b)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:46.030775 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e072d9c-ed96-41fd-bb5e-7fc6020e916e None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:46.032382 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 568/1158] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:45 2022] GET /identity/v3/users/6215ed1509de45c0905e1b6c8402a01b => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:46.038427 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f537eb-d607-40c5-8317-095d2d126c71 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:46.054886 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:46.138139 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f537eb-d607-40c5-8317-095d2d126c71 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:46.175488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1a711-6bc5-4266-9fb5-0088dd850810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:46.176099 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1a711-6bc5-4266-9fb5-0088dd850810 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:46.176401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1a711-6bc5-4266-9fb5-0088dd850810 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:46.176672 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1a711-6bc5-4266-9fb5-0088dd850810 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:46.244152 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1a711-6bc5-4266-9fb5-0088dd850810 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:46.245681 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1a711-6bc5-4266-9fb5-0088dd850810 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:46.259724 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:46.343581 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 591/1159] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:27:46.349558 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e072d9c-ed96-41fd-bb5e-7fc6020e916e None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:46.448213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e072d9c-ed96-41fd-bb5e-7fc6020e916e None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:46.482923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131116d-8377-474c-aa86-017ed41e1a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:46.483558 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131116d-8377-474c-aa86-017ed41e1a75 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:46.483838 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131116d-8377-474c-aa86-017ed41e1a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:46.484112 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131116d-8377-474c-aa86-017ed41e1a75 None admin] PATH_INFO: `/v3/projects/ec0f75803598472091c51b3006e0a105` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:46.485251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4131116d-8377-474c-aa86-017ed41e1a75 None admin] RBAC: Authorizing `identity:get_project(project_id=ec0f75803598472091c51b3006e0a105)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:46.486939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4131116d-8377-474c-aa86-017ed41e1a75 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:46.488610 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 569/1160] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:46 2022] GET /identity/v3/projects/ec0f75803598472091c51b3006e0a105 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:46.494746 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1a711-6bc5-4266-9fb5-0088dd850810 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:46.592755 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1a711-6bc5-4266-9fb5-0088dd850810 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:46.606929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:46.626956 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820e331-ac03-4ecd-aa0a-50c87d39fc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:46.627551 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820e331-ac03-4ecd-aa0a-50c87d39fc1d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:46.627828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820e331-ac03-4ecd-aa0a-50c87d39fc1d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:46.628096 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820e331-ac03-4ecd-aa0a-50c87d39fc1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:46.628831 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820e331-ac03-4ecd-aa0a-50c87d39fc1d None admin] RBAC: Adding query filter params (role.id=69369872661e4179bb51cd1ca76e28c3, scope.project.id=ec0f75803598472091c51b3006e0a105, user.id=6215ed1509de45c0905e1b6c8402a01b) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:46.629138 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820e331-ac03-4ecd-aa0a-50c87d39fc1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:46.630546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820e331-ac03-4ecd-aa0a-50c87d39fc1d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:46.637084 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 592/1161] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:27:46 2022] GET /identity/v3/role_assignments?user.id=6215ed1509de45c0905e1b6c8402a01b&scope.project.id=ec0f75803598472091c51b3006e0a105&role.id=69369872661e4179bb51cd1ca76e28c3 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:48.558118 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9627cdf-57dc-415e-8438-b1a1d2da1f96 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:48.558703 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9627cdf-57dc-415e-8438-b1a1d2da1f96 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:48.558703 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9627cdf-57dc-415e-8438-b1a1d2da1f96 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:48.560503 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 570/1162] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:48.565643 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8cf66-a3c7-4ae5-be76-11f4210df3d2 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:48.566051 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8cf66-a3c7-4ae5-be76-11f4210df3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:48.566195 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8cf66-a3c7-4ae5-be76-11f4210df3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:48.584587 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f6f8cf66-a3c7-4ae5-be76-11f4210df3d2 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:48.585778 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f6f8cf66-a3c7-4ae5-be76-11f4210df3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:48.650920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 593/1163] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:27:48.921928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9627cdf-57dc-415e-8438-b1a1d2da1f96 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:48.937875 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:49.025532 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9627cdf-57dc-415e-8438-b1a1d2da1f96 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:49.059384 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e52801-1f5e-4919-98da-71a4f2c1d7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:49.059982 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e52801-1f5e-4919-98da-71a4f2c1d7fb None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:49.060293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e52801-1f5e-4919-98da-71a4f2c1d7fb None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:49.060567 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e52801-1f5e-4919-98da-71a4f2c1d7fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:49.135308 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e52801-1f5e-4919-98da-71a4f2c1d7fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:49.136822 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e52801-1f5e-4919-98da-71a4f2c1d7fb None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:49.150128 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:49.241057 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 571/1164] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:27:49.247058 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8cf66-a3c7-4ae5-be76-11f4210df3d2 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:49.345637 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8cf66-a3c7-4ae5-be76-11f4210df3d2 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:49.354970 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:49.380137 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b00ee-5e00-474e-8547-60d8ec7d0bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:49.380798 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b00ee-5e00-474e-8547-60d8ec7d0bdb None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:49.381078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b00ee-5e00-474e-8547-60d8ec7d0bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:49.381351 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b00ee-5e00-474e-8547-60d8ec7d0bdb None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:49.388483 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b00ee-5e00-474e-8547-60d8ec7d0bdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:49.389914 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b00ee-5e00-474e-8547-60d8ec7d0bdb None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:49.401242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-5a0b00ee-5e00-474e-8547-60d8ec7d0bdb None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 21:27:49.401242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:49.401242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 21:27:49.401242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 21:27:49.401242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:27:49.401242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:27:49.401242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:27:49.401242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:27:49.401242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 29 21:27:49.401242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:49.401242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:27:49.401242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:49.401242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:49.401242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:49.401242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:49.401242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:49.401242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:49.403131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:49.403131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:49.403131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:49.403131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:49.403131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:49.403131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:49.403131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:27:49.403131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:27:49.403131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:27:49.403131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:27:49.403131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:49.403131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:49.403131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:49.403131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:49.403131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:49.403131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:49.404027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:49.404027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:49.404027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:49.404027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:49.404027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:49.404027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:49.404027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:49.404027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:49.404027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:49.404027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:49.404027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 21:27:49.404027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:27:49.404027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 21:27:49.404027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:27:49.404027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 594/1165] 10.222.0.69 () {56 vars in 1117 bytes} [Mon Aug 29 21:27:49 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:49.409026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e52801-1f5e-4919-98da-71a4f2c1d7fb None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:49.506064 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e52801-1f5e-4919-98da-71a4f2c1d7fb None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:49.519293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:49.541185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8c51e-9e1a-4d66-894e-0aec48dcfd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:49.541791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8c51e-9e1a-4d66-894e-0aec48dcfd01 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:49.542073 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8c51e-9e1a-4d66-894e-0aec48dcfd01 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:49.542348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8c51e-9e1a-4d66-894e-0aec48dcfd01 None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:49.543015 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8c51e-9e1a-4d66-894e-0aec48dcfd01 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:49.543319 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8c51e-9e1a-4d66-894e-0aec48dcfd01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:49.544796 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8c51e-9e1a-4d66-894e-0aec48dcfd01 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:49.552083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 572/1166] 10.222.0.69 () {56 vars in 1115 bytes} [Mon Aug 29 21:27:49 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:51.448890 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263bd16-f24c-4805-9d9b-6ff1aeac68cf None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:51.450005 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263bd16-f24c-4805-9d9b-6ff1aeac68cf None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:51.450117 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263bd16-f24c-4805-9d9b-6ff1aeac68cf None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:51.451389 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 595/1167] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:51.456725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd944f84-b9cb-4f9c-880a-c12814fb1362 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:51.457147 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd944f84-b9cb-4f9c-880a-c12814fb1362 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:51.457241 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd944f84-b9cb-4f9c-880a-c12814fb1362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:51.475056 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-bd944f84-b9cb-4f9c-880a-c12814fb1362 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:51.476294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-bd944f84-b9cb-4f9c-880a-c12814fb1362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:51.545308 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 573/1168] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:27:51.811948 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263bd16-f24c-4805-9d9b-6ff1aeac68cf None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:51.916197 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263bd16-f24c-4805-9d9b-6ff1aeac68cf None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:51.950850 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395df342-c149-4991-b39c-bc91d21719df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:51.951458 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395df342-c149-4991-b39c-bc91d21719df None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:51.951740 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395df342-c149-4991-b39c-bc91d21719df None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:51.952012 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395df342-c149-4991-b39c-bc91d21719df None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:51.952716 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395df342-c149-4991-b39c-bc91d21719df None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:51.954084 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395df342-c149-4991-b39c-bc91d21719df None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:51.970466 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 596/1169] 10.222.0.69 () {60 vars in 1138 bytes} [Mon Aug 29 21:27:51 2022] POST /identity/v3/domains => generated 267 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:27:53.893612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196d16c-8e39-4a09-81ab-268d61c230b6 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:53.894157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196d16c-8e39-4a09-81ab-268d61c230b6 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:53.894157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196d16c-8e39-4a09-81ab-268d61c230b6 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:53.895511 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 574/1170] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:53.900809 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f0ac8-8821-4cd5-aacc-90b27269d42c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:53.901217 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f0ac8-8821-4cd5-aacc-90b27269d42c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:53.901369 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f0ac8-8821-4cd5-aacc-90b27269d42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:53.920287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-452f0ac8-8821-4cd5-aacc-90b27269d42c None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:53.921479 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-452f0ac8-8821-4cd5-aacc-90b27269d42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:53.945400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:53.992073 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 597/1171] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:27:54.271858 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196d16c-8e39-4a09-81ab-268d61c230b6 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:54.371888 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196d16c-8e39-4a09-81ab-268d61c230b6 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:54.379200 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:54.406309 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a90a06-75d5-4a3b-be37-bed0d6ac7dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:54.406950 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a90a06-75d5-4a3b-be37-bed0d6ac7dcc None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:54.407330 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a90a06-75d5-4a3b-be37-bed0d6ac7dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:54.407511 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a90a06-75d5-4a3b-be37-bed0d6ac7dcc None admin] PATH_INFO: `/v3/domains/9256d3ed8eab46e39b54d8c1b742d898` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:54.419200 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a90a06-75d5-4a3b-be37-bed0d6ac7dcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=9256d3ed8eab46e39b54d8c1b742d898)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:54.420710 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a90a06-75d5-4a3b-be37-bed0d6ac7dcc None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:54.422528 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 575/1172] 10.222.0.69 () {56 vars in 1183 bytes} [Mon Aug 29 21:27:54 2022] GET /identity/v3/domains/9256d3ed8eab46e39b54d8c1b742d898 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:54.430818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f0ac8-8821-4cd5-aacc-90b27269d42c None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:54.531571 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f0ac8-8821-4cd5-aacc-90b27269d42c None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:54.564811 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbce98-a54f-45d1-85ee-9682f3a7b4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:54.565407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbce98-a54f-45d1-85ee-9682f3a7b4f7 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:54.565680 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbce98-a54f-45d1-85ee-9682f3a7b4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:54.565944 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbce98-a54f-45d1-85ee-9682f3a7b4f7 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:54.566573 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bbce98-a54f-45d1-85ee-9682f3a7b4f7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:54.567987 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bbce98-a54f-45d1-85ee-9682f3a7b4f7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:54.595321 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 598/1173] 10.222.0.69 () {60 vars in 1141 bytes} [Mon Aug 29 21:27:54 2022] POST /identity/v3/projects => generated 361 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:27:56.549819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00c2d5-5600-4240-af1b-950d7210e8d3 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:56.550321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00c2d5-5600-4240-af1b-950d7210e8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:56.550321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00c2d5-5600-4240-af1b-950d7210e8d3 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:56.551635 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 576/1174] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:56.556897 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81316b16-745d-436c-8788-6423526c85f4 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:56.557317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81316b16-745d-436c-8788-6423526c85f4 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:56.557431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81316b16-745d-436c-8788-6423526c85f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:56.575399 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-81316b16-745d-436c-8788-6423526c85f4 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:56.576628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-81316b16-745d-436c-8788-6423526c85f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:56.579372 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:56.644298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 599/1175] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:27:56.919045 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00c2d5-5600-4240-af1b-950d7210e8d3 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:57.019294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00c2d5-5600-4240-af1b-950d7210e8d3 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:57.052313 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3943c7b-0f6e-43ad-8216-88522b4adf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:57.052936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3943c7b-0f6e-43ad-8216-88522b4adf4d None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:57.053211 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3943c7b-0f6e-43ad-8216-88522b4adf4d None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:57.053479 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3943c7b-0f6e-43ad-8216-88522b4adf4d None admin] PATH_INFO: `/v3/domains/9256d3ed8eab46e39b54d8c1b742d898` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:57.054581 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3943c7b-0f6e-43ad-8216-88522b4adf4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=9256d3ed8eab46e39b54d8c1b742d898)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:57.055992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3943c7b-0f6e-43ad-8216-88522b4adf4d None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:57.057565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 577/1176] 10.222.0.69 () {56 vars in 1183 bytes} [Mon Aug 29 21:27:56 2022] GET /identity/v3/domains/9256d3ed8eab46e39b54d8c1b742d898 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:57.063385 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81316b16-745d-436c-8788-6423526c85f4 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:57.164978 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81316b16-745d-436c-8788-6423526c85f4 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:57.198368 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1835e7a-4e1c-4008-9436-bcf5bff1b461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:57.198906 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1835e7a-4e1c-4008-9436-bcf5bff1b461 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:57.199185 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1835e7a-4e1c-4008-9436-bcf5bff1b461 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:57.199457 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1835e7a-4e1c-4008-9436-bcf5bff1b461 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:57.200731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1835e7a-4e1c-4008-9436-bcf5bff1b461 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:57.202166 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1835e7a-4e1c-4008-9436-bcf5bff1b461 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:57.213175 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:57.224122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 600/1177] 10.222.0.69 () {60 vars in 1132 bytes} [Mon Aug 29 21:27:57 2022] POST /identity/v3/users => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:27:59.198354 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c178d-2a00-49da-bf22-366e07ab6946 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:59.198896 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c178d-2a00-49da-bf22-366e07ab6946 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:59.198896 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c178d-2a00-49da-bf22-366e07ab6946 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:59.200793 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 578/1178] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:59.206464 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc8477-cd67-4ee1-837d-b007d66a8cce None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:59.206464 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc8477-cd67-4ee1-837d-b007d66a8cce None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:59.206919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc8477-cd67-4ee1-837d-b007d66a8cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:59.225398 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-98bc8477-cd67-4ee1-837d-b007d66a8cce None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:59.226587 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-98bc8477-cd67-4ee1-837d-b007d66a8cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:59.295395 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 601/1179] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:27:59.566407 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c178d-2a00-49da-bf22-366e07ab6946 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:59.600818 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:59.667239 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c178d-2a00-49da-bf22-366e07ab6946 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:59.701081 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad452d-5f99-4040-881b-5fe43fbf2400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:59.701700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad452d-5f99-4040-881b-5fe43fbf2400 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:59.701976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad452d-5f99-4040-881b-5fe43fbf2400 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:59.702247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad452d-5f99-4040-881b-5fe43fbf2400 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:59.712131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad452d-5f99-4040-881b-5fe43fbf2400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:59.717374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-8dad452d-5f99-4040-881b-5fe43fbf2400 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:59.717374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:59.717374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:59.717374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:59.717374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:59.717374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:59.717374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:59.717374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:59.717374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:59.717374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:59.717374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:59.717374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:59.717374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:59.717374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:59.717374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:59.717374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:59.718752 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:59.718752 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:59.718752 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:59.718752 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:59.718752 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:59.718752 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:59.718752 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:59.718752 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:59.718752 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:59.718752 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:59.718752 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:59.718752 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:59.718752 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:59.718752 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:59.718752 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:59.718752 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:59.719636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:59.719636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:59.719636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:59.719636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:59.719636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:59.719636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:59.719636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:59.719636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:59.719636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:59.719636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:59.719636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:59.719636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:27:59.719636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 579/1180] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:27:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:59.724618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc8477-cd67-4ee1-837d-b007d66a8cce None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:59.825185 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc8477-cd67-4ee1-837d-b007d66a8cce None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:59.850381 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:59.860261 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4928ef-5e06-4662-b424-05851dae2124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:59.861535 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4928ef-5e06-4662-b424-05851dae2124 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:59.862158 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4928ef-5e06-4662-b424-05851dae2124 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:59.862451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4928ef-5e06-4662-b424-05851dae2124 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:59.863176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4928ef-5e06-4662-b424-05851dae2124 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:59.863485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4928ef-5e06-4662-b424-05851dae2124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:59.864893 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4928ef-5e06-4662-b424-05851dae2124 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:59.874386 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 602/1181] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:59.880327 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad452d-5f99-4040-881b-5fe43fbf2400 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:59.980976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:59.988965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad452d-5f99-4040-881b-5fe43fbf2400 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:00.022452 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707d810-de2d-46d8-849f-d7f019cc06ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:00.023070 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707d810-de2d-46d8-849f-d7f019cc06ab None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:00.023349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707d810-de2d-46d8-849f-d7f019cc06ab None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:00.023667 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707d810-de2d-46d8-849f-d7f019cc06ab None admin] PATH_INFO: `/v3/users/6d5d6189bfed4339992399d67dc7a267` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:00.036956 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707d810-de2d-46d8-849f-d7f019cc06ab None admin] RBAC: Authorizing `identity:get_user(user_id=6d5d6189bfed4339992399d67dc7a267)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:00.038401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707d810-de2d-46d8-849f-d7f019cc06ab None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:00.040032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 580/1182] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:59 2022] GET /identity/v3/users/6d5d6189bfed4339992399d67dc7a267 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:00.046838 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4928ef-5e06-4662-b424-05851dae2124 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:00.147794 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4928ef-5e06-4662-b424-05851dae2124 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:00.182023 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4cbc0-8eb9-4a83-adae-d6c55db9d535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:00.182632 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4cbc0-8eb9-4a83-adae-d6c55db9d535 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:00.182916 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4cbc0-8eb9-4a83-adae-d6c55db9d535 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:00.183188 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4cbc0-8eb9-4a83-adae-d6c55db9d535 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:00.243673 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:00.256142 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4cbc0-8eb9-4a83-adae-d6c55db9d535 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:00.257656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4cbc0-8eb9-4a83-adae-d6c55db9d535 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:00.355516 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 603/1183] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:28:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 21:28:00.362330 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707d810-de2d-46d8-849f-d7f019cc06ab None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:00.464464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707d810-de2d-46d8-849f-d7f019cc06ab None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:00.498995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ab9b7-0fc3-41d3-a3de-6a57af7e695f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:00.499621 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ab9b7-0fc3-41d3-a3de-6a57af7e695f None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:00.499901 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ab9b7-0fc3-41d3-a3de-6a57af7e695f None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:00.500205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ab9b7-0fc3-41d3-a3de-6a57af7e695f None admin] PATH_INFO: `/v3/projects/23f326103597442ca9608495c337efed` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:00.501320 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ab9b7-0fc3-41d3-a3de-6a57af7e695f None admin] RBAC: Authorizing `identity:get_project(project_id=23f326103597442ca9608495c337efed)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:00.502758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ab9b7-0fc3-41d3-a3de-6a57af7e695f None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:00.504417 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 581/1184] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:28:00 2022] GET /identity/v3/projects/23f326103597442ca9608495c337efed => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:00.510640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4cbc0-8eb9-4a83-adae-d6c55db9d535 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:00.597407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:00.609959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4cbc0-8eb9-4a83-adae-d6c55db9d535 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:00.643498 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99288f3a-19e2-4e17-899f-01169db684ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:00.644090 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99288f3a-19e2-4e17-899f-01169db684ad None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:00.644398 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99288f3a-19e2-4e17-899f-01169db684ad None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:00.644670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99288f3a-19e2-4e17-899f-01169db684ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:00.645388 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99288f3a-19e2-4e17-899f-01169db684ad None admin] RBAC: Adding query filter params (role.id=69369872661e4179bb51cd1ca76e28c3, scope.project.id=23f326103597442ca9608495c337efed, user.id=6d5d6189bfed4339992399d67dc7a267) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:00.645694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99288f3a-19e2-4e17-899f-01169db684ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:00.647122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99288f3a-19e2-4e17-899f-01169db684ad None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:00.652440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 604/1185] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:28:00 2022] GET /identity/v3/role_assignments?user.id=6d5d6189bfed4339992399d67dc7a267&scope.project.id=23f326103597442ca9608495c337efed&role.id=69369872661e4179bb51cd1ca76e28c3 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:02.541989 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afea86b-d12d-4d9a-b24b-1f242c89a962 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:02.542503 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afea86b-d12d-4d9a-b24b-1f242c89a962 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:02.542503 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afea86b-d12d-4d9a-b24b-1f242c89a962 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:02.543779 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 582/1186] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:02.549099 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ddace-683e-4019-b314-66c2a47f27fa None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:02.549505 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ddace-683e-4019-b314-66c2a47f27fa None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:02.549654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ddace-683e-4019-b314-66c2a47f27fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:02.568008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-676ddace-683e-4019-b314-66c2a47f27fa None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:02.569221 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-676ddace-683e-4019-b314-66c2a47f27fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:02.634403 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 605/1187] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:28:02.903030 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afea86b-d12d-4d9a-b24b-1f242c89a962 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:02.925351 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:03.006451 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afea86b-d12d-4d9a-b24b-1f242c89a962 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:03.042245 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66bd17-7bdb-4ad1-b5a6-701790ae988d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:03.042870 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66bd17-7bdb-4ad1-b5a6-701790ae988d None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:03.043154 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66bd17-7bdb-4ad1-b5a6-701790ae988d None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:03.043426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66bd17-7bdb-4ad1-b5a6-701790ae988d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:03.053310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66bd17-7bdb-4ad1-b5a6-701790ae988d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:28:03.058090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-0a66bd17-7bdb-4ad1-b5a6-701790ae988d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:28:03.058090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:03.058090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:03.058090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:03.058090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:03.058090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:03.058090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:03.058090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:03.058090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:03.058090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:03.058090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:03.058090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:03.058090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:28:03.058090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:28:03.058090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:28:03.058090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:28:03.060333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:28:03.060333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:28:03.060333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:28:03.060333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:28:03.060333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:03.060333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:03.060333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:03.060333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:03.060333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:03.060333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:03.060333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:03.060333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:03.060333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:03.060333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:03.060333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:03.060333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:03.061437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:03.061437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:03.061437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:03.061437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:03.061437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:28:03.061437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:28:03.061437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:28:03.061437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:28:03.061437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:28:03.061437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:28:03.061437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:28:03.061437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:28:03.061437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 583/1188] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:28:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:03.065361 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ddace-683e-4019-b314-66c2a47f27fa None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:03.146718 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:03.165733 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ddace-683e-4019-b314-66c2a47f27fa None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:03.199659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10cc53-3242-4c14-877b-474a91e858e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:03.200858 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10cc53-3242-4c14-877b-474a91e858e5 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:03.201139 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10cc53-3242-4c14-877b-474a91e858e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:03.201408 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10cc53-3242-4c14-877b-474a91e858e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:03.202065 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10cc53-3242-4c14-877b-474a91e858e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:03.202367 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10cc53-3242-4c14-877b-474a91e858e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:03.203730 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10cc53-3242-4c14-877b-474a91e858e5 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:03.212100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 606/1189] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:28:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:03.218089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66bd17-7bdb-4ad1-b5a6-701790ae988d None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:03.297429 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:03.319605 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66bd17-7bdb-4ad1-b5a6-701790ae988d None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:03.354582 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7c254-63cc-43b7-84d7-8db9eabda2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:03.355203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7c254-63cc-43b7-84d7-8db9eabda2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:03.355477 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7c254-63cc-43b7-84d7-8db9eabda2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:03.355748 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7c254-63cc-43b7-84d7-8db9eabda2a1 None admin] PATH_INFO: `/v3/users/6d5d6189bfed4339992399d67dc7a267` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:03.356895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7c254-63cc-43b7-84d7-8db9eabda2a1 None admin] RBAC: Authorizing `identity:get_user(user_id=6d5d6189bfed4339992399d67dc7a267)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:03.358312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7c254-63cc-43b7-84d7-8db9eabda2a1 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:03.359859 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 584/1190] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:28:03 2022] GET /identity/v3/users/6d5d6189bfed4339992399d67dc7a267 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:03.366118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10cc53-3242-4c14-877b-474a91e858e5 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:03.467173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10cc53-3242-4c14-877b-474a91e858e5 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:03.500916 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d31abd-8a52-4987-8e8a-ffc83e175fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:03.501571 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d31abd-8a52-4987-8e8a-ffc83e175fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:03.501851 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d31abd-8a52-4987-8e8a-ffc83e175fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:03.502133 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d31abd-8a52-4987-8e8a-ffc83e175fc2 None admin] PATH_INFO: `/v3/projects/23f326103597442ca9608495c337efed` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:03.503277 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d31abd-8a52-4987-8e8a-ffc83e175fc2 None admin] RBAC: Authorizing `identity:get_project(project_id=23f326103597442ca9608495c337efed)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:03.504852 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d31abd-8a52-4987-8e8a-ffc83e175fc2 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:03.506501 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 607/1191] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:28:03 2022] GET /identity/v3/projects/23f326103597442ca9608495c337efed => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:03.513184 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7c254-63cc-43b7-84d7-8db9eabda2a1 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:03.611818 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7c254-63cc-43b7-84d7-8db9eabda2a1 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:03.644756 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91b03b-f6ec-4538-a29b-ade6bf30d3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:03.645404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91b03b-f6ec-4538-a29b-ade6bf30d3af None admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:03.645683 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91b03b-f6ec-4538-a29b-ade6bf30d3af None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:03.645955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91b03b-f6ec-4538-a29b-ade6bf30d3af None admin] PATH_INFO: `/v3/projects/23f326103597442ca9608495c337efed/users/6d5d6189bfed4339992399d67dc7a267/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:03.647835 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91b03b-f6ec-4538-a29b-ade6bf30d3af None admin] RBAC: Authorizing `identity:create_grant(project_id=23f326103597442ca9608495c337efed, user_id=6d5d6189bfed4339992399d67dc7a267, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:03.649285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91b03b-f6ec-4538-a29b-ade6bf30d3af None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:03.662495 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 585/1192] 10.222.0.69 () {58 vars in 1439 bytes} [Mon Aug 29 21:28:03 2022] PUT /identity/v3/projects/23f326103597442ca9608495c337efed/users/6d5d6189bfed4339992399d67dc7a267/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:28:05.557112 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46c8f2-0a13-46bf-8162-bb7dd80476d5 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:05.557640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46c8f2-0a13-46bf-8162-bb7dd80476d5 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:05.557640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46c8f2-0a13-46bf-8162-bb7dd80476d5 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:05.558923 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 608/1193] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:05.564099 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94529e6-279e-4d49-b6c7-cbdfb20595d4 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:05.564527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94529e6-279e-4d49-b6c7-cbdfb20595d4 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:05.564773 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94529e6-279e-4d49-b6c7-cbdfb20595d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:05.584048 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-b94529e6-279e-4d49-b6c7-cbdfb20595d4 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:05.585305 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-b94529e6-279e-4d49-b6c7-cbdfb20595d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:05.587335 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:05.654311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 586/1194] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:28:05.924203 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46c8f2-0a13-46bf-8162-bb7dd80476d5 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:05.940238 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:06.027478 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46c8f2-0a13-46bf-8162-bb7dd80476d5 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:06.061240 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5a0c5-c5ba-41af-96a0-2e9807a48ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:06.061865 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5a0c5-c5ba-41af-96a0-2e9807a48ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:06.062148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5a0c5-c5ba-41af-96a0-2e9807a48ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:06.062421 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5a0c5-c5ba-41af-96a0-2e9807a48ab0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:06.073082 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5a0c5-c5ba-41af-96a0-2e9807a48ab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:28:06.077947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-e3c5a0c5-c5ba-41af-96a0-2e9807a48ab0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:28:06.077947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:06.077947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:06.077947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:06.077947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:06.077947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:06.077947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:06.077947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:06.077947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:06.077947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:06.077947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:06.077947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:06.077947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:28:06.077947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:28:06.077947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:28:06.077947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:28:06.079091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:28:06.079091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:28:06.079091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:28:06.079091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:28:06.079091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:06.079091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:06.079091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:06.079091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:06.079091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:06.079091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:06.079091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:06.079091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:06.079091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:06.079091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:06.079091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:06.079091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:06.079961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:06.079961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:06.079961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:06.079961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:06.079961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:28:06.079961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:28:06.079961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:28:06.079961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:28:06.079961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:28:06.079961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:28:06.079961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:28:06.079961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:28:06.079961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 609/1195] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:28:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:06.085282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94529e6-279e-4d49-b6c7-cbdfb20595d4 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:06.184236 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94529e6-279e-4d49-b6c7-cbdfb20595d4 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:06.218857 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d7032-253b-412f-ac95-2f548882a255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:06.219470 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d7032-253b-412f-ac95-2f548882a255 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:06.219751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d7032-253b-412f-ac95-2f548882a255 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:06.220027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d7032-253b-412f-ac95-2f548882a255 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:06.220720 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d7032-253b-412f-ac95-2f548882a255 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:06.221026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d7032-253b-412f-ac95-2f548882a255 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:06.222390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d7032-253b-412f-ac95-2f548882a255 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:06.227374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:06.231020 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 587/1196] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:28:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:06.237002 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5a0c5-c5ba-41af-96a0-2e9807a48ab0 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:06.310508 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:06.342681 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5a0c5-c5ba-41af-96a0-2e9807a48ab0 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:06.378332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cbd07-d4ec-4e72-a080-836932ba9067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:06.378971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cbd07-d4ec-4e72-a080-836932ba9067 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:06.379248 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cbd07-d4ec-4e72-a080-836932ba9067 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:06.379693 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cbd07-d4ec-4e72-a080-836932ba9067 None admin] PATH_INFO: `/v3/users/6d5d6189bfed4339992399d67dc7a267` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:06.381618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79cbd07-d4ec-4e72-a080-836932ba9067 None admin] RBAC: Authorizing `identity:get_user(user_id=6d5d6189bfed4339992399d67dc7a267)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:06.384357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79cbd07-d4ec-4e72-a080-836932ba9067 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:06.392762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 610/1197] 10.222.0.69 () {56 vars in 1177 bytes} [Mon Aug 29 21:28:06 2022] GET /identity/v3/users/6d5d6189bfed4339992399d67dc7a267 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:06.393977 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d7032-253b-412f-ac95-2f548882a255 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:06.497639 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d7032-253b-412f-ac95-2f548882a255 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:06.532303 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d392d10-122d-4461-8b47-db1819448204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:06.532939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d392d10-122d-4461-8b47-db1819448204 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:06.533227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d392d10-122d-4461-8b47-db1819448204 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:06.533505 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d392d10-122d-4461-8b47-db1819448204 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:06.598916 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:06.601185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d392d10-122d-4461-8b47-db1819448204 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:06.602947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d392d10-122d-4461-8b47-db1819448204 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:06.701309 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 588/1198] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:28:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:28:06.707210 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cbd07-d4ec-4e72-a080-836932ba9067 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:06.805769 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cbd07-d4ec-4e72-a080-836932ba9067 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:06.838655 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786954ec-8b3f-4a12-b98c-ab0682f49cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:06.839268 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786954ec-8b3f-4a12-b98c-ab0682f49cef None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:06.839547 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786954ec-8b3f-4a12-b98c-ab0682f49cef None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:06.839820 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786954ec-8b3f-4a12-b98c-ab0682f49cef None admin] PATH_INFO: `/v3/projects/23f326103597442ca9608495c337efed` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:06.840953 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786954ec-8b3f-4a12-b98c-ab0682f49cef None admin] RBAC: Authorizing `identity:get_project(project_id=23f326103597442ca9608495c337efed)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:06.842366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786954ec-8b3f-4a12-b98c-ab0682f49cef None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:06.843981 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 611/1199] 10.222.0.69 () {56 vars in 1186 bytes} [Mon Aug 29 21:28:06 2022] GET /identity/v3/projects/23f326103597442ca9608495c337efed => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:06.850161 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d392d10-122d-4461-8b47-db1819448204 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:06.945734 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:06.948565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d392d10-122d-4461-8b47-db1819448204 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:06.992246 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458da1ab-ede0-4bfb-811d-c69a1888281b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:06.992834 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458da1ab-ede0-4bfb-811d-c69a1888281b None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:06.993112 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458da1ab-ede0-4bfb-811d-c69a1888281b None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:06.993376 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458da1ab-ede0-4bfb-811d-c69a1888281b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:06.994097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458da1ab-ede0-4bfb-811d-c69a1888281b None admin] RBAC: Adding query filter params (role.id=69369872661e4179bb51cd1ca76e28c3, scope.project.id=23f326103597442ca9608495c337efed, user.id=6d5d6189bfed4339992399d67dc7a267) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:06.994399 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458da1ab-ede0-4bfb-811d-c69a1888281b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:06.995814 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458da1ab-ede0-4bfb-811d-c69a1888281b None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:07.001795 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 589/1200] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:28:06 2022] GET /identity/v3/role_assignments?user.id=6d5d6189bfed4339992399d67dc7a267&scope.project.id=23f326103597442ca9608495c337efed&role.id=69369872661e4179bb51cd1ca76e28c3 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:16.834360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=96 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:16.999283 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=18 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:03.417184 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14ecd3-cc74-4ade-9b91-dc0763a64400 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:03.417798 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14ecd3-cc74-4ade-9b91-dc0763a64400 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:03.417798 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14ecd3-cc74-4ade-9b91-dc0763a64400 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:03.419108 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 612/1201] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:03.425992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e00e5-b35f-45fd-9cb9-6321b035fa9a None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:03.426484 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e00e5-b35f-45fd-9cb9-6321b035fa9a None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:03.426572 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e00e5-b35f-45fd-9cb9-6321b035fa9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:03.450838 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-211e00e5-b35f-45fd-9cb9-6321b035fa9a None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:03.452092 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-211e00e5-b35f-45fd-9cb9-6321b035fa9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:03.541302 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 590/1202] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:03.811085 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14ecd3-cc74-4ade-9b91-dc0763a64400 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:03.960305 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14ecd3-cc74-4ade-9b91-dc0763a64400 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:04.013310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d2a69-e63e-471d-ac3a-b6d1cf854f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:04.013959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d2a69-e63e-471d-ac3a-b6d1cf854f69 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:04.014819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d2a69-e63e-471d-ac3a-b6d1cf854f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:04.015103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d2a69-e63e-471d-ac3a-b6d1cf854f69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:04.027638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d2a69-e63e-471d-ac3a-b6d1cf854f69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:04.029221 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d2a69-e63e-471d-ac3a-b6d1cf854f69 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:04.050870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-e34d2a69-e63e-471d-ac3a-b6d1cf854f69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:04.050870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:04.050870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:04.050870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:04.050870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:04.050870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:04.050870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:04.050870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:04.050870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:04.050870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:04.050870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:04.050870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:04.050870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:04.050870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:04.050870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:04.050870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:04.062170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:04.062170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:04.062170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:04.062170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:04.062170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:04.062170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:04.062170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:04.062170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:04.062170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:04.062170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:04.062170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:04.062170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:04.062170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:04.062170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:04.062170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:04.062170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:04.062170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:04.064459 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:04.064459 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:04.064459 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:29:04.064459 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 613/1203] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:04.069888 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e00e5-b35f-45fd-9cb9-6321b035fa9a None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:04.208909 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e00e5-b35f-45fd-9cb9-6321b035fa9a None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:04.258467 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:04.268445 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e6551-2e7e-4b3b-b4ce-7c099816a976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:04.269075 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e6551-2e7e-4b3b-b4ce-7c099816a976 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:04.269359 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e6551-2e7e-4b3b-b4ce-7c099816a976 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:04.269640 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e6551-2e7e-4b3b-b4ce-7c099816a976 None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:04.270294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e6551-2e7e-4b3b-b4ce-7c099816a976 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:04.270605 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e6551-2e7e-4b3b-b4ce-7c099816a976 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:04.272075 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e6551-2e7e-4b3b-b4ce-7c099816a976 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:04.285319 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 591/1204] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:04.293243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d2a69-e63e-471d-ac3a-b6d1cf854f69 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:04.365073 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:04.434266 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d2a69-e63e-471d-ac3a-b6d1cf854f69 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:04.489147 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d9306-ed88-4f78-9311-a2540dd39eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:04.490144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d9306-ed88-4f78-9311-a2540dd39eca None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:04.490904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d9306-ed88-4f78-9311-a2540dd39eca None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:04.491403 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d9306-ed88-4f78-9311-a2540dd39eca None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:04.492389 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d9306-ed88-4f78-9311-a2540dd39eca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:04.494119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d9306-ed88-4f78-9311-a2540dd39eca None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:04.528257 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 614/1205] 10.222.0.69 () {60 vars in 1132 bytes} [Mon Aug 29 21:29:04 2022] POST /identity/v3/users => generated 251 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:06.708040 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161edfeb-5180-4986-b3d8-c08022376174 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:06.708620 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161edfeb-5180-4986-b3d8-c08022376174 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:06.708620 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161edfeb-5180-4986-b3d8-c08022376174 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:06.710039 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 592/1206] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:06.716215 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef866237-e6ad-417b-a3fd-ac66316887ba None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:06.716215 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef866237-e6ad-417b-a3fd-ac66316887ba None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:06.716808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef866237-e6ad-417b-a3fd-ac66316887ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:06.736652 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ef866237-e6ad-417b-a3fd-ac66316887ba None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:06.737955 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ef866237-e6ad-417b-a3fd-ac66316887ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:06.828573 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 615/1207] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:07.099843 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161edfeb-5180-4986-b3d8-c08022376174 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:07.234398 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161edfeb-5180-4986-b3d8-c08022376174 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:07.280959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb37cc-c2bd-495d-ac97-3ff116614c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:07.281767 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb37cc-c2bd-495d-ac97-3ff116614c4d None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:07.282093 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb37cc-c2bd-495d-ac97-3ff116614c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:07.282344 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb37cc-c2bd-495d-ac97-3ff116614c4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:07.294519 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb37cc-c2bd-495d-ac97-3ff116614c4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:29:07.299983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-0bcb37cc-c2bd-495d-ac97-3ff116614c4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:29:07.299983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:07.299983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:07.299983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:07.299983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:07.299983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:07.299983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:07.299983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:07.299983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:07.299983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:07.299983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:07.299983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:07.299983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:29:07.299983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:29:07.299983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:29:07.299983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:29:07.301230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:29:07.301230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:29:07.301230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:29:07.301230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:29:07.301230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:07.301230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:07.301230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:07.301230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:07.301230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:07.301230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:07.301230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:07.301230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:07.301230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:07.301230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:07.301230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:07.301230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:07.302251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:07.302251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:07.302251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:07.302251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:07.302251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:29:07.302251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:29:07.302251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:29:07.302251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:29:07.302251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:29:07.302251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:29:07.302251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:29:07.302251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:29:07.302251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 593/1208] 10.222.0.69 () {56 vars in 1102 bytes} [Mon Aug 29 21:29:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:07.307390 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef866237-e6ad-417b-a3fd-ac66316887ba None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:07.355588 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:07.441698 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef866237-e6ad-417b-a3fd-ac66316887ba None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:07.487634 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7474d4a-93e9-435e-9dc2-9ec8de616cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:07.488814 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7474d4a-93e9-435e-9dc2-9ec8de616cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:07.489093 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7474d4a-93e9-435e-9dc2-9ec8de616cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:07.489603 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7474d4a-93e9-435e-9dc2-9ec8de616cd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:07.490288 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7474d4a-93e9-435e-9dc2-9ec8de616cd2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:07.490852 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7474d4a-93e9-435e-9dc2-9ec8de616cd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:07.492314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7474d4a-93e9-435e-9dc2-9ec8de616cd2 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:07.503595 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 616/1209] 10.222.0.69 () {56 vars in 1103 bytes} [Mon Aug 29 21:29:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:07.510061 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb37cc-c2bd-495d-ac97-3ff116614c4d None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:07.576254 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:07.654617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb37cc-c2bd-495d-ac97-3ff116614c4d None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:07.696492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5502489-6d5e-45eb-957a-616a47abbcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:07.697285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5502489-6d5e-45eb-957a-616a47abbcf7 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:07.697566 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5502489-6d5e-45eb-957a-616a47abbcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:07.697882 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5502489-6d5e-45eb-957a-616a47abbcf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:07.711433 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5502489-6d5e-45eb-957a-616a47abbcf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:07.713758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5502489-6d5e-45eb-957a-616a47abbcf7 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:07.731981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-b5502489-6d5e-45eb-957a-616a47abbcf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:07.731981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:07.731981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:07.731981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:07.731981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:07.731981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:07.731981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:07.731981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:07.731981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:07.731981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:07.731981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:07.731981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:07.731981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:07.731981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:07.731981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:07.731981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:07.733196 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:07.733196 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:07.733196 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:07.733196 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:07.733196 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:07.733196 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:07.733196 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:07.733196 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:07.733196 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:07.733196 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:07.733196 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:07.733196 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:07.733196 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:07.733196 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:07.733196 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:07.733196 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:07.733196 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:07.734653 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:07.734653 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:07.734653 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:29:07.734653 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 594/1210] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:07.739807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7474d4a-93e9-435e-9dc2-9ec8de616cd2 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:07.873214 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:07.877301 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7474d4a-93e9-435e-9dc2-9ec8de616cd2 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:07.925229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540c506-48c8-4c98-b1bb-649a8d8e5be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:07.925978 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540c506-48c8-4c98-b1bb-649a8d8e5be2 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:07.926262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540c506-48c8-4c98-b1bb-649a8d8e5be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:07.926702 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540c506-48c8-4c98-b1bb-649a8d8e5be2 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:07.927460 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540c506-48c8-4c98-b1bb-649a8d8e5be2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:07.927914 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540c506-48c8-4c98-b1bb-649a8d8e5be2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:07.930121 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540c506-48c8-4c98-b1bb-649a8d8e5be2 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:07.946496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 617/1211] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:07.954979 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5502489-6d5e-45eb-957a-616a47abbcf7 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:08.080301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5502489-6d5e-45eb-957a-616a47abbcf7 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:08.083000 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:08.125185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a386c-ccfe-4a59-9b66-92ef3657a5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:08.126111 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a386c-ccfe-4a59-9b66-92ef3657a5b5 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:08.126494 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a386c-ccfe-4a59-9b66-92ef3657a5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:08.126892 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a386c-ccfe-4a59-9b66-92ef3657a5b5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:08.141831 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a386c-ccfe-4a59-9b66-92ef3657a5b5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:08.144778 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a386c-ccfe-4a59-9b66-92ef3657a5b5 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:08.158913 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-bc4a386c-ccfe-4a59-9b66-92ef3657a5b5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:29:08.158913 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:08.158913 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:08.158913 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:08.158913 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:08.158913 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:08.158913 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:08.158913 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:08.158913 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:08.158913 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:08.158913 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:08.158913 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:08.158913 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:29:08.158913 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:29:08.158913 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:29:08.158913 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:29:08.165678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:08.165678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:08.165678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:29:08.165678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:08.165678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:29:08.165678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:08.165678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:08.165678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:08.165678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:08.165678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:08.165678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:08.165678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:08.165678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:08.165678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:08.165678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:08.165678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:08.165678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:08.165678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:08.175701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:08.175701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:08.175701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:29:08.175701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:29:08.175701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:29:08.175701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:29:08.175701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:29:08.175701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:29:08.175701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:29:08.175701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:29:08.175701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 595/1212] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:08.176706 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540c506-48c8-4c98-b1bb-649a8d8e5be2 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:08.319250 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540c506-48c8-4c98-b1bb-649a8d8e5be2 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:08.364171 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d36f68-d7eb-4437-85d4-09bee14b4973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:08.364895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d36f68-d7eb-4437-85d4-09bee14b4973 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:08.365179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d36f68-d7eb-4437-85d4-09bee14b4973 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:08.365461 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d36f68-d7eb-4437-85d4-09bee14b4973 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:08.366500 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d36f68-d7eb-4437-85d4-09bee14b4973 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:08.366818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d36f68-d7eb-4437-85d4-09bee14b4973 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:08.368398 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d36f68-d7eb-4437-85d4-09bee14b4973 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:08.394566 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 618/1213] 10.222.0.69 () {56 vars in 1143 bytes} [Mon Aug 29 21:29:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:08.401080 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a386c-ccfe-4a59-9b66-92ef3657a5b5 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:08.542832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a386c-ccfe-4a59-9b66-92ef3657a5b5 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:08.585699 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f20eb0-a780-4486-a519-32654da26d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:08.586388 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f20eb0-a780-4486-a519-32654da26d43 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:08.586672 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f20eb0-a780-4486-a519-32654da26d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:08.586944 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f20eb0-a780-4486-a519-32654da26d43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:08.627360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:08.677075 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f20eb0-a780-4486-a519-32654da26d43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:08.677075 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f20eb0-a780-4486-a519-32654da26d43 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:08.792524 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 596/1214] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:29:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 21:29:08.793900 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d36f68-d7eb-4437-85d4-09bee14b4973 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:08.814965 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:08.918248 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d36f68-d7eb-4437-85d4-09bee14b4973 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:08.967964 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445ee7e-3f4e-41fd-ba3f-a33e49473efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:08.968737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445ee7e-3f4e-41fd-ba3f-a33e49473efe None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:08.969050 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445ee7e-3f4e-41fd-ba3f-a33e49473efe None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:08.969709 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445ee7e-3f4e-41fd-ba3f-a33e49473efe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:08.983596 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e445ee7e-3f4e-41fd-ba3f-a33e49473efe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:08.986300 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e445ee7e-3f4e-41fd-ba3f-a33e49473efe None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:09.001624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-e445ee7e-3f4e-41fd-ba3f-a33e49473efe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:09.001624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:09.001624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:09.001624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:09.001624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:09.001624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:09.001624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:09.001624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:09.001624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:09.001624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:09.001624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:09.001624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:09.001624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:09.001624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:09.001624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:09.001624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:09.002818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:09.002818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:09.002818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:09.002818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:09.002818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:09.002818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:09.002818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:09.002818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:09.002818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:09.002818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:09.002818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:09.002818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:09.002818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:09.002818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:09.002818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:09.002818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:09.002818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:09.003957 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:09.003957 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:09.003957 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:29:09.010026 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 619/1215] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:09.011145 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f20eb0-a780-4486-a519-32654da26d43 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:09.085290 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:09.129876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f20eb0-a780-4486-a519-32654da26d43 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:09.174204 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ee5d9-8644-4bb6-9e5e-92a5a280edc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:09.174825 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ee5d9-8644-4bb6-9e5e-92a5a280edc9 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:09.175398 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ee5d9-8644-4bb6-9e5e-92a5a280edc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:09.175712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ee5d9-8644-4bb6-9e5e-92a5a280edc9 None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:09.176428 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ee5d9-8644-4bb6-9e5e-92a5a280edc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:09.176730 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ee5d9-8644-4bb6-9e5e-92a5a280edc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:09.178107 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ee5d9-8644-4bb6-9e5e-92a5a280edc9 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:09.192091 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 597/1216] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:09.197979 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445ee7e-3f4e-41fd-ba3f-a33e49473efe None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:09.285930 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:09.342239 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445ee7e-3f4e-41fd-ba3f-a33e49473efe None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:09.390911 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f476ca5-522f-4d5d-896e-abb65999fdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:09.391555 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f476ca5-522f-4d5d-896e-abb65999fdba None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:09.391835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f476ca5-522f-4d5d-896e-abb65999fdba None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:09.392103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f476ca5-522f-4d5d-896e-abb65999fdba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:09.401098 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f476ca5-522f-4d5d-896e-abb65999fdba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:09.402833 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f476ca5-522f-4d5d-896e-abb65999fdba None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:09.423295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-8f476ca5-522f-4d5d-896e-abb65999fdba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:09.423295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:09.423295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:09.423295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:09.423295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:09.423295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:09.423295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:09.423295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:09.423295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:09.423295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:09.423295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:09.423295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:09.423295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:29:09.423295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:29:09.423295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:29:09.424407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:29:09.424407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:09.424407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:09.424407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:09.424407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:09.424407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:09.424407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:09.424407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:09.424407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:09.424407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:09.424407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:09.424407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:09.424407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:09.424407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:09.424407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:09.424407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:09.424407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:09.425430 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:29:09.425430 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:29:09.425430 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:29:09.425430 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:29:09.425430 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:29:09.425430 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:29:09.425430 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:09.425430 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:29:09.429326 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 620/1217] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:29:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:09.431720 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ee5d9-8644-4bb6-9e5e-92a5a280edc9 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:09.572940 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ee5d9-8644-4bb6-9e5e-92a5a280edc9 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:09.610263 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:09.627650 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bab93-38e7-4793-a697-4ee0e84b4dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:09.628338 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bab93-38e7-4793-a697-4ee0e84b4dec None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:09.628625 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bab93-38e7-4793-a697-4ee0e84b4dec None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:09.628902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bab93-38e7-4793-a697-4ee0e84b4dec None admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:09.629602 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6bab93-38e7-4793-a697-4ee0e84b4dec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:09.629917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6bab93-38e7-4793-a697-4ee0e84b4dec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:09.631352 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6bab93-38e7-4793-a697-4ee0e84b4dec None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:09.645439 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 598/1218] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:29:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:09.651802 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f476ca5-522f-4d5d-896e-abb65999fdba None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:09.772720 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f476ca5-522f-4d5d-896e-abb65999fdba None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:09.802819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:09.809438 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8c2d5-9be3-4611-94ae-708c1ab173d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:09.810051 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8c2d5-9be3-4611-94ae-708c1ab173d4 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:09.810332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8c2d5-9be3-4611-94ae-708c1ab173d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:09.810637 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8c2d5-9be3-4611-94ae-708c1ab173d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:09.812114 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8c2d5-9be3-4611-94ae-708c1ab173d4 None admin] RBAC: Adding query filter params (role.id=3766508ffa094bb5bbec6d9209745261, scope.project.id=a302406c548c43c983625c0d66da47cc, user.id=a7911672bb2a471daf4f69ba940ef41d) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:09.812446 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8c2d5-9be3-4611-94ae-708c1ab173d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:09.813992 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8c2d5-9be3-4611-94ae-708c1ab173d4 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:09.820834 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 621/1219] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:29:09 2022] GET /identity/v3/role_assignments?user.id=a7911672bb2a471daf4f69ba940ef41d&scope.project.id=a302406c548c43c983625c0d66da47cc&role.id=3766508ffa094bb5bbec6d9209745261 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:11.885895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1604c5-e7d1-424e-824a-1e7c2c43035e None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:11.886631 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1604c5-e7d1-424e-824a-1e7c2c43035e None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:11.886631 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1604c5-e7d1-424e-824a-1e7c2c43035e None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:11.888079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 599/1220] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:11.894244 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf8fd0-c2bc-4d53-9863-cd97e2df984d None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:11.894718 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf8fd0-c2bc-4d53-9863-cd97e2df984d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:11.894836 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf8fd0-c2bc-4d53-9863-cd97e2df984d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:11.913452 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d9bf8fd0-c2bc-4d53-9863-cd97e2df984d None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:11.914664 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d9bf8fd0-c2bc-4d53-9863-cd97e2df984d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:11.987170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 622/1221] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:12.272208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1604c5-e7d1-424e-824a-1e7c2c43035e None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:12.393301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1604c5-e7d1-424e-824a-1e7c2c43035e None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:12.434752 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aabeef-e121-4900-991d-6e1564665582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:12.435389 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aabeef-e121-4900-991d-6e1564665582 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:12.435672 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aabeef-e121-4900-991d-6e1564665582 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:12.435945 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aabeef-e121-4900-991d-6e1564665582 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:12.449096 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aabeef-e121-4900-991d-6e1564665582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:29:12.454546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-b7aabeef-e121-4900-991d-6e1564665582 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:29:12.454546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:12.454546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:12.454546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:12.454546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:12.454546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:12.454546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:12.454546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:12.454546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:12.454546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:12.454546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:12.454546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:12.454546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:29:12.454546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:29:12.454546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:29:12.454546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:29:12.455875 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:29:12.455875 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:29:12.455875 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:29:12.455875 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:29:12.455875 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:12.455875 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:12.455875 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:12.455875 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:12.455875 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:12.455875 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:12.455875 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:12.455875 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:12.455875 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:12.455875 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:12.455875 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:12.455875 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:12.457182 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:12.457182 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:12.457182 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:12.457182 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:12.457182 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:29:12.457182 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:29:12.457182 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:29:12.457182 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:29:12.457182 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:29:12.457182 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:29:12.457182 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:29:12.457182 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:29:12.457182 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 600/1222] 10.222.0.69 () {56 vars in 1102 bytes} [Mon Aug 29 21:29:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:12.462106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf8fd0-c2bc-4d53-9863-cd97e2df984d None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:12.571332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf8fd0-c2bc-4d53-9863-cd97e2df984d None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:12.595509 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:12.607882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab2870-6746-43a3-9dcc-c8790b9d3541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:12.608934 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab2870-6746-43a3-9dcc-c8790b9d3541 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:12.609213 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab2870-6746-43a3-9dcc-c8790b9d3541 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:12.609484 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab2870-6746-43a3-9dcc-c8790b9d3541 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:12.610146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab2870-6746-43a3-9dcc-c8790b9d3541 None admin] RBAC: Adding query filter params (name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:12.610451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab2870-6746-43a3-9dcc-c8790b9d3541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:12.611814 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab2870-6746-43a3-9dcc-c8790b9d3541 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:12.621226 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 623/1223] 10.222.0.69 () {56 vars in 1103 bytes} [Mon Aug 29 21:29:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:12.627730 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aabeef-e121-4900-991d-6e1564665582 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:12.675671 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:12.742673 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aabeef-e121-4900-991d-6e1564665582 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:12.783272 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3a661-0e76-4ef7-805a-1d6b903fd4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:12.783954 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3a661-0e76-4ef7-805a-1d6b903fd4b3 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:12.784382 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3a661-0e76-4ef7-805a-1d6b903fd4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:12.784669 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3a661-0e76-4ef7-805a-1d6b903fd4b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:12.797232 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3a661-0e76-4ef7-805a-1d6b903fd4b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:12.799054 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3a661-0e76-4ef7-805a-1d6b903fd4b3 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:12.816513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-b2a3a661-0e76-4ef7-805a-1d6b903fd4b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:12.816513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:12.816513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:12.816513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:12.816513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:12.816513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:12.816513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:12.816513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:12.816513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:12.816513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:12.816513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:12.816513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:12.816513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:12.816513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:12.816513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:12.816513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:12.817850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:12.817850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:12.817850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:12.817850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:12.817850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:12.817850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:12.817850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:12.817850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:12.817850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:12.817850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:12.817850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:12.817850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:12.817850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:12.817850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:12.817850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:12.817850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:12.817850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:12.818811 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:12.818811 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:12.818811 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:29:12.818811 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 601/1224] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:12.824012 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab2870-6746-43a3-9dcc-c8790b9d3541 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:12.949312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab2870-6746-43a3-9dcc-c8790b9d3541 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:12.989067 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0034762-d766-4197-a5ca-0d3b3ac5abd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:12.989889 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0034762-d766-4197-a5ca-0d3b3ac5abd7 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:12.990411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0034762-d766-4197-a5ca-0d3b3ac5abd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:12.990692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0034762-d766-4197-a5ca-0d3b3ac5abd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:12.991996 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0034762-d766-4197-a5ca-0d3b3ac5abd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:12.992371 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0034762-d766-4197-a5ca-0d3b3ac5abd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:12.993783 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0034762-d766-4197-a5ca-0d3b3ac5abd7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:13.010556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 624/1225] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:13.016716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3a661-0e76-4ef7-805a-1d6b903fd4b3 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:13.131876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:13.140283 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3a661-0e76-4ef7-805a-1d6b903fd4b3 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:13.182623 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588725d-db8f-49c1-88c6-f58784e4ede2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:13.183271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588725d-db8f-49c1-88c6-f58784e4ede2 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:13.183546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588725d-db8f-49c1-88c6-f58784e4ede2 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:13.183927 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588725d-db8f-49c1-88c6-f58784e4ede2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:13.192171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588725d-db8f-49c1-88c6-f58784e4ede2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:13.193727 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588725d-db8f-49c1-88c6-f58784e4ede2 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:13.207260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-1588725d-db8f-49c1-88c6-f58784e4ede2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:29:13.207260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:13.207260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:13.207260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:13.207260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:13.207260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:13.207260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:13.207260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:13.207260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:13.207260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:13.207260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:13.207260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:13.207260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:29:13.207260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:29:13.207260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:29:13.207260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:29:13.208506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:13.208506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:13.208506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:29:13.208506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:13.208506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:29:13.208506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:13.208506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:13.208506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:13.208506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:13.208506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:13.208506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:13.208506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:13.208506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:13.208506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:13.208506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:13.208506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:13.208506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:13.208506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:13.209499 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:13.209499 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:13.209499 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:29:13.209499 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:29:13.209499 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:29:13.209499 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:29:13.209499 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:29:13.209499 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:29:13.209499 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:29:13.209499 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:29:13.209499 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 602/1226] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:13.214640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0034762-d766-4197-a5ca-0d3b3ac5abd7 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:13.266473 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:13.337394 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0034762-d766-4197-a5ca-0d3b3ac5abd7 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:13.377158 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fd73e-40b3-4528-b005-e73efc15e563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:13.377897 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fd73e-40b3-4528-b005-e73efc15e563 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:13.378074 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fd73e-40b3-4528-b005-e73efc15e563 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:13.378376 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fd73e-40b3-4528-b005-e73efc15e563 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:13.379141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fd73e-40b3-4528-b005-e73efc15e563 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:13.379450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fd73e-40b3-4528-b005-e73efc15e563 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:13.381074 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fd73e-40b3-4528-b005-e73efc15e563 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:13.400169 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 625/1227] 10.222.0.69 () {56 vars in 1143 bytes} [Mon Aug 29 21:29:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:13.406730 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588725d-db8f-49c1-88c6-f58784e4ede2 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:13.528088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588725d-db8f-49c1-88c6-f58784e4ede2 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:13.564561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec40697-aae5-4969-8b47-9694bf6296b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:13.565341 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec40697-aae5-4969-8b47-9694bf6296b3 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:13.565576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec40697-aae5-4969-8b47-9694bf6296b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:13.565857 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec40697-aae5-4969-8b47-9694bf6296b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:13.577915 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec40697-aae5-4969-8b47-9694bf6296b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:13.579371 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec40697-aae5-4969-8b47-9694bf6296b3 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:13.594534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-3ec40697-aae5-4969-8b47-9694bf6296b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:13.594534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:13.594534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:13.594534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:13.594534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:13.594534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:13.594534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:13.594534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:13.594534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:13.594534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:13.594534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:13.594534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:13.594534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:13.594534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:13.594534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:13.594534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:13.595766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:13.595766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:13.595766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:13.595766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:13.595766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:13.595766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:13.595766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:13.595766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:13.595766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:13.595766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:13.595766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:13.595766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:13.595766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:13.595766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:13.595766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:13.595766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:13.595766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:13.596741 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:13.596741 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:13.596741 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:29:13.596741 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 603/1228] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:13.601941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fd73e-40b3-4528-b005-e73efc15e563 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:13.722982 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fd73e-40b3-4528-b005-e73efc15e563 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:13.725344 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:13.762478 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2b339-0294-4d85-acdb-eb0d548e8589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:13.763103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2b339-0294-4d85-acdb-eb0d548e8589 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:13.763366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2b339-0294-4d85-acdb-eb0d548e8589 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:13.763640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2b339-0294-4d85-acdb-eb0d548e8589 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:13.764387 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2b339-0294-4d85-acdb-eb0d548e8589 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:13.765210 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2b339-0294-4d85-acdb-eb0d548e8589 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:13.766547 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2b339-0294-4d85-acdb-eb0d548e8589 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:13.781477 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 626/1229] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:13.787611 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec40697-aae5-4969-8b47-9694bf6296b3 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:13.798599 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:13.910291 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec40697-aae5-4969-8b47-9694bf6296b3 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:13.946221 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf6083-a88f-451d-a661-5a9122101000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:13.946853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf6083-a88f-451d-a661-5a9122101000 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:13.947136 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf6083-a88f-451d-a661-5a9122101000 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:13.947410 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf6083-a88f-451d-a661-5a9122101000 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:13.955235 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf6083-a88f-451d-a661-5a9122101000 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:13.956729 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf6083-a88f-451d-a661-5a9122101000 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:13.968716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-e6cf6083-a88f-451d-a661-5a9122101000 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:13.968716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:13.968716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:13.968716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:13.968716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:13.968716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:13.968716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:13.968716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:13.968716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:13.968716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:13.968716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:13.968716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:13.968716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:29:13.968716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:29:13.968716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:29:13.969973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:29:13.969973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:13.969973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:13.969973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:13.969973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:13.969973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:13.969973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:13.969973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:13.969973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:13.969973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:13.969973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:13.969973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:13.969973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:13.969973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:13.969973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:13.969973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:13.969973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:13.971052 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:29:13.971052 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:29:13.971052 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:29:13.971052 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:29:13.971052 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:29:13.971052 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:29:13.971052 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:13.971052 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:29:13.971052 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 604/1230] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:29:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:13.976797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2b339-0294-4d85-acdb-eb0d548e8589 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:14.095316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2b339-0294-4d85-acdb-eb0d548e8589 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:14.138887 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef5877-d1fa-486c-a09f-e4654ec13ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:14.140333 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef5877-d1fa-486c-a09f-e4654ec13ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:14.140791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef5877-d1fa-486c-a09f-e4654ec13ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:14.141273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef5877-d1fa-486c-a09f-e4654ec13ea3 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:14.142203 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef5877-d1fa-486c-a09f-e4654ec13ea3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:14.142633 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef5877-d1fa-486c-a09f-e4654ec13ea3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:14.144363 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef5877-d1fa-486c-a09f-e4654ec13ea3 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:14.158479 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 627/1231] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:29:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:14.165251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf6083-a88f-451d-a661-5a9122101000 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:14.250969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:14.290386 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf6083-a88f-451d-a661-5a9122101000 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:14.328492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca97d5b-8657-4c20-9847-485795a10010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:14.329163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca97d5b-8657-4c20-9847-485795a10010 None admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:14.329440 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca97d5b-8657-4c20-9847-485795a10010 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:14.329716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca97d5b-8657-4c20-9847-485795a10010 None admin] PATH_INFO: `/v3/projects/a302406c548c43c983625c0d66da47cc/users/a7911672bb2a471daf4f69ba940ef41d/roles/3766508ffa094bb5bbec6d9209745261` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:14.348350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca97d5b-8657-4c20-9847-485795a10010 None admin] RBAC: Authorizing `identity:create_grant(project_id=a302406c548c43c983625c0d66da47cc, user_id=a7911672bb2a471daf4f69ba940ef41d, role_id=3766508ffa094bb5bbec6d9209745261)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:14.349839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca97d5b-8657-4c20-9847-485795a10010 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:14.368207 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 605/1232] 10.222.0.69 () {58 vars in 1439 bytes} [Mon Aug 29 21:29:14 2022] PUT /identity/v3/projects/a302406c548c43c983625c0d66da47cc/users/a7911672bb2a471daf4f69ba940ef41d/roles/3766508ffa094bb5bbec6d9209745261 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:29:16.395193 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc4798-2588-4bc2-b114-0dfff4d2267a None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:16.395771 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc4798-2588-4bc2-b114-0dfff4d2267a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:16.396925 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc4798-2588-4bc2-b114-0dfff4d2267a None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:16.398866 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 628/1233] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:29:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:16.407792 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59723133-d397-47eb-8d33-b7314eecb167 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:16.407792 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59723133-d397-47eb-8d33-b7314eecb167 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:16.407792 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59723133-d397-47eb-8d33-b7314eecb167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:16.429555 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-59723133-d397-47eb-8d33-b7314eecb167 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:16.430863 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-59723133-d397-47eb-8d33-b7314eecb167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:16.506790 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 606/1234] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:16.797335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc4798-2588-4bc2-b114-0dfff4d2267a None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:16.825248 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:16.909558 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc4798-2588-4bc2-b114-0dfff4d2267a None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:16.945719 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd331bf1-3f90-4d93-a120-7c474630ebe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:16.946484 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd331bf1-3f90-4d93-a120-7c474630ebe0 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:16.946759 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd331bf1-3f90-4d93-a120-7c474630ebe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:16.947046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd331bf1-3f90-4d93-a120-7c474630ebe0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:16.959190 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd331bf1-3f90-4d93-a120-7c474630ebe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:29:16.964110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-dd331bf1-3f90-4d93-a120-7c474630ebe0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:29:16.964110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:16.964110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:16.964110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:16.964110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:16.964110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:16.964110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:16.964110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:16.964110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:16.964110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:16.964110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:16.964110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:16.964110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:29:16.964110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:29:16.964110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:29:16.964110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:29:16.970620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:29:16.970620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:29:16.970620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:29:16.970620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:29:16.970620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:16.970620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:16.970620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:16.970620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:16.970620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:16.970620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:16.970620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:16.970620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:16.970620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:16.970620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:16.970620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:16.970620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:16.971870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:16.971870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:16.971870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:16.971870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:16.971870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:29:16.971870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:29:16.971870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:29:16.971870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:29:16.971870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:29:16.971870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:29:16.971870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:29:16.971870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:29:16.971870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 629/1235] 10.222.0.69 () {56 vars in 1102 bytes} [Mon Aug 29 21:29:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:16.972794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59723133-d397-47eb-8d33-b7314eecb167 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:17.021746 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:17.085797 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59723133-d397-47eb-8d33-b7314eecb167 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:17.123598 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd140b-db5d-442a-87cd-eea742f3d1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:17.124810 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd140b-db5d-442a-87cd-eea742f3d1bb None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:17.125187 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd140b-db5d-442a-87cd-eea742f3d1bb None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:17.125352 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd140b-db5d-442a-87cd-eea742f3d1bb None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:17.126011 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd140b-db5d-442a-87cd-eea742f3d1bb None admin] RBAC: Adding query filter params (name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:17.126304 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd140b-db5d-442a-87cd-eea742f3d1bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:17.127664 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd140b-db5d-442a-87cd-eea742f3d1bb None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:17.140639 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 607/1236] 10.222.0.69 () {56 vars in 1103 bytes} [Mon Aug 29 21:29:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:17.141885 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd331bf1-3f90-4d93-a120-7c474630ebe0 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:17.246046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:17.265527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd331bf1-3f90-4d93-a120-7c474630ebe0 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:17.304759 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5baf1-d1a6-40e0-95d8-2492fc500c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:17.305397 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5baf1-d1a6-40e0-95d8-2492fc500c99 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:17.305680 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5baf1-d1a6-40e0-95d8-2492fc500c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:17.305954 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5baf1-d1a6-40e0-95d8-2492fc500c99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:17.318616 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5baf1-d1a6-40e0-95d8-2492fc500c99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:17.320224 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5baf1-d1a6-40e0-95d8-2492fc500c99 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:17.335762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-e5a5baf1-d1a6-40e0-95d8-2492fc500c99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:17.335762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:17.335762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:17.335762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:17.335762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:17.335762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:17.335762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:17.335762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:17.335762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:17.335762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:17.335762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:17.335762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:17.335762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:17.335762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:17.335762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:17.335762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:17.337174 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:17.337174 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:17.337174 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:17.337174 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:17.337174 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:17.337174 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:17.337174 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:17.337174 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:17.337174 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:17.337174 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:17.337174 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:17.337174 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:17.337174 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:17.337174 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:17.337174 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:17.337174 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:17.337174 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:17.338493 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:17.338493 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:17.338493 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:29:17.338493 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 630/1237] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:17.343461 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd140b-db5d-442a-87cd-eea742f3d1bb None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:17.465703 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd140b-db5d-442a-87cd-eea742f3d1bb None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:17.477368 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:17.507283 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9925ce-32fe-4dcd-ac50-ed8c3c13bde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:17.507971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9925ce-32fe-4dcd-ac50-ed8c3c13bde6 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:17.508311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9925ce-32fe-4dcd-ac50-ed8c3c13bde6 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:17.508665 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9925ce-32fe-4dcd-ac50-ed8c3c13bde6 None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:17.509317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9925ce-32fe-4dcd-ac50-ed8c3c13bde6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:17.509643 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9925ce-32fe-4dcd-ac50-ed8c3c13bde6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:17.511178 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9925ce-32fe-4dcd-ac50-ed8c3c13bde6 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:17.528207 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 608/1238] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:17.531452 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5baf1-d1a6-40e0-95d8-2492fc500c99 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:17.650537 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5baf1-d1a6-40e0-95d8-2492fc500c99 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:17.697332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c75ff-a458-44b8-adb7-23dce0db20fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:17.698031 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c75ff-a458-44b8-adb7-23dce0db20fb None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:17.698355 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c75ff-a458-44b8-adb7-23dce0db20fb None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:17.698616 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c75ff-a458-44b8-adb7-23dce0db20fb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:17.702341 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:17.708409 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c75ff-a458-44b8-adb7-23dce0db20fb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:17.710047 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c75ff-a458-44b8-adb7-23dce0db20fb None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:17.723929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-573c75ff-a458-44b8-adb7-23dce0db20fb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:29:17.723929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:17.723929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:17.723929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:17.723929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:17.723929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:17.723929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:17.723929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:17.723929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:17.723929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:17.723929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:17.723929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:17.723929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:29:17.723929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:29:17.723929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:29:17.723929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:29:17.725316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:17.725316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:17.725316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:29:17.725316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:17.725316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:29:17.725316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:17.725316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:17.725316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:17.725316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:17.725316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:17.725316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:17.725316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:17.725316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:17.725316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:17.725316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:17.725316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:17.725316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:17.725316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:17.726360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:17.726360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:17.726360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:29:17.726360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:29:17.726360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:29:17.726360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:29:17.726360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:29:17.726360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:29:17.726360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:29:17.726360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:29:17.726360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 631/1239] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:17.731229 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9925ce-32fe-4dcd-ac50-ed8c3c13bde6 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:17.847611 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9925ce-32fe-4dcd-ac50-ed8c3c13bde6 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:17.885716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e078df2-3238-416e-a664-ce1a6dc518da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:17.886350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e078df2-3238-416e-a664-ce1a6dc518da None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:17.886647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e078df2-3238-416e-a664-ce1a6dc518da None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:17.886969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e078df2-3238-416e-a664-ce1a6dc518da None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:17.887711 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e078df2-3238-416e-a664-ce1a6dc518da None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:17.888016 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e078df2-3238-416e-a664-ce1a6dc518da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:17.890082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e078df2-3238-416e-a664-ce1a6dc518da None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:17.911684 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 609/1240] 10.222.0.69 () {56 vars in 1143 bytes} [Mon Aug 29 21:29:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:17.917932 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c75ff-a458-44b8-adb7-23dce0db20fb None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:18.034859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c75ff-a458-44b8-adb7-23dce0db20fb None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:18.071765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a8a4a-c656-44f4-8084-431b7971ffe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:18.072457 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a8a4a-c656-44f4-8084-431b7971ffe1 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:18.072740 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a8a4a-c656-44f4-8084-431b7971ffe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:18.073099 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a8a4a-c656-44f4-8084-431b7971ffe1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:18.147053 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:18.154776 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a8a4a-c656-44f4-8084-431b7971ffe1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:18.156870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a8a4a-c656-44f4-8084-431b7971ffe1 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:18.285321 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 632/1241] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:29:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:29:18.292000 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e078df2-3238-416e-a664-ce1a6dc518da None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:18.326066 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:18.412533 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e078df2-3238-416e-a664-ce1a6dc518da None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:18.455149 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23a9cc-a9b0-4e93-bb10-c85ace039fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:18.455782 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23a9cc-a9b0-4e93-bb10-c85ace039fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:18.456065 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23a9cc-a9b0-4e93-bb10-c85ace039fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:18.456426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23a9cc-a9b0-4e93-bb10-c85ace039fb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:18.467293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23a9cc-a9b0-4e93-bb10-c85ace039fb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:18.469725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23a9cc-a9b0-4e93-bb10-c85ace039fb0 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:18.488709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-9b23a9cc-a9b0-4e93-bb10-c85ace039fb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:18.488709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:18.488709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:18.488709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:18.488709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:18.488709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:18.488709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:18.488709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:18.488709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:18.488709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:18.488709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:18.488709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:18.488709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:18.488709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:18.488709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:18.488709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:18.490262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:18.490262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:18.490262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:18.490262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:18.490262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:18.490262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:18.490262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:18.490262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:18.490262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:18.490262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:18.490262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:18.490262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:18.490262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:18.490262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:18.490262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:18.490262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:18.490262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:18.491188 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:18.491188 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:18.491188 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:29:18.491188 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 610/1242] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:18.496451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a8a4a-c656-44f4-8084-431b7971ffe1 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:18.613667 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:18.620268 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a8a4a-c656-44f4-8084-431b7971ffe1 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:18.655743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b156e-4c92-4731-aac9-badb3b3a9f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:18.656612 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b156e-4c92-4731-aac9-badb3b3a9f56 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:18.656753 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b156e-4c92-4731-aac9-badb3b3a9f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:18.656938 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b156e-4c92-4731-aac9-badb3b3a9f56 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:18.657580 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b156e-4c92-4731-aac9-badb3b3a9f56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:18.657894 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b156e-4c92-4731-aac9-badb3b3a9f56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:18.659255 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b156e-4c92-4731-aac9-badb3b3a9f56 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:18.675615 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 633/1243] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:18.676970 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23a9cc-a9b0-4e93-bb10-c85ace039fb0 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:18.767778 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:18.795441 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23a9cc-a9b0-4e93-bb10-c85ace039fb0 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:18.835535 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57daca14-a95f-49cb-8792-1df1a332c394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:18.836278 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57daca14-a95f-49cb-8792-1df1a332c394 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:18.836559 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57daca14-a95f-49cb-8792-1df1a332c394 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:18.836832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57daca14-a95f-49cb-8792-1df1a332c394 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:18.850963 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57daca14-a95f-49cb-8792-1df1a332c394 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:18.853072 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57daca14-a95f-49cb-8792-1df1a332c394 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:18.866847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-57daca14-a95f-49cb-8792-1df1a332c394 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:18.866847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:18.866847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:18.866847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:18.866847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:18.866847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:18.866847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:18.866847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:18.866847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:18.866847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:18.866847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:18.866847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:18.866847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:29:18.866847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:29:18.866847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:29:18.868006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:29:18.868006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:18.868006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:18.868006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:18.868006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:18.868006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:18.868006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:18.868006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:18.868006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:18.868006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:18.868006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:18.868006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:18.868006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:18.868006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:18.868006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:18.868006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:18.868006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:18.869065 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:29:18.869065 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:29:18.869065 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:29:18.869065 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:29:18.869065 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:29:18.869065 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:29:18.869065 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:18.869065 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:29:18.872276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 611/1244] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:29:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:18.878744 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b156e-4c92-4731-aac9-badb3b3a9f56 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:19.004099 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b156e-4c92-4731-aac9-badb3b3a9f56 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:19.041876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfe505-a54b-4406-860a-776ad143777e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:19.042422 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfe505-a54b-4406-860a-776ad143777e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:19.042727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfe505-a54b-4406-860a-776ad143777e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:19.042976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfe505-a54b-4406-860a-776ad143777e None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:19.043674 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfe505-a54b-4406-860a-776ad143777e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:19.043981 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfe505-a54b-4406-860a-776ad143777e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:19.045503 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfe505-a54b-4406-860a-776ad143777e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:19.059370 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 634/1245] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:29:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:19.065774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57daca14-a95f-49cb-8792-1df1a332c394 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:19.180075 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57daca14-a95f-49cb-8792-1df1a332c394 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:19.219226 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b7240-413b-4cb7-8801-4c56a9816d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:19.219865 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b7240-413b-4cb7-8801-4c56a9816d2e None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:19.220141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b7240-413b-4cb7-8801-4c56a9816d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:19.220446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b7240-413b-4cb7-8801-4c56a9816d2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:19.221181 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b7240-413b-4cb7-8801-4c56a9816d2e None admin] RBAC: Adding query filter params (role.id=3766508ffa094bb5bbec6d9209745261, scope.project.id=a302406c548c43c983625c0d66da47cc, user.id=a7911672bb2a471daf4f69ba940ef41d) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:19.221521 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b7240-413b-4cb7-8801-4c56a9816d2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:19.222935 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b7240-413b-4cb7-8801-4c56a9816d2e None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:19.230117 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 612/1246] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:29:19 2022] GET /identity/v3/role_assignments?user.id=a7911672bb2a471daf4f69ba940ef41d&scope.project.id=a302406c548c43c983625c0d66da47cc&role.id=3766508ffa094bb5bbec6d9209745261 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:21.421985 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fb189-09c6-4af9-9559-d403982e49e2 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:21.422536 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fb189-09c6-4af9-9559-d403982e49e2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:21.422536 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fb189-09c6-4af9-9559-d403982e49e2 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:21.423870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 635/1247] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:29:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:21.429432 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef88b9-1dc9-4102-8a0f-8198a614039d None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:21.429917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef88b9-1dc9-4102-8a0f-8198a614039d None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:21.430185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef88b9-1dc9-4102-8a0f-8198a614039d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:21.437024 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:21.451481 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-77ef88b9-1dc9-4102-8a0f-8198a614039d None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:21.452941 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-77ef88b9-1dc9-4102-8a0f-8198a614039d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:21.537323 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 613/1248] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:21.805936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fb189-09c6-4af9-9559-d403982e49e2 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:21.838664 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:21.934091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fb189-09c6-4af9-9559-d403982e49e2 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:21.974220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f1196-d5be-4449-b29f-55181cfefc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:21.974892 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f1196-d5be-4449-b29f-55181cfefc9e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:21.975141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f1196-d5be-4449-b29f-55181cfefc9e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:21.975526 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f1196-d5be-4449-b29f-55181cfefc9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:21.988543 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f1196-d5be-4449-b29f-55181cfefc9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:29:21.994019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-ca5f1196-d5be-4449-b29f-55181cfefc9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:29:21.994019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:21.994019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:21.994019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:21.994019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:21.994019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:21.994019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:21.994019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:21.994019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:21.994019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:21.994019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:21.994019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:21.994019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:29:21.994019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:29:21.994019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:29:21.994019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:29:21.995231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:29:21.995231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:29:21.995231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:29:21.995231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:29:21.995231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:21.995231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:21.995231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:21.995231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:21.995231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:21.995231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:21.995231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:21.995231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:21.995231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:21.995231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:21.995231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:21.995231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:21.996126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:21.996126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:21.996126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:21.996126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:21.996126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:29:21.996126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:29:21.996126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:29:21.996126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:29:21.996126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:29:21.996126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:29:21.996126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:29:21.996126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:29:21.996126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 636/1249] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:29:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:22.003478 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef88b9-1dc9-4102-8a0f-8198a614039d None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:22.133370 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef88b9-1dc9-4102-8a0f-8198a614039d None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:22.171665 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:22.178406 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce1357-d417-42a7-bf9b-597564978ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:22.179109 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce1357-d417-42a7-bf9b-597564978ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:22.179389 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce1357-d417-42a7-bf9b-597564978ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:22.179700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce1357-d417-42a7-bf9b-597564978ff1 None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:22.180462 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce1357-d417-42a7-bf9b-597564978ff1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:22.180765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce1357-d417-42a7-bf9b-597564978ff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:22.182304 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce1357-d417-42a7-bf9b-597564978ff1 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:22.191971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 614/1250] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:29:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:22.197851 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f1196-d5be-4449-b29f-55181cfefc9e None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:22.292688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:22.321279 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f1196-d5be-4449-b29f-55181cfefc9e None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:22.360828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b179d-2e07-499e-bd2c-692b7d8972ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:22.361481 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b179d-2e07-499e-bd2c-692b7d8972ac None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:22.361819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b179d-2e07-499e-bd2c-692b7d8972ac None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:22.362096 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b179d-2e07-499e-bd2c-692b7d8972ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:22.373480 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b179d-2e07-499e-bd2c-692b7d8972ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:22.375669 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b179d-2e07-499e-bd2c-692b7d8972ac None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:22.392021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-730b179d-2e07-499e-bd2c-692b7d8972ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:22.392021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:22.392021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:22.392021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:22.392021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:22.392021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:22.392021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:22.392021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:22.392021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:22.392021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:22.392021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:22.392021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:22.392021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:22.392021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:22.392021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:22.392021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:22.393033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:22.393033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:22.393033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:22.393033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:22.393033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:22.393033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:22.393033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:22.393033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:22.393033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:22.393033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:22.393033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:22.393033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:22.393033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:22.393033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:22.393033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:22.393033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:22.393033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:22.393959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:22.393959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:22.393959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:29:22.393959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 637/1251] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:22.399599 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce1357-d417-42a7-bf9b-597564978ff1 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:22.518231 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce1357-d417-42a7-bf9b-597564978ff1 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:22.558682 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3cecf-b0f2-4f5c-8674-43837d8555e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:22.559299 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3cecf-b0f2-4f5c-8674-43837d8555e7 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:22.559580 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3cecf-b0f2-4f5c-8674-43837d8555e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:22.559858 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3cecf-b0f2-4f5c-8674-43837d8555e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:22.560538 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3cecf-b0f2-4f5c-8674-43837d8555e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:22.560842 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3cecf-b0f2-4f5c-8674-43837d8555e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:22.562782 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3cecf-b0f2-4f5c-8674-43837d8555e7 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:22.575576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 615/1252] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:22.581667 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b179d-2e07-499e-bd2c-692b7d8972ac None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:22.695134 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b179d-2e07-499e-bd2c-692b7d8972ac None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:22.723828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:22.734249 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f3103-84c9-4b0d-b912-22f0164f166b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:22.734872 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f3103-84c9-4b0d-b912-22f0164f166b None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:22.735204 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f3103-84c9-4b0d-b912-22f0164f166b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:22.735446 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f3103-84c9-4b0d-b912-22f0164f166b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:22.744305 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f3103-84c9-4b0d-b912-22f0164f166b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:22.745843 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f3103-84c9-4b0d-b912-22f0164f166b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:22.757707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-741f3103-84c9-4b0d-b912-22f0164f166b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:29:22.757707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:22.757707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:22.757707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:22.757707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:22.757707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:22.757707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:22.757707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:22.757707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:22.757707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:22.757707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:22.757707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:22.757707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:29:22.757707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:29:22.757707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:29:22.757707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:29:22.758928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:22.758928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:22.758928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:29:22.758928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:22.758928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:29:22.758928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:22.758928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:22.758928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:22.758928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:22.758928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:22.758928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:22.758928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:22.758928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:22.758928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:22.758928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:22.758928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:22.758928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:22.758928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:22.759920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:22.759920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:22.759920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:29:22.759920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:29:22.759920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:29:22.759920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:29:22.759920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:29:22.759920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:29:22.759920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:29:22.759920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:29:22.759920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 638/1253] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:22.764910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3cecf-b0f2-4f5c-8674-43837d8555e7 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:22.831534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:22.880427 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3cecf-b0f2-4f5c-8674-43837d8555e7 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:22.923646 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37461091-c51e-4a40-bb5d-b88c541dbc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:22.924299 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37461091-c51e-4a40-bb5d-b88c541dbc6c None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:22.924581 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37461091-c51e-4a40-bb5d-b88c541dbc6c None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:22.924855 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37461091-c51e-4a40-bb5d-b88c541dbc6c None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:22.925584 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37461091-c51e-4a40-bb5d-b88c541dbc6c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:22.925890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37461091-c51e-4a40-bb5d-b88c541dbc6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:22.927319 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37461091-c51e-4a40-bb5d-b88c541dbc6c None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:22.945717 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 616/1254] 10.222.0.69 () {56 vars in 1143 bytes} [Mon Aug 29 21:29:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:22.951428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f3103-84c9-4b0d-b912-22f0164f166b None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:23.083660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f3103-84c9-4b0d-b912-22f0164f166b None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:23.132826 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4db64b-c7ee-43c9-a673-8f1c44a565b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:23.133834 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4db64b-c7ee-43c9-a673-8f1c44a565b5 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:23.134310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4db64b-c7ee-43c9-a673-8f1c44a565b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:23.134784 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4db64b-c7ee-43c9-a673-8f1c44a565b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:23.231983 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:23.249698 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4db64b-c7ee-43c9-a673-8f1c44a565b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:23.251294 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4db64b-c7ee-43c9-a673-8f1c44a565b5 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:23.370736 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 639/1255] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:29:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:29:23.377341 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37461091-c51e-4a40-bb5d-b88c541dbc6c None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:23.507085 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37461091-c51e-4a40-bb5d-b88c541dbc6c None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:23.523929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:23.547585 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c10fc8-76b5-4ec0-b705-ad5593956d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:23.548399 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c10fc8-76b5-4ec0-b705-ad5593956d08 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:23.548678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c10fc8-76b5-4ec0-b705-ad5593956d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:23.549000 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c10fc8-76b5-4ec0-b705-ad5593956d08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:23.560975 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c10fc8-76b5-4ec0-b705-ad5593956d08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:23.563269 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c10fc8-76b5-4ec0-b705-ad5593956d08 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:23.580531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-76c10fc8-76b5-4ec0-b705-ad5593956d08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:23.580531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:23.580531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:23.580531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:23.580531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:23.580531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:23.580531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:23.580531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:23.580531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:23.580531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:23.580531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:23.580531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:23.580531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:23.580531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:23.580531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:23.580531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:23.581910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:23.581910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:23.581910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:23.581910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:23.581910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:23.581910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:23.581910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:23.581910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:23.581910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:23.581910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:23.581910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:23.581910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:23.581910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:23.581910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:23.581910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:23.581910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:23.581910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:23.583112 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:23.583112 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:23.583112 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:29:23.583112 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 617/1256] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:23.588096 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4db64b-c7ee-43c9-a673-8f1c44a565b5 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:23.683470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:23.698100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4db64b-c7ee-43c9-a673-8f1c44a565b5 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:23.734814 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3bf58-c09a-4511-a946-859c17bbdb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:23.735581 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3bf58-c09a-4511-a946-859c17bbdb51 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:23.735852 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3bf58-c09a-4511-a946-859c17bbdb51 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:23.736206 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3bf58-c09a-4511-a946-859c17bbdb51 None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:23.736987 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3bf58-c09a-4511-a946-859c17bbdb51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:23.737319 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3bf58-c09a-4511-a946-859c17bbdb51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:23.739036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3bf58-c09a-4511-a946-859c17bbdb51 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:23.753484 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 640/1257] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:23.759910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c10fc8-76b5-4ec0-b705-ad5593956d08 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:23.869287 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c10fc8-76b5-4ec0-b705-ad5593956d08 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:23.904792 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e8c42-c744-40e5-82ce-824b1bd258b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:23.905518 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e8c42-c744-40e5-82ce-824b1bd258b1 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:23.906066 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e8c42-c744-40e5-82ce-824b1bd258b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:23.906066 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e8c42-c744-40e5-82ce-824b1bd258b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:23.913448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e8c42-c744-40e5-82ce-824b1bd258b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:23.914902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e8c42-c744-40e5-82ce-824b1bd258b1 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:23.928668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-3c8e8c42-c744-40e5-82ce-824b1bd258b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:23.928668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:23.928668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:23.928668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:23.928668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:23.928668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:23.928668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:23.928668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:23.928668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:23.928668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:23.928668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:23.928668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:23.928668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:29:23.928668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:29:23.928668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:29:23.929696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:29:23.929696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:23.929696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:23.929696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:23.929696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:23.929696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:23.929696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:23.929696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:23.929696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:23.929696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:23.929696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:23.929696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:23.929696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:23.929696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:23.929696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:23.929696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:23.929696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:23.930710 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:29:23.930710 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:29:23.930710 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:29:23.930710 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:29:23.930710 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:29:23.930710 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:29:23.930710 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:23.930710 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:29:23.930710 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 618/1258] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:29:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:23.938204 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3bf58-c09a-4511-a946-859c17bbdb51 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:24.055965 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3bf58-c09a-4511-a946-859c17bbdb51 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:24.099324 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3df67-9796-49cd-901c-5eeb7f874873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:24.099940 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3df67-9796-49cd-901c-5eeb7f874873 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:24.100240 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3df67-9796-49cd-901c-5eeb7f874873 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:24.100518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3df67-9796-49cd-901c-5eeb7f874873 None admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:24.101313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3df67-9796-49cd-901c-5eeb7f874873 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:24.101624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3df67-9796-49cd-901c-5eeb7f874873 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:24.103432 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3df67-9796-49cd-901c-5eeb7f874873 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:24.118469 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 641/1259] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:29:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:24.125253 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e8c42-c744-40e5-82ce-824b1bd258b1 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:24.155080 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:24.256059 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e8c42-c744-40e5-82ce-824b1bd258b1 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:24.293362 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fa066-3271-475f-baba-1ccb95939338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:24.293982 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fa066-3271-475f-baba-1ccb95939338 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:24.294262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fa066-3271-475f-baba-1ccb95939338 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:24.294536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fa066-3271-475f-baba-1ccb95939338 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:24.295271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82fa066-3271-475f-baba-1ccb95939338 None admin] RBAC: Adding query filter params (role.id=69369872661e4179bb51cd1ca76e28c3, scope.project.id=a302406c548c43c983625c0d66da47cc, user.id=a7911672bb2a471daf4f69ba940ef41d) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:24.295574 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82fa066-3271-475f-baba-1ccb95939338 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:24.297685 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82fa066-3271-475f-baba-1ccb95939338 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:24.306759 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 619/1260] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:29:24 2022] GET /identity/v3/role_assignments?user.id=a7911672bb2a471daf4f69ba940ef41d&scope.project.id=a302406c548c43c983625c0d66da47cc&role.id=69369872661e4179bb51cd1ca76e28c3 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:26.272494 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112192e-3fd7-4691-b849-a4f6c3c63b67 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:26.273013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112192e-3fd7-4691-b849-a4f6c3c63b67 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:26.273106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112192e-3fd7-4691-b849-a4f6c3c63b67 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:26.274358 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 642/1261] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:26.279402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534b8c5-2133-413a-9105-f75ee90751d3 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:26.279831 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534b8c5-2133-413a-9105-f75ee90751d3 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:26.280018 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534b8c5-2133-413a-9105-f75ee90751d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:26.300113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-0534b8c5-2133-413a-9105-f75ee90751d3 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:26.301347 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-0534b8c5-2133-413a-9105-f75ee90751d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:26.385423 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 620/1262] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:26.680290 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112192e-3fd7-4691-b849-a4f6c3c63b67 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:26.691207 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:26.784194 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112192e-3fd7-4691-b849-a4f6c3c63b67 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:26.818838 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328be69-2fd3-478b-98c9-6bff7b9cd459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:26.819460 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328be69-2fd3-478b-98c9-6bff7b9cd459 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:26.819743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328be69-2fd3-478b-98c9-6bff7b9cd459 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:26.820017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328be69-2fd3-478b-98c9-6bff7b9cd459 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:26.829975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328be69-2fd3-478b-98c9-6bff7b9cd459 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:29:26.834747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-5328be69-2fd3-478b-98c9-6bff7b9cd459 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:29:26.834747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:26.834747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:26.834747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:26.834747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:26.834747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:26.834747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:26.834747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:26.834747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:26.834747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:26.834747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:26.834747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:26.834747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:29:26.834747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:29:26.834747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:29:26.834747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:29:26.836088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:29:26.836088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:29:26.836088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:29:26.836088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:29:26.836088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:26.836088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:26.836088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:26.836088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:26.836088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:26.836088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:26.836088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:26.836088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:26.836088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:26.836088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:26.836088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:26.836088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:26.837398 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:26.837398 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:26.837398 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:26.837398 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:26.837398 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:29:26.837398 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:29:26.837398 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:29:26.837398 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:29:26.837398 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:29:26.837398 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:29:26.837398 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:29:26.837398 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:29:26.837398 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 643/1263] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:29:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:26.841976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534b8c5-2133-413a-9105-f75ee90751d3 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:26.860603 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:26.942167 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534b8c5-2133-413a-9105-f75ee90751d3 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:26.976094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fe67c-fec7-4b40-99ba-c55a84a0557c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:26.976736 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fe67c-fec7-4b40-99ba-c55a84a0557c None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:26.977015 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fe67c-fec7-4b40-99ba-c55a84a0557c None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:26.977288 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fe67c-fec7-4b40-99ba-c55a84a0557c None admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:26.977947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fe67c-fec7-4b40-99ba-c55a84a0557c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:26.978249 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fe67c-fec7-4b40-99ba-c55a84a0557c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:26.979608 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fe67c-fec7-4b40-99ba-c55a84a0557c None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:26.988555 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 621/1264] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:29:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:26.994639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328be69-2fd3-478b-98c9-6bff7b9cd459 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:27.067473 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:27.100634 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328be69-2fd3-478b-98c9-6bff7b9cd459 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:27.134366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331348f-bb33-4743-a2e5-cacd0524ac30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:27.134988 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331348f-bb33-4743-a2e5-cacd0524ac30 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:27.135265 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331348f-bb33-4743-a2e5-cacd0524ac30 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:27.135533 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331348f-bb33-4743-a2e5-cacd0524ac30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:27.146102 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c331348f-bb33-4743-a2e5-cacd0524ac30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:27.147526 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c331348f-bb33-4743-a2e5-cacd0524ac30 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:27.161762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-c331348f-bb33-4743-a2e5-cacd0524ac30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:27.161762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:27.161762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:27.161762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:27.161762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:27.161762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:27.161762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:27.161762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:27.161762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:27.161762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:27.161762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:27.161762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:27.161762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:27.161762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:27.161762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:27.161762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:27.162939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:27.162939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:27.162939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:27.162939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:27.162939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:27.162939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:27.162939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:27.162939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:27.162939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:27.162939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:27.162939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:27.162939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:27.162939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:27.162939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:27.162939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:27.162939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:27.162939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:27.164071 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:27.164071 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:27.164071 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:29:27.164071 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 644/1265] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:27.168708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fe67c-fec7-4b40-99ba-c55a84a0557c None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:27.252485 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:27.274873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fe67c-fec7-4b40-99ba-c55a84a0557c None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:27.309530 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b38c3-e407-4d1e-a13a-aa41e024ee5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:27.310187 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b38c3-e407-4d1e-a13a-aa41e024ee5b None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:27.310388 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b38c3-e407-4d1e-a13a-aa41e024ee5b None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:27.310659 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b38c3-e407-4d1e-a13a-aa41e024ee5b None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:27.311297 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b38c3-e407-4d1e-a13a-aa41e024ee5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:27.311623 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b38c3-e407-4d1e-a13a-aa41e024ee5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:27.312989 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b38c3-e407-4d1e-a13a-aa41e024ee5b None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:27.324506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 622/1266] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:27.330219 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331348f-bb33-4743-a2e5-cacd0524ac30 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:27.441035 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331348f-bb33-4743-a2e5-cacd0524ac30 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:27.460627 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:27.475413 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827a5d5-81fe-4756-842e-f428e076c23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:27.476038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827a5d5-81fe-4756-842e-f428e076c23f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:27.476344 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827a5d5-81fe-4756-842e-f428e076c23f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:27.476612 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827a5d5-81fe-4756-842e-f428e076c23f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:27.484541 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827a5d5-81fe-4756-842e-f428e076c23f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:27.485962 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827a5d5-81fe-4756-842e-f428e076c23f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:27.497173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-3827a5d5-81fe-4756-842e-f428e076c23f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:29:27.497173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:27.497173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:27.497173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:27.497173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:27.497173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:27.497173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:27.497173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:27.497173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:27.497173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:27.497173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:27.497173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:27.497173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:29:27.497173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:29:27.497173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:29:27.497173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:29:27.498348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:27.498348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:27.498348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:29:27.498348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:27.498348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:29:27.498348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:27.498348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:27.498348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:27.498348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:27.498348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:27.498348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:27.498348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:27.498348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:27.498348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:27.498348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:27.498348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:27.498348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:27.498348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:27.499624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:27.499624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:27.499624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:29:27.499624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:29:27.499624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:29:27.499624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:29:27.499624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:29:27.499624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:29:27.499624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:29:27.499624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:29:27.499624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 645/1267] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:27.504129 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b38c3-e407-4d1e-a13a-aa41e024ee5b None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:27.602326 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b38c3-e407-4d1e-a13a-aa41e024ee5b None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:27.640512 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa1d00-b500-46f7-8df8-eae4a434fb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:27.641119 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa1d00-b500-46f7-8df8-eae4a434fb81 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:27.641421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa1d00-b500-46f7-8df8-eae4a434fb81 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:27.641692 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa1d00-b500-46f7-8df8-eae4a434fb81 None admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:27.642408 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa1d00-b500-46f7-8df8-eae4a434fb81 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:27.642709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa1d00-b500-46f7-8df8-eae4a434fb81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:27.644126 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa1d00-b500-46f7-8df8-eae4a434fb81 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:27.652859 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:27.661938 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 623/1268] 10.222.0.69 () {56 vars in 1143 bytes} [Mon Aug 29 21:29:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:27.667828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827a5d5-81fe-4756-842e-f428e076c23f None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:27.769916 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827a5d5-81fe-4756-842e-f428e076c23f None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:27.804287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2a561-6347-4ad8-8e10-ef1f2f84211c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:27.804912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2a561-6347-4ad8-8e10-ef1f2f84211c None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:27.805202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2a561-6347-4ad8-8e10-ef1f2f84211c None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:27.805473 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2a561-6347-4ad8-8e10-ef1f2f84211c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:27.815667 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2a561-6347-4ad8-8e10-ef1f2f84211c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:27.817135 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2a561-6347-4ad8-8e10-ef1f2f84211c None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:27.831373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-50c2a561-6347-4ad8-8e10-ef1f2f84211c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:27.831373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:27.831373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:27.831373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:27.831373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:27.831373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:27.831373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:27.831373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:27.831373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:27.831373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:27.831373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:27.831373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:27.831373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:27.831373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:27.831373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:27.831373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:27.832546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:27.832546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:27.832546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:27.832546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:27.832546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:27.832546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:27.832546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:27.832546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:27.832546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:27.832546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:27.832546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:27.832546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:27.832546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:27.832546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:27.832546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:27.832546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:27.832546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:27.833884 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:27.833884 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:27.833884 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:29:27.833884 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 646/1269] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:27.838588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa1d00-b500-46f7-8df8-eae4a434fb81 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:27.942389 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa1d00-b500-46f7-8df8-eae4a434fb81 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:27.977221 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c712646-8205-43c1-b3ca-57c74c0245fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:27.977949 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c712646-8205-43c1-b3ca-57c74c0245fe None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:27.978232 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c712646-8205-43c1-b3ca-57c74c0245fe None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:27.978509 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c712646-8205-43c1-b3ca-57c74c0245fe None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:27.979149 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c712646-8205-43c1-b3ca-57c74c0245fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:27.979455 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c712646-8205-43c1-b3ca-57c74c0245fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:27.981481 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c712646-8205-43c1-b3ca-57c74c0245fe None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:27.993366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 624/1270] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:27.999721 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2a561-6347-4ad8-8e10-ef1f2f84211c None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:28.031864 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:28.106373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2a561-6347-4ad8-8e10-ef1f2f84211c None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:28.151199 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa53dd-f62c-4c00-b7cb-d1c8f71bbffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:28.151832 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa53dd-f62c-4c00-b7cb-d1c8f71bbffa None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:28.152109 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa53dd-f62c-4c00-b7cb-d1c8f71bbffa None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:28.152407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa53dd-f62c-4c00-b7cb-d1c8f71bbffa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:28.159598 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa53dd-f62c-4c00-b7cb-d1c8f71bbffa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:28.161084 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa53dd-f62c-4c00-b7cb-d1c8f71bbffa None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:28.172654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-3baa53dd-f62c-4c00-b7cb-d1c8f71bbffa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:28.172654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:28.172654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:28.172654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:28.172654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:28.172654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:28.172654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:28.172654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:28.172654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:28.172654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:28.172654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:28.172654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:28.172654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:29:28.172654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:29:28.172654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:29:28.174450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:29:28.174450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:28.174450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:28.174450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:28.174450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:28.174450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:28.174450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:28.174450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:28.174450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:28.174450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:28.174450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:28.174450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:28.174450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:28.174450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:28.174450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:28.174450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:28.174450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:28.176684 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:29:28.176684 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:29:28.176684 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:29:28.176684 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:29:28.176684 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:29:28.176684 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:29:28.176684 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:28.176684 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:29:28.176684 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 647/1271] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:29:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:28.179710 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c712646-8205-43c1-b3ca-57c74c0245fe None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:28.246235 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:28.294566 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c712646-8205-43c1-b3ca-57c74c0245fe None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:28.328780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdcf7f-c891-4cd3-b9cd-7dd1843bda19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:28.329421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdcf7f-c891-4cd3-b9cd-7dd1843bda19 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:28.329656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdcf7f-c891-4cd3-b9cd-7dd1843bda19 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:28.329929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdcf7f-c891-4cd3-b9cd-7dd1843bda19 None admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:28.330614 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcdcf7f-c891-4cd3-b9cd-7dd1843bda19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:28.330919 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcdcf7f-c891-4cd3-b9cd-7dd1843bda19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:28.332377 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcdcf7f-c891-4cd3-b9cd-7dd1843bda19 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:28.344392 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 625/1272] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:29:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:28.350814 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa53dd-f62c-4c00-b7cb-d1c8f71bbffa None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:28.466791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:28.477289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa53dd-f62c-4c00-b7cb-d1c8f71bbffa None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:28.516253 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76663602-5933-4d9c-97b8-1e2a11c9194b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:28.516928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76663602-5933-4d9c-97b8-1e2a11c9194b None admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:28.517210 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76663602-5933-4d9c-97b8-1e2a11c9194b None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:28.517483 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76663602-5933-4d9c-97b8-1e2a11c9194b None admin] PATH_INFO: `/v3/projects/a302406c548c43c983625c0d66da47cc/users/a7911672bb2a471daf4f69ba940ef41d/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:28.519427 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76663602-5933-4d9c-97b8-1e2a11c9194b None admin] RBAC: Authorizing `identity:create_grant(project_id=a302406c548c43c983625c0d66da47cc, user_id=a7911672bb2a471daf4f69ba940ef41d, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:28.520893 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76663602-5933-4d9c-97b8-1e2a11c9194b None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:28.534103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 648/1273] 10.222.0.69 () {58 vars in 1439 bytes} [Mon Aug 29 21:29:28 2022] PUT /identity/v3/projects/a302406c548c43c983625c0d66da47cc/users/a7911672bb2a471daf4f69ba940ef41d/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:29:30.449981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5044a54-7a12-4ec6-aefb-de49eebfc80d None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:30.450580 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5044a54-7a12-4ec6-aefb-de49eebfc80d None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:30.450580 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5044a54-7a12-4ec6-aefb-de49eebfc80d None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:30.451861 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 626/1274] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:30.458156 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f30bf1-00e5-40bc-be6c-da7693c4ad12 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:30.458566 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f30bf1-00e5-40bc-be6c-da7693c4ad12 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:30.458669 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f30bf1-00e5-40bc-be6c-da7693c4ad12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:30.476789 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-45f30bf1-00e5-40bc-be6c-da7693c4ad12 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:30.477979 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-45f30bf1-00e5-40bc-be6c-da7693c4ad12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:30.546779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 649/1275] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:30.825485 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5044a54-7a12-4ec6-aefb-de49eebfc80d None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:30.928489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5044a54-7a12-4ec6-aefb-de49eebfc80d None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:30.945831 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:30.962705 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531a014-55e9-4869-91c8-3ed72e31a39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:30.963332 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531a014-55e9-4869-91c8-3ed72e31a39a None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:30.963614 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531a014-55e9-4869-91c8-3ed72e31a39a None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:30.963892 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531a014-55e9-4869-91c8-3ed72e31a39a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:30.975265 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531a014-55e9-4869-91c8-3ed72e31a39a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:29:30.980492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-d531a014-55e9-4869-91c8-3ed72e31a39a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:29:30.980492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:30.980492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:30.980492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:30.980492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:30.980492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:30.980492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:30.980492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:30.980492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:30.980492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:30.980492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:30.980492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:30.980492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:29:30.980492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:29:30.980492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:29:30.980492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:29:30.981628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:29:30.981628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:29:30.981628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:29:30.981628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:29:30.981628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:30.981628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:30.981628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:30.981628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:30.981628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:30.981628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:30.981628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:30.981628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:30.981628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:30.981628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:30.981628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:30.981628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:30.982866 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:30.982866 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:30.982866 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:30.982866 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:30.982866 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:29:30.982866 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:29:30.982866 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:29:30.982866 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:29:30.982866 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:29:30.982866 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:29:30.982866 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:29:30.982866 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:29:30.982866 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 627/1276] 10.222.0.69 () {56 vars in 1096 bytes} [Mon Aug 29 21:29:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:30.988280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f30bf1-00e5-40bc-be6c-da7693c4ad12 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:31.069146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:31.088653 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f30bf1-00e5-40bc-be6c-da7693c4ad12 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:31.122997 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d0108-fa36-46d9-a9a0-bf9642b946a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:31.123661 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d0108-fa36-46d9-a9a0-bf9642b946a7 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:31.123945 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d0108-fa36-46d9-a9a0-bf9642b946a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:31.124330 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d0108-fa36-46d9-a9a0-bf9642b946a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:31.124962 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d0108-fa36-46d9-a9a0-bf9642b946a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:31.125269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d0108-fa36-46d9-a9a0-bf9642b946a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:31.126781 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d0108-fa36-46d9-a9a0-bf9642b946a7 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:31.135001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 650/1277] 10.222.0.69 () {56 vars in 1099 bytes} [Mon Aug 29 21:29:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:31.140896 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531a014-55e9-4869-91c8-3ed72e31a39a None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:31.249005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531a014-55e9-4869-91c8-3ed72e31a39a None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:31.287524 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940a468-26d5-4e83-a06c-03e65c7254cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:31.288151 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940a468-26d5-4e83-a06c-03e65c7254cb None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:31.288454 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940a468-26d5-4e83-a06c-03e65c7254cb None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:31.288724 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940a468-26d5-4e83-a06c-03e65c7254cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:31.298666 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940a468-26d5-4e83-a06c-03e65c7254cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:31.300171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940a468-26d5-4e83-a06c-03e65c7254cb None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:31.316677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-4940a468-26d5-4e83-a06c-03e65c7254cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:31.316677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:31.316677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:31.316677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:31.316677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:31.316677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:31.316677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:31.316677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:31.316677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:31.316677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:31.316677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:31.316677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:31.316677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:31.316677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:31.316677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:31.316677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:31.317997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:31.317997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:31.317997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:31.317997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:31.317997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:31.317997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:31.317997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:31.317997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:31.317997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:31.317997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:31.317997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:31.317997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:31.317997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:31.317997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:31.317997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:31.317997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:31.317997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:31.318956 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:31.318956 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:31.318956 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:29:31.318956 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 628/1278] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:31.324155 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d0108-fa36-46d9-a9a0-bf9642b946a7 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:31.435598 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d0108-fa36-46d9-a9a0-bf9642b946a7 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:31.478165 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e405ed5-03d5-4fb5-a085-f32de0e8056d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:31.478961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e405ed5-03d5-4fb5-a085-f32de0e8056d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:31.479096 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e405ed5-03d5-4fb5-a085-f32de0e8056d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:31.479282 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e405ed5-03d5-4fb5-a085-f32de0e8056d None admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:31.479911 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e405ed5-03d5-4fb5-a085-f32de0e8056d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:31.480236 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e405ed5-03d5-4fb5-a085-f32de0e8056d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:31.481602 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e405ed5-03d5-4fb5-a085-f32de0e8056d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:31.493610 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 651/1279] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:31.499322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940a468-26d5-4e83-a06c-03e65c7254cb None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:31.530280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:31.600652 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940a468-26d5-4e83-a06c-03e65c7254cb None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:31.634122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa8c01-f883-451f-9576-94ab944ae986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:31.634745 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa8c01-f883-451f-9576-94ab944ae986 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:31.635036 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa8c01-f883-451f-9576-94ab944ae986 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:31.635312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa8c01-f883-451f-9576-94ab944ae986 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:31.643697 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa8c01-f883-451f-9576-94ab944ae986 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:31.645233 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa8c01-f883-451f-9576-94ab944ae986 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:31.656662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-3cfa8c01-f883-451f-9576-94ab944ae986 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:29:31.656662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:31.656662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:31.656662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:31.656662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:31.656662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:31.656662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:31.656662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:31.656662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:31.656662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:31.656662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:31.656662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:31.656662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:29:31.656662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:29:31.656662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:29:31.656662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:29:31.657850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:31.657850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:31.657850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:29:31.657850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:31.657850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:29:31.657850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:31.657850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:31.657850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:31.657850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:31.657850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:31.657850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:31.657850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:31.657850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:31.657850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:31.657850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:31.657850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:31.657850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:31.657850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:31.659031 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:31.659031 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:31.659031 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:29:31.659031 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:29:31.659031 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:29:31.659031 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:29:31.659031 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:29:31.659031 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:29:31.659031 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:29:31.659031 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:29:31.659031 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 629/1280] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:31.663758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e405ed5-03d5-4fb5-a085-f32de0e8056d None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:31.667623 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:31.763668 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e405ed5-03d5-4fb5-a085-f32de0e8056d None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:31.798489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4381a-1f05-46e8-a6d1-0ded78e83cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:31.799131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4381a-1f05-46e8-a6d1-0ded78e83cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:31.799411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4381a-1f05-46e8-a6d1-0ded78e83cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:31.799694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4381a-1f05-46e8-a6d1-0ded78e83cb5 None admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:31.800443 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4381a-1f05-46e8-a6d1-0ded78e83cb5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:31.800758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4381a-1f05-46e8-a6d1-0ded78e83cb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:31.802188 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4381a-1f05-46e8-a6d1-0ded78e83cb5 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:31.819912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 652/1281] 10.222.0.69 () {56 vars in 1143 bytes} [Mon Aug 29 21:29:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:31.826038 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa8c01-f883-451f-9576-94ab944ae986 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:31.922418 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:31.932881 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa8c01-f883-451f-9576-94ab944ae986 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:31.967961 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010bfb6-6683-4a63-a62c-9dba9185a0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:31.968619 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010bfb6-6683-4a63-a62c-9dba9185a0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:31.968908 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010bfb6-6683-4a63-a62c-9dba9185a0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:31.969177 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010bfb6-6683-4a63-a62c-9dba9185a0b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:32.036687 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010bfb6-6683-4a63-a62c-9dba9185a0b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:32.038056 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010bfb6-6683-4a63-a62c-9dba9185a0b2 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:32.135950 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:32.147129 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 630/1282] 10.222.0.69 () {58 vars in 1282 bytes} [Mon Aug 29 21:29:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:29:32.153144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4381a-1f05-46e8-a6d1-0ded78e83cb5 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:32.220059 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:32.261064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4381a-1f05-46e8-a6d1-0ded78e83cb5 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:32.295783 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6df56-f324-466d-9e0d-74fbcc803923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:32.296952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6df56-f324-466d-9e0d-74fbcc803923 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:32.297256 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6df56-f324-466d-9e0d-74fbcc803923 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:32.297530 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6df56-f324-466d-9e0d-74fbcc803923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:32.307690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6df56-f324-466d-9e0d-74fbcc803923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:32.309164 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6df56-f324-466d-9e0d-74fbcc803923 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:32.324575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-51b6df56-f324-466d-9e0d-74fbcc803923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:32.324575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:32.324575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:32.324575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:32.324575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:32.324575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:32.324575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:32.324575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:32.324575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:32.324575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:32.324575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:32.324575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:32.324575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:32.324575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:32.324575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:32.324575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:32.325703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:32.325703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:32.325703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:32.325703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:32.325703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:32.325703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:32.325703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:32.325703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:32.325703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:32.325703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:32.325703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:32.325703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:32.325703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:32.325703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:32.325703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:32.325703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:32.325703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:32.326725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:32.326725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:32.326725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:29:32.326725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 653/1283] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:32.332901 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010bfb6-6683-4a63-a62c-9dba9185a0b2 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:32.439618 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010bfb6-6683-4a63-a62c-9dba9185a0b2 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:32.475176 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3f7bd-1902-4914-a5ca-cb60167a73f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:32.475782 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3f7bd-1902-4914-a5ca-cb60167a73f0 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:32.476067 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3f7bd-1902-4914-a5ca-cb60167a73f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:32.476382 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3f7bd-1902-4914-a5ca-cb60167a73f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:32.477057 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3f7bd-1902-4914-a5ca-cb60167a73f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:32.477364 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3f7bd-1902-4914-a5ca-cb60167a73f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:32.478735 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3f7bd-1902-4914-a5ca-cb60167a73f0 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:32.490681 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 631/1284] 10.222.0.69 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:32.496679 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6df56-f324-466d-9e0d-74fbcc803923 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:32.600986 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6df56-f324-466d-9e0d-74fbcc803923 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:32.614821 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:32.636220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ca1e1-82a6-4e34-a363-81faf0d59f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:32.636840 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ca1e1-82a6-4e34-a363-81faf0d59f58 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:32.637124 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ca1e1-82a6-4e34-a363-81faf0d59f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:32.637395 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ca1e1-82a6-4e34-a363-81faf0d59f58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:32.644494 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ca1e1-82a6-4e34-a363-81faf0d59f58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:32.645963 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ca1e1-82a6-4e34-a363-81faf0d59f58 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:32.657038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application [None req-1a4ca1e1-82a6-4e34-a363-81faf0d59f58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:32.657038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:32.657038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:32.657038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:32.657038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:32.657038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:32.657038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:32.657038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:32.657038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:32.657038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:32.657038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:32.657038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:32.657038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:29:32.657038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:29:32.657038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:29:32.658110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:29:32.658110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:32.658110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:32.658110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:32.658110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:32.658110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:32.658110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:32.658110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:32.658110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:32.658110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:32.658110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:32.658110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:32.658110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:32.658110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:32.658110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:32.658110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:32.658110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:32.659051 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:29:32.659051 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:29:32.659051 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:29:32.659051 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:29:32.659051 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:29:32.659051 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:29:32.659051 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:32.659051 dv-cinder-854267-3-smb devstack@keystone.service[81658]: ERROR keystone.server.flask.application Aug 29 21:29:32.659051 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 654/1285] 10.222.0.69 () {56 vars in 1111 bytes} [Mon Aug 29 21:29:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:32.665885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3f7bd-1902-4914-a5ca-cb60167a73f0 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:32.716008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:32.767485 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3f7bd-1902-4914-a5ca-cb60167a73f0 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:32.801410 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4236e-bcd8-4ed4-9bc4-3ff2764b3df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:32.802021 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4236e-bcd8-4ed4-9bc4-3ff2764b3df8 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:32.802300 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4236e-bcd8-4ed4-9bc4-3ff2764b3df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:32.802574 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4236e-bcd8-4ed4-9bc4-3ff2764b3df8 None admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:32.803259 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4236e-bcd8-4ed4-9bc4-3ff2764b3df8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:32.803565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4236e-bcd8-4ed4-9bc4-3ff2764b3df8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:32.805017 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4236e-bcd8-4ed4-9bc4-3ff2764b3df8 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:32.817469 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 632/1286] 10.222.0.69 () {56 vars in 1148 bytes} [Mon Aug 29 21:29:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:32.824434 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ca1e1-82a6-4e34-a363-81faf0d59f58 None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:32.927261 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ca1e1-82a6-4e34-a363-81faf0d59f58 None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:32.964494 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdbe78-6bdf-470d-af3f-a5f19d658e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:32.965105 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdbe78-6bdf-470d-af3f-a5f19d658e99 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:32.965386 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdbe78-6bdf-470d-af3f-a5f19d658e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:32.965659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdbe78-6bdf-470d-af3f-a5f19d658e99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:32.966381 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdbe78-6bdf-470d-af3f-a5f19d658e99 None admin] RBAC: Adding query filter params (role.id=69369872661e4179bb51cd1ca76e28c3, scope.project.id=a302406c548c43c983625c0d66da47cc, user.id=a7911672bb2a471daf4f69ba940ef41d) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:32.966687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdbe78-6bdf-470d-af3f-a5f19d658e99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:32.968142 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdbe78-6bdf-470d-af3f-a5f19d658e99 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:32.974507 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 655/1287] 10.222.0.69 () {56 vars in 1374 bytes} [Mon Aug 29 21:29:32 2022] GET /identity/v3/role_assignments?user.id=a7911672bb2a471daf4f69ba940ef41d&scope.project.id=a302406c548c43c983625c0d66da47cc&role.id=69369872661e4179bb51cd1ca76e28c3 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:34.876984 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174b317-56a9-4d8d-8fdc-c4f5dd841330 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:34.877517 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174b317-56a9-4d8d-8fdc-c4f5dd841330 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:34.877517 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174b317-56a9-4d8d-8fdc-c4f5dd841330 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:34.878873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 633/1288] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:34.883991 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1b289-63df-45f6-9cd0-dae5232ff33a None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:34.884426 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1b289-63df-45f6-9cd0-dae5232ff33a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:34.884574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1b289-63df-45f6-9cd0-dae5232ff33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:34.903609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-bcd1b289-63df-45f6-9cd0-dae5232ff33a None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:34.904827 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-bcd1b289-63df-45f6-9cd0-dae5232ff33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:34.933630 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:34.972236 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 656/1289] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:35.242810 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174b317-56a9-4d8d-8fdc-c4f5dd841330 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:35.345339 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174b317-56a9-4d8d-8fdc-c4f5dd841330 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:35.356551 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:35.383881 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b8b48-d6e8-48a0-af87-101dabb04e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:35.384631 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b8b48-d6e8-48a0-af87-101dabb04e2f None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:35.385032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b8b48-d6e8-48a0-af87-101dabb04e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:35.385347 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b8b48-d6e8-48a0-af87-101dabb04e2f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:35.386155 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b8b48-d6e8-48a0-af87-101dabb04e2f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:35.387968 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b8b48-d6e8-48a0-af87-101dabb04e2f None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:35.398967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-704b8b48-d6e8-48a0-af87-101dabb04e2f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:29:35.398967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:35.398967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:29:35.398967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:29:35.398967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:29:35.398967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:29:35.398967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:29:35.398967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:35.398967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:29:35.398967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:29:35.398967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:29:35.398967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:29:35.398967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:35.398967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:35.398967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:35.398967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:35.398967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:35.400328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:35.400328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:35.400328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:35.400328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:35.400328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:35.400328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:35.400328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:29:35.400328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:29:35.400328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:29:35.400328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:29:35.400328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:35.400328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:35.400328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:35.400328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:35.400328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:35.400328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:35.401418 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:35.401418 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:35.401418 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:35.401418 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:35.401418 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:35.401418 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:35.401418 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:35.401418 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:35.401418 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:35.401418 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:35.401418 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:29:35.401418 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:35.401418 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:29:35.401418 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:29:35.401418 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 634/1290] 10.222.0.69 () {56 vars in 1117 bytes} [Mon Aug 29 21:29:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:35.407455 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1b289-63df-45f6-9cd0-dae5232ff33a None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:35.519722 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1b289-63df-45f6-9cd0-dae5232ff33a None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:35.554118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f392c0-4883-474d-bf64-ba3a82d62e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:35.554744 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f392c0-4883-474d-bf64-ba3a82d62e7e None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:35.555022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f392c0-4883-474d-bf64-ba3a82d62e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:35.555292 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f392c0-4883-474d-bf64-ba3a82d62e7e None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:35.555913 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f392c0-4883-474d-bf64-ba3a82d62e7e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:35.556235 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f392c0-4883-474d-bf64-ba3a82d62e7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:35.557591 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f392c0-4883-474d-bf64-ba3a82d62e7e None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:35.562299 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 657/1291] 10.222.0.69 () {56 vars in 1116 bytes} [Mon Aug 29 21:29:35 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:35.568117 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b8b48-d6e8-48a0-af87-101dabb04e2f None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:35.667618 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b8b48-d6e8-48a0-af87-101dabb04e2f None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:35.701251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f880f51-c7bb-40d2-8145-9199b7856030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:35.701858 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f880f51-c7bb-40d2-8145-9199b7856030 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:35.702140 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f880f51-c7bb-40d2-8145-9199b7856030 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:35.702437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f880f51-c7bb-40d2-8145-9199b7856030 None admin] PATH_INFO: `/v3/services` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:35.703044 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f880f51-c7bb-40d2-8145-9199b7856030 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:35.703347 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f880f51-c7bb-40d2-8145-9199b7856030 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:35.704755 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f880f51-c7bb-40d2-8145-9199b7856030 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:35.709183 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 635/1292] 10.222.0.69 () {56 vars in 1116 bytes} [Mon Aug 29 21:29:35 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:37.585522 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2df6d-c964-4b66-a7c3-b10b2a90554d None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:37.586042 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2df6d-c964-4b66-a7c3-b10b2a90554d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:37.586042 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2df6d-c964-4b66-a7c3-b10b2a90554d None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:37.587315 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 658/1293] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:37.592625 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbd69b-2347-4029-9f80-cc7bfe147681 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:37.593049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbd69b-2347-4029-9f80-cc7bfe147681 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:37.593184 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbd69b-2347-4029-9f80-cc7bfe147681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:37.611810 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-a8dbd69b-2347-4029-9f80-cc7bfe147681 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:37.613037 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a8dbd69b-2347-4029-9f80-cc7bfe147681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:37.644131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:37.681683 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 636/1294] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:37.950482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2df6d-c964-4b66-a7c3-b10b2a90554d None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:37.981481 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:38.058310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2df6d-c964-4b66-a7c3-b10b2a90554d None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:38.091892 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa86dd9-a055-47da-b12e-dccf38723596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:38.092519 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa86dd9-a055-47da-b12e-dccf38723596 None admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:38.092806 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa86dd9-a055-47da-b12e-dccf38723596 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:38.093077 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa86dd9-a055-47da-b12e-dccf38723596 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:38.093745 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa86dd9-a055-47da-b12e-dccf38723596 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:38.095096 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa86dd9-a055-47da-b12e-dccf38723596 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:38.110684 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 659/1295] 10.222.0.69 () {60 vars in 1141 bytes} [Mon Aug 29 21:29:37 2022] POST /identity/v3/services => generated 246 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:40.046595 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac0274-b854-4cb3-aa0b-78b867540d1e None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:40.047132 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac0274-b854-4cb3-aa0b-78b867540d1e None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:40.047132 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac0274-b854-4cb3-aa0b-78b867540d1e None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:40.048519 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 637/1296] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:40.053938 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16dbad-955e-4a5d-a188-4f7917d7fc21 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:40.054403 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16dbad-955e-4a5d-a188-4f7917d7fc21 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:40.054496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16dbad-955e-4a5d-a188-4f7917d7fc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:40.073066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-4f16dbad-955e-4a5d-a188-4f7917d7fc21 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:40.074267 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4f16dbad-955e-4a5d-a188-4f7917d7fc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:40.148974 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 660/1297] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:40 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:40.424271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac0274-b854-4cb3-aa0b-78b867540d1e None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:40.537832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac0274-b854-4cb3-aa0b-78b867540d1e None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:40.576486 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bd0c9-431e-4501-8fd0-faa1af1c5096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:40.577129 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bd0c9-431e-4501-8fd0-faa1af1c5096 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:40.577409 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bd0c9-431e-4501-8fd0-faa1af1c5096 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:40.577683 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bd0c9-431e-4501-8fd0-faa1af1c5096 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:40.578271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bd0c9-431e-4501-8fd0-faa1af1c5096 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:40.579645 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bd0c9-431e-4501-8fd0-faa1af1c5096 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:40.592170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-e34bd0c9-431e-4501-8fd0-faa1af1c5096 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:29:40.592170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:40.592170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:29:40.592170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:29:40.592170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:29:40.592170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:29:40.592170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:29:40.592170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:40.592170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:29:40.592170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:29:40.592170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:29:40.592170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:29:40.592170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:40.592170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:40.592170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:40.592170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:40.592170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:40.593656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:40.593656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:40.593656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:40.593656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:40.593656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:40.593656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:40.593656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:29:40.593656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:29:40.593656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:29:40.593656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:29:40.593656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:40.593656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:40.593656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:40.593656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:40.593656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:40.593656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:40.594617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:40.594617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:40.594617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:40.594617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:40.594617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:40.594617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:40.594617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:40.594617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:40.594617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:40.594617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:40.594617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:29:40.594617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:40.594617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:29:40.594617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:29:40.594617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 638/1298] 10.222.0.69 () {56 vars in 1117 bytes} [Mon Aug 29 21:29:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:40.599931 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16dbad-955e-4a5d-a188-4f7917d7fc21 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:40.619988 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:40.704648 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16dbad-955e-4a5d-a188-4f7917d7fc21 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:40.739474 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a8813-a5ac-4caa-8dca-35fe8497c89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:40.740076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a8813-a5ac-4caa-8dca-35fe8497c89d None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:40.740381 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a8813-a5ac-4caa-8dca-35fe8497c89d None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:40.740651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a8813-a5ac-4caa-8dca-35fe8497c89d None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:40.741274 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a8813-a5ac-4caa-8dca-35fe8497c89d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:40.741581 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a8813-a5ac-4caa-8dca-35fe8497c89d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:40.743196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a8813-a5ac-4caa-8dca-35fe8497c89d None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:40.748199 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 661/1299] 10.222.0.69 () {56 vars in 1116 bytes} [Mon Aug 29 21:29:40 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:40.754213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bd0c9-431e-4501-8fd0-faa1af1c5096 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:40.785765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:40.854267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bd0c9-431e-4501-8fd0-faa1af1c5096 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:40.889688 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4aa8bb-3ff9-463c-81af-2d1354a0da33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:40.890321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4aa8bb-3ff9-463c-81af-2d1354a0da33 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:40.890605 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4aa8bb-3ff9-463c-81af-2d1354a0da33 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:40.890880 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4aa8bb-3ff9-463c-81af-2d1354a0da33 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:40.891573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4aa8bb-3ff9-463c-81af-2d1354a0da33 None admin] RBAC: Adding query filter params (interface=public, service_id=1b6f518a10fa41bbb5ec3dea5732b27e, region_id=RegionOne) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:40.891883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4aa8bb-3ff9-463c-81af-2d1354a0da33 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:40.893283 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4aa8bb-3ff9-463c-81af-2d1354a0da33 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:40.898283 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 639/1300] 10.222.0.69 () {56 vars in 1251 bytes} [Mon Aug 29 21:29:40 2022] GET /identity/v3/endpoints?service_id=1b6f518a10fa41bbb5ec3dea5732b27e&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:40.903994 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a8813-a5ac-4caa-8dca-35fe8497c89d None admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:40.985922 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:41.005271 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a8813-a5ac-4caa-8dca-35fe8497c89d None admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:41.039946 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a9ef8-aa54-473a-a27a-97b330ad288f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:41.040583 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a9ef8-aa54-473a-a27a-97b330ad288f None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:41.040869 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a9ef8-aa54-473a-a27a-97b330ad288f None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:41.041145 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a9ef8-aa54-473a-a27a-97b330ad288f None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:41.041740 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a9ef8-aa54-473a-a27a-97b330ad288f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:41.043097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a9ef8-aa54-473a-a27a-97b330ad288f None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:41.049854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 662/1301] 10.222.0.69 () {56 vars in 1087 bytes} [Mon Aug 29 21:29:40 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:29:42.954214 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06788296-8a75-4d7b-9396-f3881dd242fe None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:42.954749 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06788296-8a75-4d7b-9396-f3881dd242fe None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:42.954749 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06788296-8a75-4d7b-9396-f3881dd242fe None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:42.956083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 640/1302] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:42.961140 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725b496-0b69-4abd-ac2e-842a3ec34d00 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:42.961575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725b496-0b69-4abd-ac2e-842a3ec34d00 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:42.961676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725b496-0b69-4abd-ac2e-842a3ec34d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:42.979911 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-5725b496-0b69-4abd-ac2e-842a3ec34d00 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:42.981123 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5725b496-0b69-4abd-ac2e-842a3ec34d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:43.051038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 663/1303] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:42 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:43.323982 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06788296-8a75-4d7b-9396-f3881dd242fe None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:43.444579 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:43.452202 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06788296-8a75-4d7b-9396-f3881dd242fe None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:43.493708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ad8ca-3bbc-47c1-8e70-5bbca0096982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:43.494255 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ad8ca-3bbc-47c1-8e70-5bbca0096982 None admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:43.494534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ad8ca-3bbc-47c1-8e70-5bbca0096982 None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:43.494871 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ad8ca-3bbc-47c1-8e70-5bbca0096982 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:43.495921 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ad8ca-3bbc-47c1-8e70-5bbca0096982 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:43.498248 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ad8ca-3bbc-47c1-8e70-5bbca0096982 None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:43.512312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application [None req-9b9ad8ca-3bbc-47c1-8e70-5bbca0096982 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:29:43.512312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:43.512312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:29:43.512312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:29:43.512312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:29:43.512312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:29:43.512312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:29:43.512312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:43.512312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:29:43.512312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:29:43.512312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:29:43.512312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:29:43.512312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:43.512312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:43.512312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:43.512312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:43.512312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:43.513571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:43.513571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:43.513571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:43.513571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:43.513571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:43.513571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:43.513571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:29:43.513571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:29:43.513571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:29:43.513571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:29:43.513571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:43.513571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:43.513571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:43.513571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:43.513571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:43.513571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:43.514601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:43.514601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:43.514601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:43.514601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:43.514601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:43.514601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:43.514601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:43.514601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:43.514601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:43.514601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:43.514601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:29:43.514601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:43.514601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:29:43.514601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: ERROR keystone.server.flask.application Aug 29 21:29:43.514601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 641/1304] 10.222.0.69 () {56 vars in 1117 bytes} [Mon Aug 29 21:29:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:43.519486 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725b496-0b69-4abd-ac2e-842a3ec34d00 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:43.623783 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:43.657992 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725b496-0b69-4abd-ac2e-842a3ec34d00 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:43.700356 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8cb3d-358d-4f75-a709-5e15a643add6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:43.704530 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8cb3d-358d-4f75-a709-5e15a643add6 None admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:43.704772 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8cb3d-358d-4f75-a709-5e15a643add6 None admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:43.705056 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8cb3d-358d-4f75-a709-5e15a643add6 None admin] PATH_INFO: `/v3/services` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:43.705701 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8cb3d-358d-4f75-a709-5e15a643add6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:43.706010 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8cb3d-358d-4f75-a709-5e15a643add6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:43.707386 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8cb3d-358d-4f75-a709-5e15a643add6 None admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:43.712670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 664/1305] 10.222.0.69 () {56 vars in 1116 bytes} [Mon Aug 29 21:29:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:43.719207 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ad8ca-3bbc-47c1-8e70-5bbca0096982 None admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:43.822385 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ad8ca-3bbc-47c1-8e70-5bbca0096982 None admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:43.855671 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f22be-7b3c-40a1-acbb-0593f4df9f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:43.856299 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f22be-7b3c-40a1-acbb-0593f4df9f7f None admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:43.856582 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f22be-7b3c-40a1-acbb-0593f4df9f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:43.856858 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f22be-7b3c-40a1-acbb-0593f4df9f7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:43.857526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f22be-7b3c-40a1-acbb-0593f4df9f7f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:43.858894 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f22be-7b3c-40a1-acbb-0593f4df9f7f None admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:43.879150 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 642/1306] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:29:43 2022] POST /identity/v3/endpoints => generated 331 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:53.709557 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=30 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:53.874613 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:50.455146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04630a87-6ac8-4ca4-a827-48d7eb01481f None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:50.455779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04630a87-6ac8-4ca4-a827-48d7eb01481f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:50.455779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04630a87-6ac8-4ca4-a827-48d7eb01481f None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:50.461942 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 665/1307] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:30:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:30:50.463802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eada7-befe-4931-8f3f-f5a4449234f1 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:50.464342 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eada7-befe-4931-8f3f-f5a4449234f1 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:50.464466 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eada7-befe-4931-8f3f-f5a4449234f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:50.638818 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-c13eada7-befe-4931-8f3f-f5a4449234f1 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:50.640466 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-c13eada7-befe-4931-8f3f-f5a4449234f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:50.928784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 643/1308] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:51.229974 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a1d62-4b15-4214-8150-0c781727281a None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:51.230308 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a1d62-4b15-4214-8150-0c781727281a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:51.230587 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a1d62-4b15-4214-8150-0c781727281a None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:51.232003 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 666/1309] 10.222.0.69 () {54 vars in 965 bytes} [Mon Aug 29 21:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:30:51.239133 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbaa9dd-eda9-40c1-ae63-539d1525216c None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:51.239941 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbaa9dd-eda9-40c1-ae63-539d1525216c None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:51.240923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbaa9dd-eda9-40c1-ae63-539d1525216c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:51.366174 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-afbaa9dd-eda9-40c1-ae63-539d1525216c None None] MFA Rules not processed for user `dfa16ba58c0040f8bdfa5e46f2681395`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:51.367599 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-afbaa9dd-eda9-40c1-ae63-539d1525216c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:51.399812 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:51.476990 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 644/1310] 10.222.0.69 () {58 vars in 1062 bytes} [Mon Aug 29 21:30:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:30:51.488466 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a1d62-4b15-4214-8150-0c781727281a None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:51.490145 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a10a1d62-4b15-4214-8150-0c781727281a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:51.646869 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a1d62-4b15-4214-8150-0c781727281a None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:51.732622 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe61edb-5817-48f1-8019-0b0a29c07af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:51.733241 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe61edb-5817-48f1-8019-0b0a29c07af7 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:51.733519 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe61edb-5817-48f1-8019-0b0a29c07af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:51.733792 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe61edb-5817-48f1-8019-0b0a29c07af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:51.735410 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ebe61edb-5817-48f1-8019-0b0a29c07af7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:51.794812 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:51.858283 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe61edb-5817-48f1-8019-0b0a29c07af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:51.860053 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe61edb-5817-48f1-8019-0b0a29c07af7 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:51.884667 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 667/1311] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:54.147571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89738abb-c3b7-4985-9c34-e980f7d5b0c2 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:54.148130 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89738abb-c3b7-4985-9c34-e980f7d5b0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:54.148130 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89738abb-c3b7-4985-9c34-e980f7d5b0c2 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:54.149550 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 645/1312] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:30:54.155474 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ada19-1804-4ced-844b-ef843c637680 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:54.156008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ada19-1804-4ced-844b-ef843c637680 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:54.156008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ada19-1804-4ced-844b-ef843c637680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:54.246574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-6f2ada19-1804-4ced-844b-ef843c637680 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:54.248055 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-6f2ada19-1804-4ced-844b-ef843c637680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:54.351347 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 668/1313] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:54.651838 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532df9b-384e-414b-8fb1-0fba115705ad None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:54.652122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532df9b-384e-414b-8fb1-0fba115705ad None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:54.652422 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532df9b-384e-414b-8fb1-0fba115705ad None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:54.653770 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 646/1314] 10.222.0.69 () {54 vars in 965 bytes} [Mon Aug 29 21:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:30:54.659920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df9a40-7b94-4c5e-8175-ba7786f796b2 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:54.660234 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df9a40-7b94-4c5e-8175-ba7786f796b2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:54.660514 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df9a40-7b94-4c5e-8175-ba7786f796b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:54.672017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:54.741977 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d3df9a40-7b94-4c5e-8175-ba7786f796b2 None None] MFA Rules not processed for user `dfa16ba58c0040f8bdfa5e46f2681395`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:54.743113 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d3df9a40-7b94-4c5e-8175-ba7786f796b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:54.823743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 669/1315] 10.222.0.69 () {58 vars in 1062 bytes} [Mon Aug 29 21:30:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:54.833116 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532df9b-384e-414b-8fb1-0fba115705ad None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:54.834691 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-7532df9b-384e-414b-8fb1-0fba115705ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:54.941806 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532df9b-384e-414b-8fb1-0fba115705ad None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:55.013620 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:55.016598 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a715c23-4bd5-4ca7-816d-7de3efbb14ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:55.017435 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a715c23-4bd5-4ca7-816d-7de3efbb14ec service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:55.017934 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a715c23-4bd5-4ca7-816d-7de3efbb14ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:55.018226 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a715c23-4bd5-4ca7-816d-7de3efbb14ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:55.019886 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-9a715c23-4bd5-4ca7-816d-7de3efbb14ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:55.132267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a715c23-4bd5-4ca7-816d-7de3efbb14ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:55.133717 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a715c23-4bd5-4ca7-816d-7de3efbb14ec service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:55.152447 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 647/1316] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:30:57.609112 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801c4e5-4466-4680-a05d-b7a3c0348624 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:57.609642 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801c4e5-4466-4680-a05d-b7a3c0348624 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:57.609642 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801c4e5-4466-4680-a05d-b7a3c0348624 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:57.610931 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 670/1317] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:30:57.616813 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6160f-2fd5-46ce-821c-64081ad0aaa7 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:57.617242 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6160f-2fd5-46ce-821c-64081ad0aaa7 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:57.617365 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6160f-2fd5-46ce-821c-64081ad0aaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:57.684726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-ddc6160f-2fd5-46ce-821c-64081ad0aaa7 None None] MFA Rules not processed for user `11f0143c2b4e42a4ab57c2570a1d80e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:57.685944 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-ddc6160f-2fd5-46ce-821c-64081ad0aaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:57.737898 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:57.783082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 648/1318] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:30:57 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:30:58.075148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801c4e5-4466-4680-a05d-b7a3c0348624 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:58.076669 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3801c4e5-4466-4680-a05d-b7a3c0348624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:58.182617 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801c4e5-4466-4680-a05d-b7a3c0348624 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:58.185512 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:58.258437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72609c2-741f-44ae-a836-5266583c082d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:58.259047 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72609c2-741f-44ae-a836-5266583c082d service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:58.259330 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72609c2-741f-44ae-a836-5266583c082d service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:58.259606 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72609c2-741f-44ae-a836-5266583c082d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:58.261252 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d72609c2-741f-44ae-a836-5266583c082d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:58.380062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72609c2-741f-44ae-a836-5266583c082d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:58.381420 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72609c2-741f-44ae-a836-5266583c082d service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:58.404107 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 671/1319] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:30:58 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:00.884606 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ce046-a9ab-4775-9695-b1f9e8f1c5ed None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:00.885136 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ce046-a9ab-4775-9695-b1f9e8f1c5ed None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:00.885233 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ce046-a9ab-4775-9695-b1f9e8f1c5ed None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:00.886498 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 649/1320] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:31:00.891911 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979545a2-12d3-4681-a931-985a59590bf6 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:00.892431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979545a2-12d3-4681-a931-985a59590bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:00.892530 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979545a2-12d3-4681-a931-985a59590bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:00.935677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:00.961421 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-979545a2-12d3-4681-a931-985a59590bf6 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:00.962736 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-979545a2-12d3-4681-a931-985a59590bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:01.074094 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 672/1321] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:31:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:01.356289 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ce046-a9ab-4775-9695-b1f9e8f1c5ed None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:01.357883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-567ce046-a9ab-4775-9695-b1f9e8f1c5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:01.465409 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ce046-a9ab-4775-9695-b1f9e8f1c5ed None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:01.540119 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8161c9a-93ad-4b6e-82ff-27d476bd8344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:01.540749 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8161c9a-93ad-4b6e-82ff-27d476bd8344 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:01.541027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8161c9a-93ad-4b6e-82ff-27d476bd8344 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:01.541296 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8161c9a-93ad-4b6e-82ff-27d476bd8344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:01.542883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-e8161c9a-93ad-4b6e-82ff-27d476bd8344 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:01.549835 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:01.653211 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8161c9a-93ad-4b6e-82ff-27d476bd8344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:01.654762 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8161c9a-93ad-4b6e-82ff-27d476bd8344 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:01.673012 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 650/1322] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:04.259463 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86be96a-80ab-4b6c-9816-4af7748c2465 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:04.260056 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86be96a-80ab-4b6c-9816-4af7748c2465 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:04.260056 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86be96a-80ab-4b6c-9816-4af7748c2465 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:04.261778 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 673/1323] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:31:04.267061 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b99e5-7688-4914-a598-55a02cb6d634 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:04.267500 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b99e5-7688-4914-a598-55a02cb6d634 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:04.267703 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b99e5-7688-4914-a598-55a02cb6d634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:04.341898 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-1d5b99e5-7688-4914-a598-55a02cb6d634 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:04.343124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-1d5b99e5-7688-4914-a598-55a02cb6d634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:04.404451 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:04.445658 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 651/1324] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:04.739928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86be96a-80ab-4b6c-9816-4af7748c2465 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:04.741560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c86be96a-80ab-4b6c-9816-4af7748c2465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:04.849344 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86be96a-80ab-4b6c-9816-4af7748c2465 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:04.861598 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:04.926811 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f72f37-0f94-4070-846f-f04c8d7e58fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:04.927418 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f72f37-0f94-4070-846f-f04c8d7e58fd service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:04.927700 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f72f37-0f94-4070-846f-f04c8d7e58fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:04.927975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f72f37-0f94-4070-846f-f04c8d7e58fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:04.929624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-82f72f37-0f94-4070-846f-f04c8d7e58fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:05.049786 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f72f37-0f94-4070-846f-f04c8d7e58fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:05.051664 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f72f37-0f94-4070-846f-f04c8d7e58fd service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:05.072054 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 674/1325] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:07.077171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b40ea-7ae7-4c4d-8bcc-8bc98093f02f None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:07.077735 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b40ea-7ae7-4c4d-8bcc-8bc98093f02f None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:07.077735 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b40ea-7ae7-4c4d-8bcc-8bc98093f02f None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:07.079130 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 652/1326] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:31:07.084738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384dc0c-19d1-4def-86d2-37d53ae4dc12 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:07.085212 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384dc0c-19d1-4def-86d2-37d53ae4dc12 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:07.085336 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384dc0c-19d1-4def-86d2-37d53ae4dc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:07.142054 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:07.164346 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-a384dc0c-19d1-4def-86d2-37d53ae4dc12 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:07.165556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a384dc0c-19d1-4def-86d2-37d53ae4dc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:07.278339 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 675/1327] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:07.563195 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b40ea-7ae7-4c4d-8bcc-8bc98093f02f None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:07.564783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-7e2b40ea-7ae7-4c4d-8bcc-8bc98093f02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:07.686307 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b40ea-7ae7-4c4d-8bcc-8bc98093f02f None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:07.770981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf81b8-29d9-46a7-ade9-69f588831a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:07.771594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf81b8-29d9-46a7-ade9-69f588831a76 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:07.771879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf81b8-29d9-46a7-ade9-69f588831a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:07.772152 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf81b8-29d9-46a7-ade9-69f588831a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:07.773780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-2eaf81b8-29d9-46a7-ade9-69f588831a76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:07.791703 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:07.892511 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf81b8-29d9-46a7-ade9-69f588831a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:07.893992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf81b8-29d9-46a7-ade9-69f588831a76 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:07.913186 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 653/1328] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:09.907467 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edbdda-773b-4715-bf6d-96997154e8ce None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:09.907961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edbdda-773b-4715-bf6d-96997154e8ce None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:09.908077 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edbdda-773b-4715-bf6d-96997154e8ce None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:09.909941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 676/1329] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:31:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:31:09.915393 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e11ba-cc60-4989-b50b-01558cf0537f None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:09.915829 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e11ba-cc60-4989-b50b-01558cf0537f None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:09.915957 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e11ba-cc60-4989-b50b-01558cf0537f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:09.991726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-a22e11ba-cc60-4989-b50b-01558cf0537f None None] MFA Rules not processed for user `11f0143c2b4e42a4ab57c2570a1d80e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:09.993015 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a22e11ba-cc60-4989-b50b-01558cf0537f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:10.064275 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:10.097985 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 654/1330] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:31:09 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:10.392335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edbdda-773b-4715-bf6d-96997154e8ce None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:10.392335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f3edbdda-773b-4715-bf6d-96997154e8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:10.521034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edbdda-773b-4715-bf6d-96997154e8ce None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:10.548403 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:10.610753 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f50ba9-0bff-410d-b4f3-392946f6b51c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:10.611363 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f50ba9-0bff-410d-b4f3-392946f6b51c service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:10.611641 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f50ba9-0bff-410d-b4f3-392946f6b51c service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:10.611928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f50ba9-0bff-410d-b4f3-392946f6b51c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:10.613739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-99f50ba9-0bff-410d-b4f3-392946f6b51c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:10.741072 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f50ba9-0bff-410d-b4f3-392946f6b51c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:10.742426 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f50ba9-0bff-410d-b4f3-392946f6b51c service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:10.765021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 677/1331] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:10 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:13.111624 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37403f99-ba26-42c6-914b-e9c112fe8626 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:13.112327 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37403f99-ba26-42c6-914b-e9c112fe8626 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:13.112327 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37403f99-ba26-42c6-914b-e9c112fe8626 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:13.113623 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 655/1332] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:31:13.118840 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc774bf-122b-4f0d-9218-c7ccc72b7af6 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:13.119247 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc774bf-122b-4f0d-9218-c7ccc72b7af6 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:13.119397 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc774bf-122b-4f0d-9218-c7ccc72b7af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:13.184605 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:13.187669 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-5bc774bf-122b-4f0d-9218-c7ccc72b7af6 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:13.189570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5bc774bf-122b-4f0d-9218-c7ccc72b7af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:13.291147 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 678/1333] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:13.586832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37403f99-ba26-42c6-914b-e9c112fe8626 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:13.588405 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-37403f99-ba26-42c6-914b-e9c112fe8626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:13.691816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37403f99-ba26-42c6-914b-e9c112fe8626 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:13.765542 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7f8dc-b197-4442-809a-de61fa06909d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:13.766154 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7f8dc-b197-4442-809a-de61fa06909d service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:13.766435 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7f8dc-b197-4442-809a-de61fa06909d service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:13.766710 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7f8dc-b197-4442-809a-de61fa06909d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:13.768380 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-1dc7f8dc-b197-4442-809a-de61fa06909d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:13.796766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:13.881014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7f8dc-b197-4442-809a-de61fa06909d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:13.882606 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7f8dc-b197-4442-809a-de61fa06909d service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:13.902461 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 656/1334] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:31:15.891890 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0ec82-9fd9-4928-86e7-754420c386fb None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:15.892483 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0ec82-9fd9-4928-86e7-754420c386fb None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:15.892483 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0ec82-9fd9-4928-86e7-754420c386fb None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:15.893822 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 679/1335] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:31:15.899151 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378840b-e768-47cf-9758-eb64c197841d None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:15.899568 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378840b-e768-47cf-9758-eb64c197841d None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:15.899700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378840b-e768-47cf-9758-eb64c197841d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:15.965920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-0378840b-e768-47cf-9758-eb64c197841d None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:15.967377 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-0378840b-e768-47cf-9758-eb64c197841d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:16.042452 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:16.066563 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 657/1336] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:16.353745 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0ec82-9fd9-4928-86e7-754420c386fb None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:16.355371 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-98b0ec82-9fd9-4928-86e7-754420c386fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:16.466512 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0ec82-9fd9-4928-86e7-754420c386fb None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:16.496644 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:16.543753 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b840fc-85ef-4968-ab37-a4bcc9ac37b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:16.544391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b840fc-85ef-4968-ab37-a4bcc9ac37b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:16.544674 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b840fc-85ef-4968-ab37-a4bcc9ac37b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:16.544948 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b840fc-85ef-4968-ab37-a4bcc9ac37b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:16.546570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-13b840fc-85ef-4968-ab37-a4bcc9ac37b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:16.659844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b840fc-85ef-4968-ab37-a4bcc9ac37b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:16.661314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b840fc-85ef-4968-ab37-a4bcc9ac37b9 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:16.679340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 680/1337] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:19.084621 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f8ee3-886f-4dc1-84c0-8241f7216234 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:19.085197 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f8ee3-886f-4dc1-84c0-8241f7216234 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:19.085197 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f8ee3-886f-4dc1-84c0-8241f7216234 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:19.086483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 658/1338] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:31:19.091741 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c1d31-b490-4f52-80a2-e6262880ca68 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:19.092145 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c1d31-b490-4f52-80a2-e6262880ca68 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:19.092465 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c1d31-b490-4f52-80a2-e6262880ca68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:19.159237 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f84c1d31-b490-4f52-80a2-e6262880ca68 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:19.161002 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f84c1d31-b490-4f52-80a2-e6262880ca68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:19.170671 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:19.272938 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 681/1339] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:31:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:19.557314 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f8ee3-886f-4dc1-84c0-8241f7216234 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:19.558873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-027f8ee3-886f-4dc1-84c0-8241f7216234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:19.667126 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f8ee3-886f-4dc1-84c0-8241f7216234 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:19.740914 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d92335-5238-4396-86e3-579c9adba922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:19.741436 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d92335-5238-4396-86e3-579c9adba922 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:19.741710 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d92335-5238-4396-86e3-579c9adba922 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:19.741978 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d92335-5238-4396-86e3-579c9adba922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:19.743584 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-08d92335-5238-4396-86e3-579c9adba922 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:19.780964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:19.855797 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d92335-5238-4396-86e3-579c9adba922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:19.857280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d92335-5238-4396-86e3-579c9adba922 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:19.876419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 659/1340] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:23.893391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53eb8f-8e72-494b-a159-9005be8e8cc6 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:23.893967 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53eb8f-8e72-494b-a159-9005be8e8cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:23.893967 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53eb8f-8e72-494b-a159-9005be8e8cc6 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:23.895556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 682/1341] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:31:23.900956 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0a0b9-a3b9-405c-bb6d-313dd4d66fa9 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:23.901432 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0a0b9-a3b9-405c-bb6d-313dd4d66fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:23.901544 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0a0b9-a3b9-405c-bb6d-313dd4d66fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:23.973359 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-a5c0a0b9-a3b9-405c-bb6d-313dd4d66fa9 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:23.974583 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a5c0a0b9-a3b9-405c-bb6d-313dd4d66fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:24.066113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:24.079811 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 660/1342] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:24.368162 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53eb8f-8e72-494b-a159-9005be8e8cc6 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:24.369762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9e53eb8f-8e72-494b-a159-9005be8e8cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:24.485806 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53eb8f-8e72-494b-a159-9005be8e8cc6 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:24.527891 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:24.565770 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc3e62-4e28-4002-9f40-6dfbeff0623d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:24.566389 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc3e62-4e28-4002-9f40-6dfbeff0623d service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:24.566668 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc3e62-4e28-4002-9f40-6dfbeff0623d service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:24.566941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc3e62-4e28-4002-9f40-6dfbeff0623d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:24.568582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cfdc3e62-4e28-4002-9f40-6dfbeff0623d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:24.684858 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc3e62-4e28-4002-9f40-6dfbeff0623d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:24.686152 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc3e62-4e28-4002-9f40-6dfbeff0623d service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:24.704650 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 683/1343] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:31:27.304556 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724a265-af9f-43f2-a5aa-cb4aaf68967d None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:27.305336 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724a265-af9f-43f2-a5aa-cb4aaf68967d None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:27.305336 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724a265-af9f-43f2-a5aa-cb4aaf68967d None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:27.306779 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 661/1344] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:31:27.312496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cb5c8-2138-4a92-804d-b85658c93119 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:27.312980 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cb5c8-2138-4a92-804d-b85658c93119 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:27.313081 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cb5c8-2138-4a92-804d-b85658c93119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:27.382458 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-324cb5c8-2138-4a92-804d-b85658c93119 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:27.383670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-324cb5c8-2138-4a92-804d-b85658c93119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:27.405943 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:27.490606 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 684/1345] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:31:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:27.773736 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724a265-af9f-43f2-a5aa-cb4aaf68967d None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:27.775306 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-c724a265-af9f-43f2-a5aa-cb4aaf68967d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:27.883826 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724a265-af9f-43f2-a5aa-cb4aaf68967d None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:27.969442 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f0403-be2d-4f54-afb9-98afcf62b2a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:27.970050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f0403-be2d-4f54-afb9-98afcf62b2a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:27.970321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f0403-be2d-4f54-afb9-98afcf62b2a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:27.970593 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f0403-be2d-4f54-afb9-98afcf62b2a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:27.972344 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-0f3f0403-be2d-4f54-afb9-98afcf62b2a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:28.019651 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:28.089823 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f0403-be2d-4f54-afb9-98afcf62b2a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:28.091403 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f0403-be2d-4f54-afb9-98afcf62b2a1 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:28.110868 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 662/1346] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:32.334308 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae96b7e-7b49-42c9-b312-55f78ffdd3f1 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:32.334920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae96b7e-7b49-42c9-b312-55f78ffdd3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:32.334920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae96b7e-7b49-42c9-b312-55f78ffdd3f1 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:32.336219 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 685/1347] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:31:32.341723 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1dcb91-e794-4a16-b1dc-beb72e7187c7 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:32.342211 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1dcb91-e794-4a16-b1dc-beb72e7187c7 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:32.342324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1dcb91-e794-4a16-b1dc-beb72e7187c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:32.419313 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-ba1dcb91-e794-4a16-b1dc-beb72e7187c7 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:32.420637 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-ba1dcb91-e794-4a16-b1dc-beb72e7187c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:32.529787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:32.552386 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 663/1348] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:31:32.826604 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae96b7e-7b49-42c9-b312-55f78ffdd3f1 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:32.828452 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-dae96b7e-7b49-42c9-b312-55f78ffdd3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:32.967463 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae96b7e-7b49-42c9-b312-55f78ffdd3f1 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:33.021167 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:33.053874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfec131-6986-41c4-bdcc-d5e321e16adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:33.054494 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfec131-6986-41c4-bdcc-d5e321e16adb service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:33.054803 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfec131-6986-41c4-bdcc-d5e321e16adb service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:33.055075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfec131-6986-41c4-bdcc-d5e321e16adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:33.057071 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-dcfec131-6986-41c4-bdcc-d5e321e16adb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:33.172358 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfec131-6986-41c4-bdcc-d5e321e16adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:33.173802 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfec131-6986-41c4-bdcc-d5e321e16adb service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:33.192787 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 686/1349] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:31:38.276894 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f9750-dedd-4434-a8cf-13f81ef83b8d None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:38.277515 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f9750-dedd-4434-a8cf-13f81ef83b8d None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:38.277515 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f9750-dedd-4434-a8cf-13f81ef83b8d None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:38.279110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 664/1350] 10.222.0.69 () {54 vars in 921 bytes} [Mon Aug 29 21:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:31:38.286951 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e3ac6-4576-4b82-8705-f9401c4452e2 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:38.287816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e3ac6-4576-4b82-8705-f9401c4452e2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:38.288096 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e3ac6-4576-4b82-8705-f9401c4452e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:38.410954 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-e20e3ac6-4576-4b82-8705-f9401c4452e2 None None] MFA Rules not processed for user `a7911672bb2a471daf4f69ba940ef41d`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:38.412254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e20e3ac6-4576-4b82-8705-f9401c4452e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:38.437815 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:38.578041 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 687/1351] 10.222.0.69 () {58 vars in 1018 bytes} [Mon Aug 29 21:31:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:43.225485 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09175339-11d8-4526-89e3-8b1d5dc34c7f None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:43.226471 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09175339-11d8-4526-89e3-8b1d5dc34c7f None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:43.227033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09175339-11d8-4526-89e3-8b1d5dc34c7f None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:43.228569 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 665/1352] 10.222.0.69 () {54 vars in 921 bytes} [Mon Aug 29 21:31:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:31:43.236691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb69ef-67b4-4ade-a563-57810f44f1e3 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:43.237192 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb69ef-67b4-4ade-a563-57810f44f1e3 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:43.237435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb69ef-67b4-4ade-a563-57810f44f1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:43.344629 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-dccb69ef-67b4-4ade-a563-57810f44f1e3 None None] MFA Rules not processed for user `a7911672bb2a471daf4f69ba940ef41d`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:43.346644 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-dccb69ef-67b4-4ade-a563-57810f44f1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:43.490443 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:43.541869 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 688/1353] 10.222.0.69 () {58 vars in 1018 bytes} [Mon Aug 29 21:31:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:45.342892 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52177831-cc9d-47ee-bebe-244d5b42b71d None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:45.343452 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52177831-cc9d-47ee-bebe-244d5b42b71d None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:45.343703 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52177831-cc9d-47ee-bebe-244d5b42b71d None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:45.345123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 666/1354] 10.222.0.69 () {54 vars in 921 bytes} [Mon Aug 29 21:31:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:31:45.351370 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c011a62-48a3-4153-a10a-676b0fbd256d None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:45.351849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c011a62-48a3-4153-a10a-676b0fbd256d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:45.352145 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c011a62-48a3-4153-a10a-676b0fbd256d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:45.453592 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-6c011a62-48a3-4153-a10a-676b0fbd256d None None] MFA Rules not processed for user `a7911672bb2a471daf4f69ba940ef41d`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:45.455443 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-6c011a62-48a3-4153-a10a-676b0fbd256d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:45.601103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 689/1355] 10.222.0.69 () {58 vars in 1018 bytes} [Mon Aug 29 21:31:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:48.998128 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0779bb6-2f3e-414a-a27a-ecfc3856956b None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:48.998624 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0779bb6-2f3e-414a-a27a-ecfc3856956b None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:48.998723 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0779bb6-2f3e-414a-a27a-ecfc3856956b None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:49.000019 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 667/1356] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:31:49.005512 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3f23c-3594-4575-a58c-3d07861c1734 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:49.005930 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3f23c-3594-4575-a58c-3d07861c1734 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:49.006070 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3f23c-3594-4575-a58c-3d07861c1734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:49.047771 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:49.082734 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-98b3f23c-3594-4575-a58c-3d07861c1734 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:49.083969 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-98b3f23c-3594-4575-a58c-3d07861c1734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:49.215371 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 690/1357] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:49.551286 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559c827-ee47-46a9-adf9-2027321bc6d5 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:49.552245 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559c827-ee47-46a9-adf9-2027321bc6d5 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:49.553058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559c827-ee47-46a9-adf9-2027321bc6d5 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:49.555127 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 668/1358] 10.222.0.69 () {54 vars in 962 bytes} [Mon Aug 29 21:31:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:31:49.573423 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c89d4-87aa-446d-b5e6-c2dd469ed84b None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:49.573861 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c89d4-87aa-446d-b5e6-c2dd469ed84b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:49.574228 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c89d4-87aa-446d-b5e6-c2dd469ed84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:49.676852 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-2d7c89d4-87aa-446d-b5e6-c2dd469ed84b None None] MFA Rules not processed for user `96c35c544cae4ad187f1a1be723e0d21`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:49.678080 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2d7c89d4-87aa-446d-b5e6-c2dd469ed84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:49.746209 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:49.843898 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 691/1359] 10.222.0.69 () {58 vars in 1059 bytes} [Mon Aug 29 21:31:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:49.853018 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559c827-ee47-46a9-adf9-2027321bc6d5 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:49.855618 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-5559c827-ee47-46a9-adf9-2027321bc6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:50.021237 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559c827-ee47-46a9-adf9-2027321bc6d5 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:50.106511 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:50.153441 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf9ecc-cdee-4bd6-a694-94c0a5199606 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:50.154220 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf9ecc-cdee-4bd6-a694-94c0a5199606 service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:50.154605 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf9ecc-cdee-4bd6-a694-94c0a5199606 service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:50.154999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf9ecc-cdee-4bd6-a694-94c0a5199606 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:50.156755 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-8ecf9ecc-cdee-4bd6-a694-94c0a5199606 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:50.260322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf9ecc-cdee-4bd6-a694-94c0a5199606 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:50.262091 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf9ecc-cdee-4bd6-a694-94c0a5199606 service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:50.282742 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 669/1360] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:52.510716 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed6524-7d36-446c-b5f2-a6aa51018d65 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:52.511323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed6524-7d36-446c-b5f2-a6aa51018d65 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:52.511323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed6524-7d36-446c-b5f2-a6aa51018d65 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:52.512880 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 692/1361] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:31:52.518152 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7990f85-f969-4cd9-87eb-ea17db0a9cb8 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:52.518647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7990f85-f969-4cd9-87eb-ea17db0a9cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:52.518745 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7990f85-f969-4cd9-87eb-ea17db0a9cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:52.600921 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-a7990f85-f969-4cd9-87eb-ea17db0a9cb8 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:52.602139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a7990f85-f969-4cd9-87eb-ea17db0a9cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:52.646075 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:52.715667 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 670/1362] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:53.019827 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed6524-7d36-446c-b5f2-a6aa51018d65 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:53.021874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-30ed6524-7d36-446c-b5f2-a6aa51018d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:53.255717 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed6524-7d36-446c-b5f2-a6aa51018d65 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:53.266928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:53.397633 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfcc8b-d44e-42b7-9fab-f60463864968 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:53.398343 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfcc8b-d44e-42b7-9fab-f60463864968 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:53.399317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfcc8b-d44e-42b7-9fab-f60463864968 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:53.399688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfcc8b-d44e-42b7-9fab-f60463864968 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:53.401448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-02cfcc8b-d44e-42b7-9fab-f60463864968 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:53.532792 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfcc8b-d44e-42b7-9fab-f60463864968 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:53.534614 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfcc8b-d44e-42b7-9fab-f60463864968 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:53.566756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 693/1363] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:55.916133 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfad35f-6163-486d-9950-160e2c111b61 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:55.916702 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfad35f-6163-486d-9950-160e2c111b61 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:55.916702 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfad35f-6163-486d-9950-160e2c111b61 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:55.918102 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 671/1364] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:31:55.924571 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37248fd7-c43d-4356-a947-78b22b2b2bd3 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:55.925118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37248fd7-c43d-4356-a947-78b22b2b2bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:55.925220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37248fd7-c43d-4356-a947-78b22b2b2bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:55.944151 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:56.015840 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-37248fd7-c43d-4356-a947-78b22b2b2bd3 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:56.017417 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-37248fd7-c43d-4356-a947-78b22b2b2bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:56.147959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 694/1365] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:56.452946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965ec61-3973-413f-851f-aba46ab662ed None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:56.453354 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965ec61-3973-413f-851f-aba46ab662ed None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:56.453867 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965ec61-3973-413f-851f-aba46ab662ed None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:56.455717 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 672/1366] 10.222.0.69 () {54 vars in 962 bytes} [Mon Aug 29 21:31:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:31:56.462638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320f03a-f1bc-4455-8c6f-953ec470b602 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:56.463151 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320f03a-f1bc-4455-8c6f-953ec470b602 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:56.463631 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320f03a-f1bc-4455-8c6f-953ec470b602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:56.559011 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-b320f03a-f1bc-4455-8c6f-953ec470b602 None None] MFA Rules not processed for user `96c35c544cae4ad187f1a1be723e0d21`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:56.560619 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b320f03a-f1bc-4455-8c6f-953ec470b602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:56.600571 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:56.698510 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 695/1367] 10.222.0.69 () {58 vars in 1059 bytes} [Mon Aug 29 21:31:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:56.706805 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965ec61-3973-413f-851f-aba46ab662ed None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:56.708452 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a965ec61-3973-413f-851f-aba46ab662ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:56.881698 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965ec61-3973-413f-851f-aba46ab662ed None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:56.906698 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:57.018579 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728619e9-afb0-4261-af85-ea21ff10b735 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:57.019233 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728619e9-afb0-4261-af85-ea21ff10b735 service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:57.019605 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728619e9-afb0-4261-af85-ea21ff10b735 service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:57.019974 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728619e9-afb0-4261-af85-ea21ff10b735 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:57.021745 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-728619e9-afb0-4261-af85-ea21ff10b735 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:57.124097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728619e9-afb0-4261-af85-ea21ff10b735 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:57.126073 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728619e9-afb0-4261-af85-ea21ff10b735 service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:57.147007 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 673/1368] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:57.902281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758462b-e398-4adf-869e-ddfef5a6296e None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:57.902816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758462b-e398-4adf-869e-ddfef5a6296e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:57.902816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758462b-e398-4adf-869e-ddfef5a6296e None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:57.904905 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 696/1369] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:31:57.910123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab867f-5120-4c3d-8216-097eaf9ff5c5 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:57.910414 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab867f-5120-4c3d-8216-097eaf9ff5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:57.910696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab867f-5120-4c3d-8216-097eaf9ff5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:57.946545 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:57.983787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-95ab867f-5120-4c3d-8216-097eaf9ff5c5 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:57.985036 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-95ab867f-5120-4c3d-8216-097eaf9ff5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:58.096034 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 674/1370] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:58.698599 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27de715-6eff-4a5c-a75b-ed7194c67749 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:58.698599 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27de715-6eff-4a5c-a75b-ed7194c67749 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:58.698599 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27de715-6eff-4a5c-a75b-ed7194c67749 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:58.700036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 697/1371] 10.222.0.69 () {54 vars in 964 bytes} [Mon Aug 29 21:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:31:58.704849 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ad7b4-44d6-491c-b684-212e879842f4 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:58.705264 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ad7b4-44d6-491c-b684-212e879842f4 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:58.705640 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ad7b4-44d6-491c-b684-212e879842f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:58.798820 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-d72ad7b4-44d6-491c-b684-212e879842f4 None None] MFA Rules not processed for user `ad05a52c8aec4744a41639f2343eb54f`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:58.800839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-d72ad7b4-44d6-491c-b684-212e879842f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:58.856672 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:58.898885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 675/1372] 10.222.0.69 () {58 vars in 1061 bytes} [Mon Aug 29 21:31:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:58.906715 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27de715-6eff-4a5c-a75b-ed7194c67749 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:58.908380 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b27de715-6eff-4a5c-a75b-ed7194c67749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:59.023616 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27de715-6eff-4a5c-a75b-ed7194c67749 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:59.072610 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:59.108389 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38aea5-236a-44b2-a3b4-f968165eeb91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:59.109041 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38aea5-236a-44b2-a3b4-f968165eeb91 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:59.109318 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38aea5-236a-44b2-a3b4-f968165eeb91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:59.109764 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38aea5-236a-44b2-a3b4-f968165eeb91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:59.111406 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-8c38aea5-236a-44b2-a3b4-f968165eeb91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:59.189809 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7ef33-53f3-48ca-93e0-4b40068b0be8 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:59.190980 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7ef33-53f3-48ca-93e0-4b40068b0be8 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:59.191683 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7ef33-53f3-48ca-93e0-4b40068b0be8 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:59.199997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 676/1373] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:31:59 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:31:59.201302 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425a4e1-55b5-457b-89fe-3f94d2325de9 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:59.201559 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425a4e1-55b5-457b-89fe-3f94d2325de9 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:59.201846 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425a4e1-55b5-457b-89fe-3f94d2325de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:59.260218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38aea5-236a-44b2-a3b4-f968165eeb91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:31:59.262126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38aea5-236a-44b2-a3b4-f968165eeb91 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:31:59.283099 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-e425a4e1-55b5-457b-89fe-3f94d2325de9 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:31:59.289228 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-e425a4e1-55b5-457b-89fe-3f94d2325de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:59.289823 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 698/1374] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:31:59.439536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 677/1375] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:31:59.734356 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38aea5-236a-44b2-a3b4-f968165eeb91 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:31:59.735573 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-8c38aea5-236a-44b2-a3b4-f968165eeb91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:31:59.807135 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:59.839723 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38aea5-236a-44b2-a3b4-f968165eeb91 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:31:59.961199 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794deb8b-fb3c-4699-9f88-0dadb34244b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:31:59.961892 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794deb8b-fb3c-4699-9f88-0dadb34244b4 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:31:59.962083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794deb8b-fb3c-4699-9f88-0dadb34244b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:31:59.962380 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794deb8b-fb3c-4699-9f88-0dadb34244b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:31:59.964257 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-794deb8b-fb3c-4699-9f88-0dadb34244b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:00.080600 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794deb8b-fb3c-4699-9f88-0dadb34244b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:00.081241 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:00.084886 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794deb8b-fb3c-4699-9f88-0dadb34244b4 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:00.105087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 699/1376] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:31:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:02.091362 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbf486-8d9a-489b-95b7-7202728382d4 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:02.092073 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbf486-8d9a-489b-95b7-7202728382d4 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:02.092073 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbf486-8d9a-489b-95b7-7202728382d4 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:02.093534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 678/1377] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:32:02.099391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf3b24-961e-4f8b-be79-2101e5bb129a None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:02.099834 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf3b24-961e-4f8b-be79-2101e5bb129a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:02.099973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf3b24-961e-4f8b-be79-2101e5bb129a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:02.172703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-84cf3b24-961e-4f8b-be79-2101e5bb129a None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:02.174101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-84cf3b24-961e-4f8b-be79-2101e5bb129a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:02.275633 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 700/1378] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:02.577199 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbf486-8d9a-489b-95b7-7202728382d4 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:02.578700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f8fbf486-8d9a-489b-95b7-7202728382d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:02.633243 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:02.732417 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbf486-8d9a-489b-95b7-7202728382d4 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:02.869530 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edf11c-143c-4708-97f9-c4182fd28ec2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:02.870177 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edf11c-143c-4708-97f9-c4182fd28ec2 service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:02.870438 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edf11c-143c-4708-97f9-c4182fd28ec2 service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:02.870711 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edf11c-143c-4708-97f9-c4182fd28ec2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:02.872669 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-73edf11c-143c-4708-97f9-c4182fd28ec2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:02.888390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:03.033757 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edf11c-143c-4708-97f9-c4182fd28ec2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:03.033757 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edf11c-143c-4708-97f9-c4182fd28ec2 service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:03.060009 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 679/1379] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:05.092392 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb823e8-26bd-4388-8929-7de72688bfc1 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:05.092980 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb823e8-26bd-4388-8929-7de72688bfc1 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:05.092980 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb823e8-26bd-4388-8929-7de72688bfc1 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:05.096751 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 701/1380] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:32:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:32:05.101085 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1701958-e500-4847-b097-e155185ba5b8 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:05.101802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1701958-e500-4847-b097-e155185ba5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:05.101802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1701958-e500-4847-b097-e155185ba5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:05.185847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-b1701958-e500-4847-b097-e155185ba5b8 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:05.186996 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-b1701958-e500-4847-b097-e155185ba5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:05.300805 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:05.328743 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 680/1381] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:05.619724 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb823e8-26bd-4388-8929-7de72688bfc1 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:05.621525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4fb823e8-26bd-4388-8929-7de72688bfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:05.696373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:05.803084 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb823e8-26bd-4388-8929-7de72688bfc1 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:05.952450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9d217-2e7f-43e6-9676-a3196d47f6ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:05.952936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9d217-2e7f-43e6-9676-a3196d47f6ea service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:05.953756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9d217-2e7f-43e6-9676-a3196d47f6ea service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:05.953756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9d217-2e7f-43e6-9676-a3196d47f6ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:05.955611 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-21b9d217-2e7f-43e6-9676-a3196d47f6ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:05.989693 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:06.072003 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9d217-2e7f-43e6-9676-a3196d47f6ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:06.073657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9d217-2e7f-43e6-9676-a3196d47f6ea service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:06.096366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 702/1382] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:08.392028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042a95a-9e34-47b6-9a3f-e81cd95ef78b None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:08.393095 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042a95a-9e34-47b6-9a3f-e81cd95ef78b None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:08.394233 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042a95a-9e34-47b6-9a3f-e81cd95ef78b None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:08.398201 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 681/1383] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:32:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:32:08.405030 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4ea92-97ea-4523-a273-453fb4e87a06 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:08.405955 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4ea92-97ea-4523-a273-453fb4e87a06 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:08.405955 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4ea92-97ea-4523-a273-453fb4e87a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:08.524624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-42f4ea92-97ea-4523-a273-453fb4e87a06 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:08.526069 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-42f4ea92-97ea-4523-a273-453fb4e87a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:08.701464 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:08.708775 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 703/1384] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:32:09.012227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042a95a-9e34-47b6-9a3f-e81cd95ef78b None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:09.012227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-c042a95a-9e34-47b6-9a3f-e81cd95ef78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:09.222701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042a95a-9e34-47b6-9a3f-e81cd95ef78b None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:09.318333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:09.381418 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68387564-b141-4eba-b227-7b56a1f46823 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:09.382936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68387564-b141-4eba-b227-7b56a1f46823 service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:09.383081 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68387564-b141-4eba-b227-7b56a1f46823 service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:09.383439 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68387564-b141-4eba-b227-7b56a1f46823 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:09.385705 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-68387564-b141-4eba-b227-7b56a1f46823 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:09.515834 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68387564-b141-4eba-b227-7b56a1f46823 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:09.517590 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68387564-b141-4eba-b227-7b56a1f46823 service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:09.539999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 682/1385] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:12.034209 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317cb69-284d-4b19-871c-efff9bb951fb None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:12.034746 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317cb69-284d-4b19-871c-efff9bb951fb None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:12.034746 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317cb69-284d-4b19-871c-efff9bb951fb None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:12.036147 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 704/1386] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:32:12.045138 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c11a68-1a7f-45ef-9730-d191a44ce902 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:12.045646 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c11a68-1a7f-45ef-9730-d191a44ce902 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:12.045923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c11a68-1a7f-45ef-9730-d191a44ce902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:12.157781 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-66c11a68-1a7f-45ef-9730-d191a44ce902 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:12.162092 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-66c11a68-1a7f-45ef-9730-d191a44ce902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:12.213976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:12.308374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 683/1387] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:12.633364 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317cb69-284d-4b19-871c-efff9bb951fb None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:12.634914 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f317cb69-284d-4b19-871c-efff9bb951fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:12.890810 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317cb69-284d-4b19-871c-efff9bb951fb None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:13.005967 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:13.058220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ff078-0e6f-4679-a140-1039e68f17b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:13.058852 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ff078-0e6f-4679-a140-1039e68f17b1 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:13.059104 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ff078-0e6f-4679-a140-1039e68f17b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:13.059378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ff078-0e6f-4679-a140-1039e68f17b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:13.061051 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cd1ff078-0e6f-4679-a140-1039e68f17b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:13.169227 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ff078-0e6f-4679-a140-1039e68f17b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:13.170785 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ff078-0e6f-4679-a140-1039e68f17b1 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:13.191193 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 705/1388] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:14.938945 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f3228-8629-4f0c-a812-05d906b2f782 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:14.939539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f3228-8629-4f0c-a812-05d906b2f782 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:14.939539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f3228-8629-4f0c-a812-05d906b2f782 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:14.940868 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 684/1389] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:32:14.946211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ae971-796b-4b1c-b3d7-5559caedaeae None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:14.946641 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ae971-796b-4b1c-b3d7-5559caedaeae None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:14.947134 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ae971-796b-4b1c-b3d7-5559caedaeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:15.022918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d90ae971-796b-4b1c-b3d7-5559caedaeae None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:15.025232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d90ae971-796b-4b1c-b3d7-5559caedaeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:15.068663 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:15.188252 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 706/1390] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:15.250444 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99614708-1f1f-4872-b9d6-5ee396dd6ac5 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:15.250792 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99614708-1f1f-4872-b9d6-5ee396dd6ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:15.250982 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99614708-1f1f-4872-b9d6-5ee396dd6ac5 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:15.252974 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 685/1391] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:32:15.260219 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cfa40-76a4-410c-927a-ac0cad2e054c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:15.260219 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cfa40-76a4-410c-927a-ac0cad2e054c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:15.260219 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cfa40-76a4-410c-927a-ac0cad2e054c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:15.345898 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-500cfa40-76a4-410c-927a-ac0cad2e054c None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:15.347290 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-500cfa40-76a4-410c-927a-ac0cad2e054c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:15.472598 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 707/1392] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:15.497435 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc208d9-3d45-4e0c-bca1-465dc649a503 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:15.497716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc208d9-3d45-4e0c-bca1-465dc649a503 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:15.498071 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc208d9-3d45-4e0c-bca1-465dc649a503 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:15.499441 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 686/1393] 10.222.0.69 () {54 vars in 967 bytes} [Mon Aug 29 21:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:32:15.505861 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5eb3df-f649-4bf9-91b4-8065e097a0e0 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:15.506193 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5eb3df-f649-4bf9-91b4-8065e097a0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:15.506461 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5eb3df-f649-4bf9-91b4-8065e097a0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:15.529626 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:15.597265 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-2a5eb3df-f649-4bf9-91b4-8065e097a0e0 None None] MFA Rules not processed for user `df18e704834948c4bb480691fa8d0824`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:15.599360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2a5eb3df-f649-4bf9-91b4-8065e097a0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:15.697001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 708/1394] 10.222.0.69 () {58 vars in 1064 bytes} [Mon Aug 29 21:32:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:15.710932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc208d9-3d45-4e0c-bca1-465dc649a503 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:15.712620 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-7bc208d9-3d45-4e0c-bca1-465dc649a503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:15.782463 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5eb3df-f649-4bf9-91b4-8065e097a0e0 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:15.783850 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2a5eb3df-f649-4bf9-91b4-8065e097a0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:15.852624 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc208d9-3d45-4e0c-bca1-465dc649a503 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:15.929294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:15.959377 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6736a6-da74-4242-ac79-3898d8ff7ae6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df18e704834948c4bb480691fa8d0824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:15.960024 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:15.960418 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6736a6-da74-4242-ac79-3898d8ff7ae6 service glance] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:15.960943 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6736a6-da74-4242-ac79-3898d8ff7ae6 service glance] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:15.961135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6736a6-da74-4242-ac79-3898d8ff7ae6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:15.964065 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-4d6736a6-da74-4242-ac79-3898d8ff7ae6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:15.977799 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5eb3df-f649-4bf9-91b4-8065e097a0e0 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:16.129880 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6736a6-da74-4242-ac79-3898d8ff7ae6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:16.131279 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6736a6-da74-4242-ac79-3898d8ff7ae6 service glance] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:16.146073 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baca766-3334-437b-a997-d82cfa101de8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:16.147753 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baca766-3334-437b-a997-d82cfa101de8 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:16.148822 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baca766-3334-437b-a997-d82cfa101de8 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:16.149420 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baca766-3334-437b-a997-d82cfa101de8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:16.151342 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 687/1395] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:16.152651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4baca766-3334-437b-a997-d82cfa101de8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:16.290344 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baca766-3334-437b-a997-d82cfa101de8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:16.292040 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baca766-3334-437b-a997-d82cfa101de8 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:16.312004 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:16.323850 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 709/1396] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:32:16.973172 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f3c7b-ded4-452a-b44b-4f042f03cecf None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:16.973747 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f3c7b-ded4-452a-b44b-4f042f03cecf None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:16.973848 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f3c7b-ded4-452a-b44b-4f042f03cecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:17.051222 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-a06f3c7b-ded4-452a-b44b-4f042f03cecf None None] MFA Rules not processed for user `540e06e694524c4a9e84ebebd45956d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:17.053233 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a06f3c7b-ded4-452a-b44b-4f042f03cecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:17.091983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:17.149286 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 688/1397] 10.222.0.69 () {58 vars in 1009 bytes} [Mon Aug 29 21:32:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:17.198571 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7891c0e-7073-40fd-8502-961b7800efc7 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:17.199090 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7891c0e-7073-40fd-8502-961b7800efc7 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:17.199272 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7891c0e-7073-40fd-8502-961b7800efc7 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:17.200716 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 710/1398] 10.222.0.69 () {54 vars in 943 bytes} [Mon Aug 29 21:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:32:17.208419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f24a84-83ed-4eb6-b85b-3bdc1bce87b7 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:17.208419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f24a84-83ed-4eb6-b85b-3bdc1bce87b7 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:17.208624 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f24a84-83ed-4eb6-b85b-3bdc1bce87b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:17.292946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-a5f24a84-83ed-4eb6-b85b-3bdc1bce87b7 None None] MFA Rules not processed for user `714a2ba019144211931dbe853f1960aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:17.294104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a5f24a84-83ed-4eb6-b85b-3bdc1bce87b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:17.419811 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 689/1399] 10.222.0.69 () {58 vars in 1040 bytes} [Mon Aug 29 21:32:17 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:17.435496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7891c0e-7073-40fd-8502-961b7800efc7 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:17.437784 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f7891c0e-7073-40fd-8502-961b7800efc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:17.600395 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7891c0e-7073-40fd-8502-961b7800efc7 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:17.702612 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:17.725612 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884cd37-0147-40c3-bce2-fca0f8fc5ce5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '714a2ba019144211931dbe853f1960aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:17.726317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884cd37-0147-40c3-bce2-fca0f8fc5ce5 service swift] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:17.726521 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884cd37-0147-40c3-bce2-fca0f8fc5ce5 service swift] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:17.726798 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884cd37-0147-40c3-bce2-fca0f8fc5ce5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:17.728529 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9884cd37-0147-40c3-bce2-fca0f8fc5ce5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:17.836055 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9884cd37-0147-40c3-bce2-fca0f8fc5ce5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:17.837730 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9884cd37-0147-40c3-bce2-fca0f8fc5ce5 service swift] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:17.847230 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 711/1400] 10.222.0.69 () {60 vars in 1384 bytes} [Mon Aug 29 21:32:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:32:18.352108 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bfd52-cdba-4305-b195-1af2c3dac8ba None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:18.353171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bfd52-cdba-4305-b195-1af2c3dac8ba None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:18.353171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bfd52-cdba-4305-b195-1af2c3dac8ba None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:18.357038 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 690/1401] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:32:18.361046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f1e54-9803-4012-ab5a-845905eb121c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:18.361532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f1e54-9803-4012-ab5a-845905eb121c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:18.361655 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f1e54-9803-4012-ab5a-845905eb121c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:18.444395 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ae8f1e54-9803-4012-ab5a-845905eb121c None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:18.445644 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ae8f1e54-9803-4012-ab5a-845905eb121c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:18.536884 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:18.575342 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 712/1402] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:18.874098 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bfd52-cdba-4305-b195-1af2c3dac8ba None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:18.875631 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-880bfd52-cdba-4305-b195-1af2c3dac8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:18.885522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:19.067413 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bfd52-cdba-4305-b195-1af2c3dac8ba None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:19.171018 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:19.233392 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca444e-8342-4946-9f1b-d14fab28df79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:19.234030 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca444e-8342-4946-9f1b-d14fab28df79 service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:19.234308 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca444e-8342-4946-9f1b-d14fab28df79 service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:19.234581 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca444e-8342-4946-9f1b-d14fab28df79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:19.236350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-6cca444e-8342-4946-9f1b-d14fab28df79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:19.382866 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca444e-8342-4946-9f1b-d14fab28df79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:19.384692 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca444e-8342-4946-9f1b-d14fab28df79 service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:19.406962 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 691/1403] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:21.451352 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81886fa8-8e41-4135-9a3f-8e6bc8401791 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:21.454083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81886fa8-8e41-4135-9a3f-8e6bc8401791 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:21.454083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81886fa8-8e41-4135-9a3f-8e6bc8401791 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:21.456214 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 713/1404] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:32:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:32:21.461918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6a455-79e8-4a66-bc4f-6cd55219e307 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:21.462416 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6a455-79e8-4a66-bc4f-6cd55219e307 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:21.462693 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6a455-79e8-4a66-bc4f-6cd55219e307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:21.541411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-34b6a455-79e8-4a66-bc4f-6cd55219e307 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:21.542814 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-34b6a455-79e8-4a66-bc4f-6cd55219e307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:21.590001 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:21.663745 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 692/1405] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:21.964808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81886fa8-8e41-4135-9a3f-8e6bc8401791 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:21.966338 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-81886fa8-8e41-4135-9a3f-8e6bc8401791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:22.147595 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81886fa8-8e41-4135-9a3f-8e6bc8401791 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:22.222218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:22.292758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03b145-721d-432f-bece-c78a4225bccb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:22.292758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03b145-721d-432f-bece-c78a4225bccb service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:22.292758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03b145-721d-432f-bece-c78a4225bccb service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:22.293190 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03b145-721d-432f-bece-c78a4225bccb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:22.294651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-bc03b145-721d-432f-bece-c78a4225bccb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:22.409354 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03b145-721d-432f-bece-c78a4225bccb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:22.410965 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03b145-721d-432f-bece-c78a4225bccb service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:22.432240 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 714/1406] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:24.458344 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d3c9d-9a33-400a-ae34-2c7d481a2d5e None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:24.458344 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d3c9d-9a33-400a-ae34-2c7d481a2d5e None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:24.458344 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d3c9d-9a33-400a-ae34-2c7d481a2d5e None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:24.467295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a99c6c-340c-4594-b78d-c7b97b1e977c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:24.468169 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a99c6c-340c-4594-b78d-c7b97b1e977c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:24.468169 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a99c6c-340c-4594-b78d-c7b97b1e977c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:24.472686 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 693/1407] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:32:24 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:32:24.573235 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-71a99c6c-340c-4594-b78d-c7b97b1e977c None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:24.576674 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-71a99c6c-340c-4594-b78d-c7b97b1e977c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:24.593052 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:24.722141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 715/1408] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:25.023926 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d3c9d-9a33-400a-ae34-2c7d481a2d5e None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:25.025493 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-0c8d3c9d-9a33-400a-ae34-2c7d481a2d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:25.222794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d3c9d-9a33-400a-ae34-2c7d481a2d5e None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:25.257256 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:25.368528 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94925195-96f2-4a4e-97d9-15a82686ad34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:25.369480 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94925195-96f2-4a4e-97d9-15a82686ad34 service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:25.369965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94925195-96f2-4a4e-97d9-15a82686ad34 service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:25.370446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94925195-96f2-4a4e-97d9-15a82686ad34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:25.372082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-94925195-96f2-4a4e-97d9-15a82686ad34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:25.481578 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94925195-96f2-4a4e-97d9-15a82686ad34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:25.484025 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94925195-96f2-4a4e-97d9-15a82686ad34 service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:25.513297 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 694/1409] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:34.718388 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=38 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:35.509956 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=86 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:41.005088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da674dcf-92c9-432f-a25f-d354b060c4b0 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:41.006506 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da674dcf-92c9-432f-a25f-d354b060c4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:41.006665 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da674dcf-92c9-432f-a25f-d354b060c4b0 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:41.008164 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 716/1410] 10.222.0.69 () {54 vars in 918 bytes} [Mon Aug 29 21:32:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:32:41.015198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c030e3-bbf2-4907-b7ca-5660d31010aa None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:41.015783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c030e3-bbf2-4907-b7ca-5660d31010aa None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:41.016116 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c030e3-bbf2-4907-b7ca-5660d31010aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:41.159076 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-e6c030e3-bbf2-4907-b7ca-5660d31010aa None None] MFA Rules not processed for user `a7911672bb2a471daf4f69ba940ef41d`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:41.160407 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-e6c030e3-bbf2-4907-b7ca-5660d31010aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:41.287996 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 695/1411] 10.222.0.69 () {58 vars in 1015 bytes} [Mon Aug 29 21:32:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:41.309628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd41b1-5afd-4892-b771-d133b4636b67 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:41.309914 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd41b1-5afd-4892-b771-d133b4636b67 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:41.310179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd41b1-5afd-4892-b771-d133b4636b67 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:41.311640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 717/1412] 10.222.0.69 () {54 vars in 918 bytes} [Mon Aug 29 21:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:32:41.317785 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac44889-2c20-46ff-a07b-8fc5b32d108f None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:41.318107 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac44889-2c20-46ff-a07b-8fc5b32d108f None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:41.318940 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac44889-2c20-46ff-a07b-8fc5b32d108f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:41.407537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:41.411721 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-7ac44889-2c20-46ff-a07b-8fc5b32d108f None None] MFA Rules not processed for user `96c35c544cae4ad187f1a1be723e0d21`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:41.414744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-7ac44889-2c20-46ff-a07b-8fc5b32d108f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:41.617980 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 696/1413] 10.222.0.69 () {58 vars in 1015 bytes} [Mon Aug 29 21:32:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:32:44.183868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3c0b7-78e7-4ea6-a4c6-0b222706caa3 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:44.184486 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3c0b7-78e7-4ea6-a4c6-0b222706caa3 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:44.184880 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3c0b7-78e7-4ea6-a4c6-0b222706caa3 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:44.187441 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 718/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:32:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:32:44.193529 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64618e79-ea52-4499-98da-bd3f399adb7e None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:44.194079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64618e79-ea52-4499-98da-bd3f399adb7e None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:44.194079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64618e79-ea52-4499-98da-bd3f399adb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:44.292655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-64618e79-ea52-4499-98da-bd3f399adb7e None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:44.294805 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-64618e79-ea52-4499-98da-bd3f399adb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:44.389936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:44.456064 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 697/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:44.782102 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3c0b7-78e7-4ea6-a4c6-0b222706caa3 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:44.783497 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-55e3c0b7-78e7-4ea6-a4c6-0b222706caa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:44.976224 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3c0b7-78e7-4ea6-a4c6-0b222706caa3 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:45.063954 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:45.119553 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c983ca-291a-4188-b32a-024359aca42e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:45.120198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c983ca-291a-4188-b32a-024359aca42e service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:45.120483 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c983ca-291a-4188-b32a-024359aca42e service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:45.120753 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c983ca-291a-4188-b32a-024359aca42e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:45.122789 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-29c983ca-291a-4188-b32a-024359aca42e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:45.226194 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c983ca-291a-4188-b32a-024359aca42e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:45.227819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c983ca-291a-4188-b32a-024359aca42e service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:45.249411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 719/1416] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:46.208677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32aa49-31ee-499d-8858-cd796c25b360 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:46.209105 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32aa49-31ee-499d-8858-cd796c25b360 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:46.209380 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32aa49-31ee-499d-8858-cd796c25b360 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:46.211184 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 698/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:32:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:32:46.216529 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03902bbc-b738-4507-aad0-94bfac180ebc None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:46.216902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03902bbc-b738-4507-aad0-94bfac180ebc None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:46.217213 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03902bbc-b738-4507-aad0-94bfac180ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:46.301892 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-03902bbc-b738-4507-aad0-94bfac180ebc None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:46.303155 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-03902bbc-b738-4507-aad0-94bfac180ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:46.333106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:46.412003 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 720/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:32:46.563125 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32aa49-31ee-499d-8858-cd796c25b360 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:46.565095 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-5f32aa49-31ee-499d-8858-cd796c25b360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:46.731150 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32aa49-31ee-499d-8858-cd796c25b360 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:46.777431 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:46.867667 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2160916-cd0a-459a-ad76-495ffa575be7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:46.868489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2160916-cd0a-459a-ad76-495ffa575be7 service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:46.868769 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2160916-cd0a-459a-ad76-495ffa575be7 service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:46.869051 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2160916-cd0a-459a-ad76-495ffa575be7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:46.870759 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a2160916-cd0a-459a-ad76-495ffa575be7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:46.975481 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2160916-cd0a-459a-ad76-495ffa575be7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:46.977171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2160916-cd0a-459a-ad76-495ffa575be7 service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:46.998582 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 699/1419] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:47.933996 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43d1b3-f533-42b9-8c44-896be1b52d73 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:47.934589 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43d1b3-f533-42b9-8c44-896be1b52d73 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:47.934792 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43d1b3-f533-42b9-8c44-896be1b52d73 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:47.936456 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 721/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:32:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:32:47.941934 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120e832-a968-4bbe-98ae-c769d292a211 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:47.942502 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120e832-a968-4bbe-98ae-c769d292a211 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:47.942632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120e832-a968-4bbe-98ae-c769d292a211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:48.009013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:48.033395 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-4120e832-a968-4bbe-98ae-c769d292a211 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:48.034637 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-4120e832-a968-4bbe-98ae-c769d292a211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:48.174790 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 700/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:48.328589 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43d1b3-f533-42b9-8c44-896be1b52d73 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:48.330484 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3d43d1b3-f533-42b9-8c44-896be1b52d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:48.552627 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43d1b3-f533-42b9-8c44-896be1b52d73 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:48.567040 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:48.687279 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d840e-75f9-47ba-8da9-0cfc0b41c1a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:48.688055 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d840e-75f9-47ba-8da9-0cfc0b41c1a5 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:48.688467 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d840e-75f9-47ba-8da9-0cfc0b41c1a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:48.688846 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d840e-75f9-47ba-8da9-0cfc0b41c1a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:48.690636 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a43d840e-75f9-47ba-8da9-0cfc0b41c1a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:48.794131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d840e-75f9-47ba-8da9-0cfc0b41c1a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:48.795865 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d840e-75f9-47ba-8da9-0cfc0b41c1a5 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:48.819218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 722/1422] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:49.741894 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dd0d5-3eba-4ac9-88aa-25497b93b681 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:49.742466 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dd0d5-3eba-4ac9-88aa-25497b93b681 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:49.742466 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dd0d5-3eba-4ac9-88aa-25497b93b681 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:49.743804 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 701/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:32:49.749922 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38886014-93da-4a0c-9972-76d4511cbc28 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:49.750492 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38886014-93da-4a0c-9972-76d4511cbc28 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:49.750837 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38886014-93da-4a0c-9972-76d4511cbc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:49.788715 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:49.883691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-38886014-93da-4a0c-9972-76d4511cbc28 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:49.884988 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-38886014-93da-4a0c-9972-76d4511cbc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:49.998632 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 723/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:50.153964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3dd0d5-3eba-4ac9-88aa-25497b93b681 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:50.155638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-fe3dd0d5-3eba-4ac9-88aa-25497b93b681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:50.288986 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:50.328911 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3dd0d5-3eba-4ac9-88aa-25497b93b681 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:50.459330 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32631c63-5ad5-4ba9-988a-77b2331a86be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:50.459936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32631c63-5ad5-4ba9-988a-77b2331a86be service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:50.460242 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32631c63-5ad5-4ba9-988a-77b2331a86be service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:50.460521 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32631c63-5ad5-4ba9-988a-77b2331a86be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:50.462223 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-32631c63-5ad5-4ba9-988a-77b2331a86be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:50.554561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:50.570290 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32631c63-5ad5-4ba9-988a-77b2331a86be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:50.571945 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32631c63-5ad5-4ba9-988a-77b2331a86be service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:50.591856 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 702/1425] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:51.580889 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bea3b-48ec-4dbf-b855-e09253c2de47 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:51.581801 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bea3b-48ec-4dbf-b855-e09253c2de47 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:51.581801 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bea3b-48ec-4dbf-b855-e09253c2de47 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:51.582799 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 724/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:32:51.589822 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d041535-3c54-40e2-826e-3c0c8ea83caf None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:51.590501 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d041535-3c54-40e2-826e-3c0c8ea83caf None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:51.590501 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d041535-3c54-40e2-826e-3c0c8ea83caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:51.680947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-2d041535-3c54-40e2-826e-3c0c8ea83caf None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:51.682201 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-2d041535-3c54-40e2-826e-3c0c8ea83caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:51.803642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 703/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:32:51.963602 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bea3b-48ec-4dbf-b855-e09253c2de47 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:51.965348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-aa3bea3b-48ec-4dbf-b855-e09253c2de47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:52.064911 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:52.155460 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bea3b-48ec-4dbf-b855-e09253c2de47 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:52.333132 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae1ca6-4841-4779-9a6d-a090004065be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:52.334047 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae1ca6-4841-4779-9a6d-a090004065be service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:52.334947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae1ca6-4841-4779-9a6d-a090004065be service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:52.335261 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae1ca6-4841-4779-9a6d-a090004065be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:52.337101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e6ae1ca6-4841-4779-9a6d-a090004065be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:52.404594 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:52.456486 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae1ca6-4841-4779-9a6d-a090004065be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:52.458324 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae1ca6-4841-4779-9a6d-a090004065be service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:52.481391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 725/1428] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:53.367968 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b3b14-abe2-441c-8865-f0ff0f624105 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:53.368669 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b3b14-abe2-441c-8865-f0ff0f624105 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:53.368669 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b3b14-abe2-441c-8865-f0ff0f624105 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:53.370094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 704/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:32:53.375906 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99573597-9b24-48c4-81ca-e859c4ccc54e None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:53.376527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99573597-9b24-48c4-81ca-e859c4ccc54e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:53.376627 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99573597-9b24-48c4-81ca-e859c4ccc54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:53.494730 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-99573597-9b24-48c4-81ca-e859c4ccc54e None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:53.495967 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-99573597-9b24-48c4-81ca-e859c4ccc54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:53.626524 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 726/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:53.788876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b3b14-abe2-441c-8865-f0ff0f624105 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:53.790391 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-2d5b3b14-abe2-441c-8865-f0ff0f624105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:53.857761 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:53.989477 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b3b14-abe2-441c-8865-f0ff0f624105 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:54.134578 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3d67b-fd9f-417f-a43d-4a1475b25295 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:54.135319 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3d67b-fd9f-417f-a43d-4a1475b25295 service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:54.135665 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3d67b-fd9f-417f-a43d-4a1475b25295 service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:54.135981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3d67b-fd9f-417f-a43d-4a1475b25295 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:54.137969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-6ba3d67b-fd9f-417f-a43d-4a1475b25295 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:54.146371 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:54.257870 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3d67b-fd9f-417f-a43d-4a1475b25295 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:54.259517 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3d67b-fd9f-417f-a43d-4a1475b25295 service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:54.282590 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 705/1431] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:55.197323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ac3de-0bca-477b-ba19-2dd45a95713c None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:55.198018 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ac3de-0bca-477b-ba19-2dd45a95713c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:55.198296 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ac3de-0bca-477b-ba19-2dd45a95713c None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:55.200954 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 727/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:32:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:32:55.210726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22341f8a-d9f4-4b8a-9cea-969c1b7df131 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:55.211255 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22341f8a-d9f4-4b8a-9cea-969c1b7df131 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:55.211674 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22341f8a-d9f4-4b8a-9cea-969c1b7df131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:55.320787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-22341f8a-d9f4-4b8a-9cea-969c1b7df131 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:55.322327 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-22341f8a-d9f4-4b8a-9cea-969c1b7df131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:55.411742 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:55.448694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 706/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:55.727044 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ac3de-0bca-477b-ba19-2dd45a95713c None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:55.728828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cf2ac3de-0bca-477b-ba19-2dd45a95713c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:55.749564 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:55.934518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ac3de-0bca-477b-ba19-2dd45a95713c None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:56.088305 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:56.126021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4bf37-e43f-4fe1-bad2-755b4bae084d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:56.127482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4bf37-e43f-4fe1-bad2-755b4bae084d service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:56.127482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4bf37-e43f-4fe1-bad2-755b4bae084d service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:56.127917 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4bf37-e43f-4fe1-bad2-755b4bae084d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:56.130558 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2ed4bf37-e43f-4fe1-bad2-755b4bae084d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:56.273604 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4bf37-e43f-4fe1-bad2-755b4bae084d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:56.275963 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4bf37-e43f-4fe1-bad2-755b4bae084d service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:56.299626 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 728/1434] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:32:57.353504 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc1492-334b-449e-94b1-77a5ae9d3969 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:57.354388 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc1492-334b-449e-94b1-77a5ae9d3969 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:57.354388 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc1492-334b-449e-94b1-77a5ae9d3969 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:57.356073 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 707/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:32:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:32:57.362100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a4cf7-67e9-4b19-a167-025986fa106d None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:57.362684 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a4cf7-67e9-4b19-a167-025986fa106d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:57.362684 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a4cf7-67e9-4b19-a167-025986fa106d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:57.458942 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-0b3a4cf7-67e9-4b19-a167-025986fa106d None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:57.460148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0b3a4cf7-67e9-4b19-a167-025986fa106d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:57.513712 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:57.606305 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 729/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:57.766530 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc1492-334b-449e-94b1-77a5ae9d3969 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:57.767980 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-87bc1492-334b-449e-94b1-77a5ae9d3969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:57.953426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc1492-334b-449e-94b1-77a5ae9d3969 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:58.052478 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:58.130141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2d686-f900-4eac-9aec-57ba61fc0610 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:58.130767 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2d686-f900-4eac-9aec-57ba61fc0610 service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:58.131042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2d686-f900-4eac-9aec-57ba61fc0610 service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:58.131869 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2d686-f900-4eac-9aec-57ba61fc0610 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:58.133853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-fdd2d686-f900-4eac-9aec-57ba61fc0610 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:58.253315 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2d686-f900-4eac-9aec-57ba61fc0610 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:58.255497 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2d686-f900-4eac-9aec-57ba61fc0610 service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:58.278479 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 708/1437] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:32:59.138421 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48be3bd-25e6-4588-81cf-6b34ae1397d5 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:59.139057 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48be3bd-25e6-4588-81cf-6b34ae1397d5 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:59.139057 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48be3bd-25e6-4588-81cf-6b34ae1397d5 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:59.140374 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 730/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:32:59.147780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63029c-3fc5-473a-b73d-4d0f49af0b60 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:59.148902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63029c-3fc5-473a-b73d-4d0f49af0b60 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:59.148902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63029c-3fc5-473a-b73d-4d0f49af0b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:59.282518 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-fb63029c-3fc5-473a-b73d-4d0f49af0b60 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:59.283763 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-fb63029c-3fc5-473a-b73d-4d0f49af0b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:59.286547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:59.462131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 709/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:32:59.619572 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48be3bd-25e6-4588-81cf-6b34ae1397d5 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:59.622532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c48be3bd-25e6-4588-81cf-6b34ae1397d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:59.870226 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48be3bd-25e6-4588-81cf-6b34ae1397d5 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:59.935330 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:00.048106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5be32-1d72-4473-b867-fa2dc3b466bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:33:00.048769 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5be32-1d72-4473-b867-fa2dc3b466bf service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:00.049047 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5be32-1d72-4473-b867-fa2dc3b466bf service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:00.049327 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5be32-1d72-4473-b867-fa2dc3b466bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:00.051118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-13f5be32-1d72-4473-b867-fa2dc3b466bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:00.181288 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5be32-1d72-4473-b867-fa2dc3b466bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:33:00.183879 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5be32-1d72-4473-b867-fa2dc3b466bf service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:33:00.213585 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 731/1440] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:32:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:33:02.153494 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135c161-b600-4e6c-b4e1-19c1205d0886 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:02.154085 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135c161-b600-4e6c-b4e1-19c1205d0886 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:02.154203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135c161-b600-4e6c-b4e1-19c1205d0886 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:02.155739 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 710/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:33:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:33:02.161768 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc4241-5c7a-4126-a65f-3e6cecf97c50 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:02.163274 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc4241-5c7a-4126-a65f-3e6cecf97c50 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:02.163274 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc4241-5c7a-4126-a65f-3e6cecf97c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:02.239405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:02.276559 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-4efc4241-5c7a-4126-a65f-3e6cecf97c50 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:33:02.277831 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4efc4241-5c7a-4126-a65f-3e6cecf97c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:02.401662 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 732/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:33:02.757475 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135c161-b600-4e6c-b4e1-19c1205d0886 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:33:02.759731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-5135c161-b600-4e6c-b4e1-19c1205d0886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:02.918557 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135c161-b600-4e6c-b4e1-19c1205d0886 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:33:02.983421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:03.072357 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee70159-d03e-434e-a83f-ddbeddae8dc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:33:03.073487 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee70159-d03e-434e-a83f-ddbeddae8dc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:03.073982 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee70159-d03e-434e-a83f-ddbeddae8dc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:03.074513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee70159-d03e-434e-a83f-ddbeddae8dc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:03.078352 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-cee70159-d03e-434e-a83f-ddbeddae8dc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:03.241602 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee70159-d03e-434e-a83f-ddbeddae8dc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:33:03.243089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee70159-d03e-434e-a83f-ddbeddae8dc1 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:33:03.265883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 711/1443] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:33:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:33:06.093196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd12d11-1f82-4f80-b697-fa206d482ada None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:06.094060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd12d11-1f82-4f80-b697-fa206d482ada None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:06.094382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd12d11-1f82-4f80-b697-fa206d482ada None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:06.096345 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 733/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:33:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:33:06.105301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c79a70-a55c-40d8-99fb-cefd77451c80 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:06.106139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c79a70-a55c-40d8-99fb-cefd77451c80 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:06.106139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c79a70-a55c-40d8-99fb-cefd77451c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:06.199223 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-76c79a70-a55c-40d8-99fb-cefd77451c80 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:33:06.200720 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-76c79a70-a55c-40d8-99fb-cefd77451c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:06.218581 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:06.344064 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 712/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:33:06.680608 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd12d11-1f82-4f80-b697-fa206d482ada None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:33:06.682476 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-efd12d11-1f82-4f80-b697-fa206d482ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:06.833594 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd12d11-1f82-4f80-b697-fa206d482ada None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:33:06.852108 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:06.976973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4c8c6-844d-4445-be97-f6ff2a4fad06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:33:06.977951 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4c8c6-844d-4445-be97-f6ff2a4fad06 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:06.978437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4c8c6-844d-4445-be97-f6ff2a4fad06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:06.978915 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4c8c6-844d-4445-be97-f6ff2a4fad06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:06.982155 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-89b4c8c6-844d-4445-be97-f6ff2a4fad06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:07.186932 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4c8c6-844d-4445-be97-f6ff2a4fad06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:33:07.189173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4c8c6-844d-4445-be97-f6ff2a4fad06 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:33:07.216083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 734/1446] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:33:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:33:09.849196 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e09739-9a8a-42bd-b4eb-368492142a82 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:09.849988 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e09739-9a8a-42bd-b4eb-368492142a82 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:09.849988 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e09739-9a8a-42bd-b4eb-368492142a82 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:09.852133 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 713/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:33:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:33:09.859514 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996edc5-ab25-4f80-b1c4-bc33b4e80213 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:09.860277 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996edc5-ab25-4f80-b1c4-bc33b4e80213 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:09.860665 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996edc5-ab25-4f80-b1c4-bc33b4e80213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:09.927241 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:09.950710 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-7996edc5-ab25-4f80-b1c4-bc33b4e80213 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:33:09.951981 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-7996edc5-ab25-4f80-b1c4-bc33b4e80213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:10.108084 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 735/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:33:10.427265 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e09739-9a8a-42bd-b4eb-368492142a82 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:33:10.428895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-b7e09739-9a8a-42bd-b4eb-368492142a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:10.554200 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e09739-9a8a-42bd-b4eb-368492142a82 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:33:10.606878 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:10.649357 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427d71b-63ab-412c-a07e-7c9fa4f09a31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:33:10.649977 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427d71b-63ab-412c-a07e-7c9fa4f09a31 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:10.650260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427d71b-63ab-412c-a07e-7c9fa4f09a31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:10.650539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427d71b-63ab-412c-a07e-7c9fa4f09a31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:10.652302 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-c427d71b-63ab-412c-a07e-7c9fa4f09a31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:10.826969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c427d71b-63ab-412c-a07e-7c9fa4f09a31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:33:10.829807 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c427d71b-63ab-412c-a07e-7c9fa4f09a31 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:33:10.871077 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 714/1449] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:33:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:33:13.117727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0bed3-c90e-4bc8-9c34-72eddeac1fb9 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:13.118345 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0bed3-c90e-4bc8-9c34-72eddeac1fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:13.118345 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0bed3-c90e-4bc8-9c34-72eddeac1fb9 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:13.119945 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 736/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:33:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:33:13.127174 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d1661-3c25-4f16-864e-8bdde48b8a64 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:13.127827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d1661-3c25-4f16-864e-8bdde48b8a64 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:13.127827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d1661-3c25-4f16-864e-8bdde48b8a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:13.214186 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-e60d1661-3c25-4f16-864e-8bdde48b8a64 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:33:13.215600 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-e60d1661-3c25-4f16-864e-8bdde48b8a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:13.256028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:13.414575 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 715/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:33:13.945033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0bed3-c90e-4bc8-9c34-72eddeac1fb9 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:33:13.946601 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-67c0bed3-c90e-4bc8-9c34-72eddeac1fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:14.096440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0bed3-c90e-4bc8-9c34-72eddeac1fb9 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:33:14.133696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:14.212607 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2955f7-1163-4557-918f-51822f453e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:33:14.213123 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2955f7-1163-4557-918f-51822f453e85 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:14.213400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2955f7-1163-4557-918f-51822f453e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:14.213671 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2955f7-1163-4557-918f-51822f453e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:14.215402 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-7e2955f7-1163-4557-918f-51822f453e85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:14.380039 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2955f7-1163-4557-918f-51822f453e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:33:14.383266 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2955f7-1163-4557-918f-51822f453e85 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:33:14.411193 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 737/1452] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:33:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:33:17.159542 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7176d4-aa58-4c10-acd0-fee7b40d026a None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:17.160166 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7176d4-aa58-4c10-acd0-fee7b40d026a None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:17.160166 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7176d4-aa58-4c10-acd0-fee7b40d026a None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:17.161545 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 716/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:33:17.167971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898e26c-a75b-4bce-a419-4693923849db None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:17.168838 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898e26c-a75b-4bce-a419-4693923849db None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:17.168838 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898e26c-a75b-4bce-a419-4693923849db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:17.271852 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:17.277458 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-3898e26c-a75b-4bce-a419-4693923849db None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:33:17.279868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3898e26c-a75b-4bce-a419-4693923849db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:17.422422 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 738/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:33:17.731705 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7176d4-aa58-4c10-acd0-fee7b40d026a None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:33:17.733531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-0b7176d4-aa58-4c10-acd0-fee7b40d026a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:17.865947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7176d4-aa58-4c10-acd0-fee7b40d026a None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:33:17.929977 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:17.961984 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50d26c-5aa5-4233-b89e-b91b749d2324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:33:17.962627 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50d26c-5aa5-4233-b89e-b91b749d2324 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:17.962908 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50d26c-5aa5-4233-b89e-b91b749d2324 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:17.963197 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50d26c-5aa5-4233-b89e-b91b749d2324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:17.964971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-1a50d26c-5aa5-4233-b89e-b91b749d2324 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:18.103304 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50d26c-5aa5-4233-b89e-b91b749d2324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:33:18.104719 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50d26c-5aa5-4233-b89e-b91b749d2324 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:33:18.127211 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 717/1455] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:33:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:33:20.559738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb031b71-bd5c-4473-8128-cfe37478bd10 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:20.560542 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb031b71-bd5c-4473-8128-cfe37478bd10 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:20.560542 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb031b71-bd5c-4473-8128-cfe37478bd10 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:20.561692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 739/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:33:20.567781 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf0fa4-b56c-4a94-83c2-c76d27f160b4 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:20.568413 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf0fa4-b56c-4a94-83c2-c76d27f160b4 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:20.568413 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf0fa4-b56c-4a94-83c2-c76d27f160b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:20.778176 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-c0bf0fa4-b56c-4a94-83c2-c76d27f160b4 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:33:20.779707 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-c0bf0fa4-b56c-4a94-83c2-c76d27f160b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:20.816889 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:20.918099 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 718/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:33:21.212072 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb031b71-bd5c-4473-8128-cfe37478bd10 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:33:21.213716 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-eb031b71-bd5c-4473-8128-cfe37478bd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:21.338857 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb031b71-bd5c-4473-8128-cfe37478bd10 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:33:21.372619 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:21.426280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5309830-de59-4a43-b7eb-e1843c4afdac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:33:21.426909 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5309830-de59-4a43-b7eb-e1843c4afdac service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:21.427197 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5309830-de59-4a43-b7eb-e1843c4afdac service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:21.427465 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5309830-de59-4a43-b7eb-e1843c4afdac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:21.429784 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d5309830-de59-4a43-b7eb-e1843c4afdac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:21.568105 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5309830-de59-4a43-b7eb-e1843c4afdac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:33:21.569677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5309830-de59-4a43-b7eb-e1843c4afdac service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:33:21.591513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 740/1458] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:33:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:33:23.811331 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc0795-64c7-41ba-b004-805e67f77b8b None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:23.812050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc0795-64c7-41ba-b004-805e67f77b8b None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:23.812050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc0795-64c7-41ba-b004-805e67f77b8b None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:23.813973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 719/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:33:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:33:23.820273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65ab5d-8fd8-4407-835a-48a197a3cdc8 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:23.821001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65ab5d-8fd8-4407-835a-48a197a3cdc8 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:23.821001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65ab5d-8fd8-4407-835a-48a197a3cdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:23.905488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-1d65ab5d-8fd8-4407-835a-48a197a3cdc8 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:33:23.907250 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1d65ab5d-8fd8-4407-835a-48a197a3cdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:23.926521 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:24.076811 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 741/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:33:24.379502 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc0795-64c7-41ba-b004-805e67f77b8b None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:33:24.381841 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-87bc0795-64c7-41ba-b004-805e67f77b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:24.516384 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc0795-64c7-41ba-b004-805e67f77b8b None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:33:24.588247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:24.626763 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae22920-a4d4-4fad-adeb-171e1105e7a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:33:24.627411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae22920-a4d4-4fad-adeb-171e1105e7a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:24.627898 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae22920-a4d4-4fad-adeb-171e1105e7a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:24.628433 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae22920-a4d4-4fad-adeb-171e1105e7a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:24.631923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-eae22920-a4d4-4fad-adeb-171e1105e7a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:24.819302 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae22920-a4d4-4fad-adeb-171e1105e7a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:33:24.820825 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae22920-a4d4-4fad-adeb-171e1105e7a8 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:33:24.852356 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 720/1461] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:33:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:33:27.183710 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b3bdf-41c2-48b1-964b-389d6fc5c80d None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:27.184332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b3bdf-41c2-48b1-964b-389d6fc5c80d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:27.184332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b3bdf-41c2-48b1-964b-389d6fc5c80d None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:27.185770 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 742/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:33:27.193732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10387f4-0d58-4b7f-88b6-6afcbcd7121c None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:27.194304 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10387f4-0d58-4b7f-88b6-6afcbcd7121c None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:27.195352 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10387f4-0d58-4b7f-88b6-6afcbcd7121c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:27.317186 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-b10387f4-0d58-4b7f-88b6-6afcbcd7121c None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:33:27.320189 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-b10387f4-0d58-4b7f-88b6-6afcbcd7121c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:27.393510 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:27.522464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 721/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:33:27.824347 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b3bdf-41c2-48b1-964b-389d6fc5c80d None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:33:27.825936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-988b3bdf-41c2-48b1-964b-389d6fc5c80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:27.994958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b3bdf-41c2-48b1-964b-389d6fc5c80d None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:33:28.056216 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:28.106654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2acc89-d010-45b5-a01d-863af420dc91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:33:28.107131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2acc89-d010-45b5-a01d-863af420dc91 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:28.107410 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2acc89-d010-45b5-a01d-863af420dc91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:28.107680 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2acc89-d010-45b5-a01d-863af420dc91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:28.109575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3f2acc89-d010-45b5-a01d-863af420dc91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:28.295080 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2acc89-d010-45b5-a01d-863af420dc91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:33:28.297694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2acc89-d010-45b5-a01d-863af420dc91 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:33:28.331246 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 743/1464] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:33:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:33:30.512136 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05289a-ed73-4f1e-bde8-9765dda1a075 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:30.512793 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05289a-ed73-4f1e-bde8-9765dda1a075 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:30.512980 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05289a-ed73-4f1e-bde8-9765dda1a075 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:30.515045 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 722/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:33:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:33:30.521458 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff05a4e-b470-4bd9-8170-8d903eaaaabe None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:30.522033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff05a4e-b470-4bd9-8170-8d903eaaaabe None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:30.522033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff05a4e-b470-4bd9-8170-8d903eaaaabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:30.607786 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-4ff05a4e-b470-4bd9-8170-8d903eaaaabe None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:33:30.609237 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4ff05a4e-b470-4bd9-8170-8d903eaaaabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:30.636131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:30.749043 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 744/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:33:31.078343 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05289a-ed73-4f1e-bde8-9765dda1a075 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:33:31.079971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-4b05289a-ed73-4f1e-bde8-9765dda1a075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:31.228595 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05289a-ed73-4f1e-bde8-9765dda1a075 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:33:31.342041 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:31.353210 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5742a-1176-4283-85f8-6cd3ab6290c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:33:31.353827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5742a-1176-4283-85f8-6cd3ab6290c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:31.354108 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5742a-1176-4283-85f8-6cd3ab6290c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:31.354371 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5742a-1176-4283-85f8-6cd3ab6290c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:31.356142 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-79e5742a-1176-4283-85f8-6cd3ab6290c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:31.499472 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5742a-1176-4283-85f8-6cd3ab6290c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:33:31.502152 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5742a-1176-4283-85f8-6cd3ab6290c0 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:33:31.525179 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 723/1467] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:33:33.782415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6c639-82a1-4698-863d-4971e3c1fae7 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:33.783049 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6c639-82a1-4698-863d-4971e3c1fae7 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:33.783210 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6c639-82a1-4698-863d-4971e3c1fae7 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:33.784572 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 745/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:33:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:33:33.790590 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970d600-89c3-4701-847c-b1968f3416ff None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:33.791156 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970d600-89c3-4701-847c-b1968f3416ff None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:33.791156 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970d600-89c3-4701-847c-b1968f3416ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:33.881976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-f970d600-89c3-4701-847c-b1968f3416ff None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:33:33.883758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f970d600-89c3-4701-847c-b1968f3416ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:33.952131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:34.018707 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 724/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:33:34.341599 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6c639-82a1-4698-863d-4971e3c1fae7 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:33:34.343379 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4dc6c639-82a1-4698-863d-4971e3c1fae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:34.481176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6c639-82a1-4698-863d-4971e3c1fae7 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:33:34.540089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:34.575488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46f74c-db12-4e72-9578-6bca865c4607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:33:34.576118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46f74c-db12-4e72-9578-6bca865c4607 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:34.576439 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46f74c-db12-4e72-9578-6bca865c4607 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:34.576716 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46f74c-db12-4e72-9578-6bca865c4607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:34.578515 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5c46f74c-db12-4e72-9578-6bca865c4607 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:34.759610 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46f74c-db12-4e72-9578-6bca865c4607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:33:34.762179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46f74c-db12-4e72-9578-6bca865c4607 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:33:34.794964 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 746/1470] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:33:44.015916 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=22 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:44.790852 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=66 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:56.777656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236563bf-cf3c-4c5f-8237-8dcf867f0a89 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:56.778288 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236563bf-cf3c-4c5f-8237-8dcf867f0a89 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:56.778483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236563bf-cf3c-4c5f-8237-8dcf867f0a89 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:56.780409 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 725/1471] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:33:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:33:56.790547 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78ca29-f0f8-40f7-8916-acbdb7a4067a None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:56.791160 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78ca29-f0f8-40f7-8916-acbdb7a4067a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:56.791768 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78ca29-f0f8-40f7-8916-acbdb7a4067a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:56.894759 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-6b78ca29-f0f8-40f7-8916-acbdb7a4067a None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:33:56.896020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-6b78ca29-f0f8-40f7-8916-acbdb7a4067a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:57.024754 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 747/1472] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:33:57.335947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d29d46-5464-4a2b-9bb3-22a28dd16c3c None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:57.336868 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d29d46-5464-4a2b-9bb3-22a28dd16c3c None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:57.337140 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d29d46-5464-4a2b-9bb3-22a28dd16c3c None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:57.338504 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 726/1473] 10.222.0.69 () {54 vars in 967 bytes} [Mon Aug 29 21:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:33:57.344812 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f14854-06d8-4cc7-af9e-18c71ec89695 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:57.345150 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f14854-06d8-4cc7-af9e-18c71ec89695 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:57.345468 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f14854-06d8-4cc7-af9e-18c71ec89695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:57.460002 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-92f14854-06d8-4cc7-af9e-18c71ec89695 None None] MFA Rules not processed for user `df18e704834948c4bb480691fa8d0824`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:33:57.461875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-92f14854-06d8-4cc7-af9e-18c71ec89695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:57.487461 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:57.561806 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 748/1474] 10.222.0.69 () {58 vars in 1064 bytes} [Mon Aug 29 21:33:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:33:57.569563 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d29d46-5464-4a2b-9bb3-22a28dd16c3c None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:33:57.571645 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-85d29d46-5464-4a2b-9bb3-22a28dd16c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:57.699822 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d29d46-5464-4a2b-9bb3-22a28dd16c3c None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:33:57.786142 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8b54d-6bb1-4294-88f3-df7b0c70b03c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df18e704834948c4bb480691fa8d0824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:33:57.786811 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8b54d-6bb1-4294-88f3-df7b0c70b03c service glance] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:57.786932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8b54d-6bb1-4294-88f3-df7b0c70b03c service glance] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:57.787164 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8b54d-6bb1-4294-88f3-df7b0c70b03c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:57.788935 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-c2f8b54d-6bb1-4294-88f3-df7b0c70b03c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:57.861461 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:57.930754 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8b54d-6bb1-4294-88f3-df7b0c70b03c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:33:57.932493 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8b54d-6bb1-4294-88f3-df7b0c70b03c service glance] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:33:57.953752 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 727/1475] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:33:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:34:00.146977 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe310e-526b-488a-aa94-fbe371775268 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:00.147686 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe310e-526b-488a-aa94-fbe371775268 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:00.147686 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe310e-526b-488a-aa94-fbe371775268 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:00.149194 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 749/1476] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:34:00.155403 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64040f7d-169f-4c08-8fd6-700aa80271a7 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:00.155960 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64040f7d-169f-4c08-8fd6-700aa80271a7 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:00.155960 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64040f7d-169f-4c08-8fd6-700aa80271a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:00.241159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-64040f7d-169f-4c08-8fd6-700aa80271a7 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:34:00.243123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-64040f7d-169f-4c08-8fd6-700aa80271a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:34:00.365090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 728/1477] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:34:00.667550 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe310e-526b-488a-aa94-fbe371775268 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:34:00.669283 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9bbe310e-526b-488a-aa94-fbe371775268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:34:00.833204 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe310e-526b-488a-aa94-fbe371775268 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:34:00.929349 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:01.021291 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d2d5a-f430-40f5-96cb-f33ade56d173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:34:01.022408 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d2d5a-f430-40f5-96cb-f33ade56d173 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:01.022903 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d2d5a-f430-40f5-96cb-f33ade56d173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:01.023392 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d2d5a-f430-40f5-96cb-f33ade56d173 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:01.025737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d2d5a-f430-40f5-96cb-f33ade56d173 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:34:01.029391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: WARNING py.warnings [None req-083d2d5a-f430-40f5-96cb-f33ade56d173 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:34:01.029391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: warnings.warn(msg) Aug 29 21:34:01.029391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: Aug 29 21:34:01.031508 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d2d5a-f430-40f5-96cb-f33ade56d173 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:34:01.056567 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 750/1478] 10.222.0.69 () {56 vars in 1108 bytes} [Mon Aug 29 21:34:00 2022] GET /identity/v3/projects => generated 2553 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:34:03.192948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d86bf-8aed-41db-bc36-b2d02e7a6ad4 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:03.193550 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d86bf-8aed-41db-bc36-b2d02e7a6ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:03.193930 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d86bf-8aed-41db-bc36-b2d02e7a6ad4 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:03.196531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 729/1479] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:34:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:34:03.202843 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c1999-7064-47e3-a0ca-bedcb15e08b6 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:03.203688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c1999-7064-47e3-a0ca-bedcb15e08b6 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:03.203863 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c1999-7064-47e3-a0ca-bedcb15e08b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:03.294168 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-6b9c1999-7064-47e3-a0ca-bedcb15e08b6 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:34:03.295425 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-6b9c1999-7064-47e3-a0ca-bedcb15e08b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:34:03.416659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 751/1480] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:34:03.865475 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d86bf-8aed-41db-bc36-b2d02e7a6ad4 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:34:03.867899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-863d86bf-8aed-41db-bc36-b2d02e7a6ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:34:03.879285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:04.053559 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d86bf-8aed-41db-bc36-b2d02e7a6ad4 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:34:04.156469 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:04.202071 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552192d5-772e-43da-ae87-8715bf4ec3be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:34:04.202929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552192d5-772e-43da-ae87-8715bf4ec3be service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:04.203083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552192d5-772e-43da-ae87-8715bf4ec3be service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:04.203360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552192d5-772e-43da-ae87-8715bf4ec3be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:04.205246 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-552192d5-772e-43da-ae87-8715bf4ec3be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:34:04.364651 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552192d5-772e-43da-ae87-8715bf4ec3be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:34:04.366389 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552192d5-772e-43da-ae87-8715bf4ec3be service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:34:04.393140 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 730/1481] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:34:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:34:06.723296 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fdbc5-8289-4058-a3e1-d212cff90b66 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:06.723989 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fdbc5-8289-4058-a3e1-d212cff90b66 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:06.723989 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fdbc5-8289-4058-a3e1-d212cff90b66 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:06.725437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 752/1482] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:34:06.732365 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464474b-1e61-4db6-9f60-c108686ad5ac None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:06.732955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464474b-1e61-4db6-9f60-c108686ad5ac None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:06.732955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464474b-1e61-4db6-9f60-c108686ad5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:06.814531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-b464474b-1e61-4db6-9f60-c108686ad5ac None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:34:06.816349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-b464474b-1e61-4db6-9f60-c108686ad5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:34:06.874388 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:06.975389 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 731/1483] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:34:07.277247 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fdbc5-8289-4058-a3e1-d212cff90b66 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:34:07.278854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3a8fdbc5-8289-4058-a3e1-d212cff90b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:34:07.307440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:07.410077 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fdbc5-8289-4058-a3e1-d212cff90b66 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:34:07.505782 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e472d-a024-43c0-89ca-6a23a5b4e4a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:34:07.506768 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e472d-a024-43c0-89ca-6a23a5b4e4a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:07.507328 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e472d-a024-43c0-89ca-6a23a5b4e4a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:07.507817 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e472d-a024-43c0-89ca-6a23a5b4e4a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:07.511378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e99e472d-a024-43c0-89ca-6a23a5b4e4a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:34:07.649585 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:07.698806 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e472d-a024-43c0-89ca-6a23a5b4e4a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:34:07.701655 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e472d-a024-43c0-89ca-6a23a5b4e4a3 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:34:07.730971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 753/1484] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:34:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:34:09.857319 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3963d-696a-40e9-a3b2-024330bd34cf None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:09.857987 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3963d-696a-40e9-a3b2-024330bd34cf None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:09.857987 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3963d-696a-40e9-a3b2-024330bd34cf None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:09.859169 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 732/1485] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:34:09.865669 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49fb6d-3bcd-4b15-980e-7e47ce8ee95f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:09.866308 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49fb6d-3bcd-4b15-980e-7e47ce8ee95f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:09.866308 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49fb6d-3bcd-4b15-980e-7e47ce8ee95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:09.949534 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-9c49fb6d-3bcd-4b15-980e-7e47ce8ee95f None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:34:09.950827 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9c49fb6d-3bcd-4b15-980e-7e47ce8ee95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:34:10.071103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 754/1486] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:34:10.372115 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3963d-696a-40e9-a3b2-024330bd34cf None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:34:10.375006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-adb3963d-696a-40e9-a3b2-024330bd34cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:34:10.513146 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3963d-696a-40e9-a3b2-024330bd34cf None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:34:10.602003 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:10.605253 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e36ddc-fa08-41bc-b584-60b0a5ea2752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:34:10.605908 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e36ddc-fa08-41bc-b584-60b0a5ea2752 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:10.606432 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e36ddc-fa08-41bc-b584-60b0a5ea2752 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:10.606791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e36ddc-fa08-41bc-b584-60b0a5ea2752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:10.609052 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-97e36ddc-fa08-41bc-b584-60b0a5ea2752 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:34:10.743581 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e36ddc-fa08-41bc-b584-60b0a5ea2752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:34:10.745108 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e36ddc-fa08-41bc-b584-60b0a5ea2752 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:34:10.769783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 733/1487] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:34:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:34:12.938910 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67879fa1-1ef5-44a3-9be3-29f6706f32c0 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:12.939849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67879fa1-1ef5-44a3-9be3-29f6706f32c0 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:12.939849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67879fa1-1ef5-44a3-9be3-29f6706f32c0 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:12.941208 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 755/1488] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:34:12.948906 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df547075-4cd5-45ed-9bb4-c4c39ce81fbf None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:12.949765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df547075-4cd5-45ed-9bb4-c4c39ce81fbf None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:12.949765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df547075-4cd5-45ed-9bb4-c4c39ce81fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:13.052975 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-df547075-4cd5-45ed-9bb4-c4c39ce81fbf None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:34:13.055873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-df547075-4cd5-45ed-9bb4-c4c39ce81fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:34:13.148634 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:13.203779 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 734/1489] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:34:13.517568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67879fa1-1ef5-44a3-9be3-29f6706f32c0 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:34:13.519153 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-67879fa1-1ef5-44a3-9be3-29f6706f32c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:34:13.565105 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:13.653687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67879fa1-1ef5-44a3-9be3-29f6706f32c0 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:34:13.753056 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46d43b-6592-47a9-bd01-46c222e62012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:34:13.753686 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46d43b-6592-47a9-bd01-46c222e62012 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:13.753974 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46d43b-6592-47a9-bd01-46c222e62012 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:13.754249 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46d43b-6592-47a9-bd01-46c222e62012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:13.755999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-de46d43b-6592-47a9-bd01-46c222e62012 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:34:13.995057 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:14.038886 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46d43b-6592-47a9-bd01-46c222e62012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:34:14.042132 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46d43b-6592-47a9-bd01-46c222e62012 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:34:14.063488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 756/1490] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:34:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:34:16.416677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe8794-04a2-4f63-811c-b20ba8adfd5c None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:16.417287 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe8794-04a2-4f63-811c-b20ba8adfd5c None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:16.417558 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe8794-04a2-4f63-811c-b20ba8adfd5c None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:16.419968 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 735/1491] 10.222.0.69 () {54 vars in 927 bytes} [Mon Aug 29 21:34:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:34:16.426700 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be5790-5622-4a3d-a21b-2dc7a1422f24 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:16.427314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be5790-5622-4a3d-a21b-2dc7a1422f24 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:16.427314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be5790-5622-4a3d-a21b-2dc7a1422f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:16.511107 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-48be5790-5622-4a3d-a21b-2dc7a1422f24 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:34:16.512682 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-48be5790-5622-4a3d-a21b-2dc7a1422f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:34:16.654886 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 757/1492] 10.222.0.69 () {58 vars in 1024 bytes} [Mon Aug 29 21:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:34:17.226941 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe8794-04a2-4f63-811c-b20ba8adfd5c None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:34:17.228987 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-befe8794-04a2-4f63-811c-b20ba8adfd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:34:17.362130 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe8794-04a2-4f63-811c-b20ba8adfd5c None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:34:17.464444 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb84cc-8efc-45af-aec4-adb7fa34c50f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:34:17.465185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb84cc-8efc-45af-aec4-adb7fa34c50f service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:34:17.465347 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb84cc-8efc-45af-aec4-adb7fa34c50f service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:34:17.465596 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb84cc-8efc-45af-aec4-adb7fa34c50f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:34:17.467303 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-40fb84cc-8efc-45af-aec4-adb7fa34c50f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:34:17.482035 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:17.671944 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb84cc-8efc-45af-aec4-adb7fa34c50f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:34:17.674781 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb84cc-8efc-45af-aec4-adb7fa34c50f service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:34:17.712036 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 736/1493] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:34:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:34:26.651070 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=82 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:27.707213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=50 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:39.388155 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25706424-0eb3-4388-afeb-c94f4fc4f162 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:39.388829 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25706424-0eb3-4388-afeb-c94f4fc4f162 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:39.388829 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25706424-0eb3-4388-afeb-c94f4fc4f162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:39.484560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-25706424-0eb3-4388-afeb-c94f4fc4f162 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:35:39.485905 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-25706424-0eb3-4388-afeb-c94f4fc4f162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:39.643560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 758/1494] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:35:39.654437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e50df8-36cf-497f-8329-aa57bd897212 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:39.655413 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e50df8-36cf-497f-8329-aa57bd897212 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:39.655413 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e50df8-36cf-497f-8329-aa57bd897212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:39.751581 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-20e50df8-36cf-497f-8329-aa57bd897212 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:35:39.752832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-20e50df8-36cf-497f-8329-aa57bd897212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:39.907958 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 737/1495] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:35:39.913052 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25706424-0eb3-4388-afeb-c94f4fc4f162 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:35:39.914300 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-25706424-0eb3-4388-afeb-c94f4fc4f162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:39.927125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25706424-0eb3-4388-afeb-c94f4fc4f162 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:35:40.005121 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:40.064639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d59a1-3b94-4896-a73e-a8eb2063c497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:35:40.065279 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d59a1-3b94-4896-a73e-a8eb2063c497 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:40.065558 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d59a1-3b94-4896-a73e-a8eb2063c497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:40.065830 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d59a1-3b94-4896-a73e-a8eb2063c497 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:40.066495 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d59a1-3b94-4896-a73e-a8eb2063c497 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:35:40.066805 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d59a1-3b94-4896-a73e-a8eb2063c497 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:35:40.067859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: WARNING py.warnings [None req-e44d59a1-3b94-4896-a73e-a8eb2063c497 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:35:40.067859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: warnings.warn(msg) Aug 29 21:35:40.067859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: Aug 29 21:35:40.068829 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d59a1-3b94-4896-a73e-a8eb2063c497 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:35:40.084273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 759/1496] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:35:40.099706 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e50df8-36cf-497f-8329-aa57bd897212 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:35:40.110664 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e50df8-36cf-497f-8329-aa57bd897212 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:35:40.194439 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:40.252701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc180c-95fc-4582-8dbe-e976475c10c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:35:40.253789 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc180c-95fc-4582-8dbe-e976475c10c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:40.254243 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc180c-95fc-4582-8dbe-e976475c10c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:40.254724 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc180c-95fc-4582-8dbe-e976475c10c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:40.255968 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc180c-95fc-4582-8dbe-e976475c10c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:35:40.259301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: WARNING py.warnings [None req-1fbc180c-95fc-4582-8dbe-e976475c10c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:35:40.259301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: warnings.warn(msg) Aug 29 21:35:40.259301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: Aug 29 21:35:40.261779 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc180c-95fc-4582-8dbe-e976475c10c2 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:35:40.368025 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 738/1497] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:35:40 2022] POST /identity/v3/projects => generated 377 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:35:40.373909 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d59a1-3b94-4896-a73e-a8eb2063c497 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:35:40.375811 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e44d59a1-3b94-4896-a73e-a8eb2063c497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:40.416771 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d59a1-3b94-4896-a73e-a8eb2063c497 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:35:40.531918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5307d-db23-4972-b2d9-1ef0051dc5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:35:40.532613 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5307d-db23-4972-b2d9-1ef0051dc5ed admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:40.532940 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5307d-db23-4972-b2d9-1ef0051dc5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:40.533262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5307d-db23-4972-b2d9-1ef0051dc5ed admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:40.533970 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5307d-db23-4972-b2d9-1ef0051dc5ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:35:40.535400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: WARNING py.warnings [None req-2fd5307d-db23-4972-b2d9-1ef0051dc5ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:35:40.535400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: warnings.warn(msg) Aug 29 21:35:40.535400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: Aug 29 21:35:40.536871 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5307d-db23-4972-b2d9-1ef0051dc5ed admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:35:40.588871 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 760/1498] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:35:40 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:35:40.593538 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc180c-95fc-4582-8dbe-e976475c10c2 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:35:40.595238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-1fbc180c-95fc-4582-8dbe-e976475c10c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:40.666753 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc180c-95fc-4582-8dbe-e976475c10c2 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:35:40.770319 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:40.794540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ef505-7727-4c1c-a93c-cfa36ede8cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:35:40.795514 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ef505-7727-4c1c-a93c-cfa36ede8cdb admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:40.796020 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ef505-7727-4c1c-a93c-cfa36ede8cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:40.796563 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ef505-7727-4c1c-a93c-cfa36ede8cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:40.797766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ef505-7727-4c1c-a93c-cfa36ede8cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:35:40.799737 dv-cinder-854267-3-smb devstack@keystone.service[81659]: WARNING py.warnings [None req-ab3ef505-7727-4c1c-a93c-cfa36ede8cdb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:35:40.799737 dv-cinder-854267-3-smb devstack@keystone.service[81659]: warnings.warn(msg) Aug 29 21:35:40.799737 dv-cinder-854267-3-smb devstack@keystone.service[81659]: Aug 29 21:35:40.801478 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ef505-7727-4c1c-a93c-cfa36ede8cdb admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:35:40.827906 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 739/1499] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:35:40.832451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5307d-db23-4972-b2d9-1ef0051dc5ed admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:35:40.834186 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2fd5307d-db23-4972-b2d9-1ef0051dc5ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:40.846586 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5307d-db23-4972-b2d9-1ef0051dc5ed admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:35:40.882612 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:40.969063 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effc2a1-684b-4abe-8bbb-eb8b82a285f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:35:40.969694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effc2a1-684b-4abe-8bbb-eb8b82a285f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:40.969974 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effc2a1-684b-4abe-8bbb-eb8b82a285f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:40.970249 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effc2a1-684b-4abe-8bbb-eb8b82a285f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:40.970923 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effc2a1-684b-4abe-8bbb-eb8b82a285f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:35:40.971972 dv-cinder-854267-3-smb devstack@keystone.service[81658]: WARNING py.warnings [None req-6effc2a1-684b-4abe-8bbb-eb8b82a285f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:35:40.971972 dv-cinder-854267-3-smb devstack@keystone.service[81658]: warnings.warn(msg) Aug 29 21:35:40.971972 dv-cinder-854267-3-smb devstack@keystone.service[81658]: Aug 29 21:35:40.972929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effc2a1-684b-4abe-8bbb-eb8b82a285f0 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:35:40.988654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 761/1500] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:35:40.993109 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ef505-7727-4c1c-a93c-cfa36ede8cdb admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:35:40.994700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-ab3ef505-7727-4c1c-a93c-cfa36ede8cdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:41.036553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ef505-7727-4c1c-a93c-cfa36ede8cdb admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:35:41.164980 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a48c2-4173-4cf1-b525-4527e189bffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:35:41.165660 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a48c2-4173-4cf1-b525-4527e189bffb admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:41.166028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a48c2-4173-4cf1-b525-4527e189bffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:41.166309 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a48c2-4173-4cf1-b525-4527e189bffb admin admin] PATH_INFO: `/v3/projects/272af63b706249809f157b26874286e1/users/410807ae98c544c093bd50f3ceb063df/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:41.192782 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a48c2-4173-4cf1-b525-4527e189bffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=272af63b706249809f157b26874286e1, user_id=410807ae98c544c093bd50f3ceb063df, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:35:41.193854 dv-cinder-854267-3-smb devstack@keystone.service[81659]: WARNING py.warnings [None req-3b6a48c2-4173-4cf1-b525-4527e189bffb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:35:41.193854 dv-cinder-854267-3-smb devstack@keystone.service[81659]: warnings.warn(msg) Aug 29 21:35:41.193854 dv-cinder-854267-3-smb devstack@keystone.service[81659]: Aug 29 21:35:41.195847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a48c2-4173-4cf1-b525-4527e189bffb admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:35:41.227791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 740/1501] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:35:40 2022] PUT /identity/v3/projects/272af63b706249809f157b26874286e1/users/410807ae98c544c093bd50f3ceb063df/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:35:41.240895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8d773-4427-4dfc-a7cb-5e39034f1ea3 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:41.241203 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8d773-4427-4dfc-a7cb-5e39034f1ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:41.241455 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8d773-4427-4dfc-a7cb-5e39034f1ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:41.309953 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-dae8d773-4427-4dfc-a7cb-5e39034f1ea3 None None] MFA Rules not processed for user `410807ae98c544c093bd50f3ceb063df`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:35:41.311153 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-dae8d773-4427-4dfc-a7cb-5e39034f1ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:41.408535 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 762/1502] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:35:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:35:41.423684 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5d4b2-0293-481d-9b6f-428e9c567b4c None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:41.423967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5d4b2-0293-481d-9b6f-428e9c567b4c None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:41.424284 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5d4b2-0293-481d-9b6f-428e9c567b4c None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:41.425707 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 741/1503] 10.222.0.69 () {54 vars in 964 bytes} [Mon Aug 29 21:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:35:41.431415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f846a3f-09b0-46e4-8919-b3d958c7aa80 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:41.431978 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f846a3f-09b0-46e4-8919-b3d958c7aa80 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:41.432086 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f846a3f-09b0-46e4-8919-b3d958c7aa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:41.468852 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:41.524522 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-8f846a3f-09b0-46e4-8919-b3d958c7aa80 None None] MFA Rules not processed for user `ad05a52c8aec4744a41639f2343eb54f`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:35:41.525778 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-8f846a3f-09b0-46e4-8919-b3d958c7aa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:41.624950 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 763/1504] 10.222.0.69 () {58 vars in 1061 bytes} [Mon Aug 29 21:35:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:35:41.633180 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5d4b2-0293-481d-9b6f-428e9c567b4c None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:35:41.635129 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-d7c5d4b2-0293-481d-9b6f-428e9c567b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:41.712932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:41.803694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5d4b2-0293-481d-9b6f-428e9c567b4c None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:35:41.894416 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c75d9-bc23-43f8-9ff0-a50c0379918d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:35:41.895042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c75d9-bc23-43f8-9ff0-a50c0379918d service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:41.895322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c75d9-bc23-43f8-9ff0-a50c0379918d service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:41.895598 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c75d9-bc23-43f8-9ff0-a50c0379918d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:41.897374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-069c75d9-bc23-43f8-9ff0-a50c0379918d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:42.013521 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c75d9-bc23-43f8-9ff0-a50c0379918d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:35:42.015248 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c75d9-bc23-43f8-9ff0-a50c0379918d service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:35:42.020665 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:42.048213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 742/1505] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:35:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:35:42.112671 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9b1d0-2b3a-424f-82a2-f3911296aae3 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:42.112959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9b1d0-2b3a-424f-82a2-f3911296aae3 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:42.113299 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9b1d0-2b3a-424f-82a2-f3911296aae3 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:42.114775 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 764/1506] 10.222.0.69 () {52 vars in 830 bytes} [Mon Aug 29 21:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:35:42.119546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c75d9-bc23-43f8-9ff0-a50c0379918d service cinder] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:35:42.121442 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-069c75d9-bc23-43f8-9ff0-a50c0379918d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:42.245426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c75d9-bc23-43f8-9ff0-a50c0379918d service cinder] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:35:42.364786 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91362b-0e6c-42db-8caf-57e0390b49c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:35:42.365567 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91362b-0e6c-42db-8caf-57e0390b49c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:42.365949 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91362b-0e6c-42db-8caf-57e0390b49c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:42.366317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91362b-0e6c-42db-8caf-57e0390b49c1 admin admin] PATH_INFO: `/v3/users/410807ae98c544c093bd50f3ceb063df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:42.381544 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91362b-0e6c-42db-8caf-57e0390b49c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=410807ae98c544c093bd50f3ceb063df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:35:42.382762 dv-cinder-854267-3-smb devstack@keystone.service[81659]: WARNING py.warnings [None req-fb91362b-0e6c-42db-8caf-57e0390b49c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:35:42.382762 dv-cinder-854267-3-smb devstack@keystone.service[81659]: warnings.warn(msg) Aug 29 21:35:42.382762 dv-cinder-854267-3-smb devstack@keystone.service[81659]: Aug 29 21:35:42.384278 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91362b-0e6c-42db-8caf-57e0390b49c1 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:35:42.398222 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:42.471105 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-fb91362b-0e6c-42db-8caf-57e0390b49c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '410807ae98c544c093bd50f3ceb063df'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:35:42.487692 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-fb91362b-0e6c-42db-8caf-57e0390b49c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '410807ae98c544c093bd50f3ceb063df'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:35:42.519727 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-fb91362b-0e6c-42db-8caf-57e0390b49c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '410807ae98c544c093bd50f3ceb063df'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:35:42.520241 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-fb91362b-0e6c-42db-8caf-57e0390b49c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '410807ae98c544c093bd50f3ceb063df'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:35:42.520772 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-fb91362b-0e6c-42db-8caf-57e0390b49c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '410807ae98c544c093bd50f3ceb063df'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:35:42.539560 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 743/1507] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:35:42 2022] DELETE /identity/v3/users/410807ae98c544c093bd50f3ceb063df => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:35:42.545445 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32708e-7b66-49a1-9628-4c08a255a2c7 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:42.546015 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32708e-7b66-49a1-9628-4c08a255a2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:42.546015 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32708e-7b66-49a1-9628-4c08a255a2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:42.614090 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ff32708e-7b66-49a1-9628-4c08a255a2c7 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:35:42.615369 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ff32708e-7b66-49a1-9628-4c08a255a2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:42.710450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:42.727060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 765/1508] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:35:42.737526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91362b-0e6c-42db-8caf-57e0390b49c1 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:35:42.738773 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-fb91362b-0e6c-42db-8caf-57e0390b49c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:42.905305 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91362b-0e6c-42db-8caf-57e0390b49c1 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:35:42.983615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:43.014477 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5eaf7-9c2a-4d93-a1db-7961b1679360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:35:43.015111 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5eaf7-9c2a-4d93-a1db-7961b1679360 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:43.015396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5eaf7-9c2a-4d93-a1db-7961b1679360 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:43.015706 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5eaf7-9c2a-4d93-a1db-7961b1679360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:43.017466 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-77c5eaf7-9c2a-4d93-a1db-7961b1679360 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:43.161895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5eaf7-9c2a-4d93-a1db-7961b1679360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:35:43.163617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5eaf7-9c2a-4d93-a1db-7961b1679360 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:35:43.199611 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 744/1509] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:35:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:35:43.603026 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32708e-7b66-49a1-9628-4c08a255a2c7 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:35:43.604474 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ff32708e-7b66-49a1-9628-4c08a255a2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:35:43.621925 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32708e-7b66-49a1-9628-4c08a255a2c7 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:35:43.762609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b4a14-6411-42fd-8c8e-9ec16a6db450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:35:43.763266 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b4a14-6411-42fd-8c8e-9ec16a6db450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:35:43.763543 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b4a14-6411-42fd-8c8e-9ec16a6db450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:35:43.763815 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b4a14-6411-42fd-8c8e-9ec16a6db450 admin admin] PATH_INFO: `/v3/projects/272af63b706249809f157b26874286e1` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:35:43.777414 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b4a14-6411-42fd-8c8e-9ec16a6db450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=272af63b706249809f157b26874286e1)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:35:43.778736 dv-cinder-854267-3-smb devstack@keystone.service[81658]: WARNING py.warnings [None req-657b4a14-6411-42fd-8c8e-9ec16a6db450 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:35:43.778736 dv-cinder-854267-3-smb devstack@keystone.service[81658]: warnings.warn(msg) Aug 29 21:35:43.778736 dv-cinder-854267-3-smb devstack@keystone.service[81658]: Aug 29 21:35:43.780653 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b4a14-6411-42fd-8c8e-9ec16a6db450 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:35:43.857932 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-657b4a14-6411-42fd-8c8e-9ec16a6db450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '272af63b706249809f157b26874286e1', 'request_id': 'req-657b4a14-6411-42fd-8c8e-9ec16a6db450'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:35:43.873782 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-657b4a14-6411-42fd-8c8e-9ec16a6db450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '272af63b706249809f157b26874286e1', 'request_id': 'req-657b4a14-6411-42fd-8c8e-9ec16a6db450'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:35:43.881576 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-657b4a14-6411-42fd-8c8e-9ec16a6db450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '272af63b706249809f157b26874286e1', 'request_id': 'req-657b4a14-6411-42fd-8c8e-9ec16a6db450'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:35:43.918218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-657b4a14-6411-42fd-8c8e-9ec16a6db450 admin admin] The token cache is being invalidate because project 272af63b706249809f157b26874286e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:35:43.918508 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-657b4a14-6411-42fd-8c8e-9ec16a6db450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:35:43.918924 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-657b4a14-6411-42fd-8c8e-9ec16a6db450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:35:43.920549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 766/1510] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:35:43 2022] DELETE /identity/v3/projects/272af63b706249809f157b26874286e1 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:35:53.193141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=62 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:53.914394 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:27.809706 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685d6d9-1d29-4850-803c-575f549217a1 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:27.810365 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685d6d9-1d29-4850-803c-575f549217a1 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:27.810365 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685d6d9-1d29-4850-803c-575f549217a1 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:27.811665 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 745/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:37:27.817427 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9237919-afad-4dd6-84cc-ed33cda43178 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:27.818003 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9237919-afad-4dd6-84cc-ed33cda43178 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:27.818110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9237919-afad-4dd6-84cc-ed33cda43178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:27.932780 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d9237919-afad-4dd6-84cc-ed33cda43178 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:27.934883 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d9237919-afad-4dd6-84cc-ed33cda43178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:28.074107 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 767/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:28.237850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685d6d9-1d29-4850-803c-575f549217a1 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:28.240368 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-9685d6d9-1d29-4850-803c-575f549217a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:28.381363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685d6d9-1d29-4850-803c-575f549217a1 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:28.387460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0760b62-ba1b-4b94-a43d-d3cdf4294882 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:28.388091 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0760b62-ba1b-4b94-a43d-d3cdf4294882 service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:28.388480 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0760b62-ba1b-4b94-a43d-d3cdf4294882 service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:28.388756 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0760b62-ba1b-4b94-a43d-d3cdf4294882 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:28.398782 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0760b62-ba1b-4b94-a43d-d3cdf4294882 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:28.400443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0760b62-ba1b-4b94-a43d-d3cdf4294882 service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:28.411239 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 746/1513] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:37:29.292368 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badab134-60f9-4f40-9002-a736dcdb53ab None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:29.293147 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badab134-60f9-4f40-9002-a736dcdb53ab None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:29.293351 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badab134-60f9-4f40-9002-a736dcdb53ab None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:29.295071 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 768/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:37:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:37:29.301356 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046583de-6e2a-4f08-93b1-7e0a01e35b2c None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:29.301947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046583de-6e2a-4f08-93b1-7e0a01e35b2c None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:29.301947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046583de-6e2a-4f08-93b1-7e0a01e35b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:29.341882 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-046583de-6e2a-4f08-93b1-7e0a01e35b2c None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:29.343914 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-046583de-6e2a-4f08-93b1-7e0a01e35b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:29.358300 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 747/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:29.526361 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badab134-60f9-4f40-9002-a736dcdb53ab None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:29.547448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badab134-60f9-4f40-9002-a736dcdb53ab None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:29.553335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8d9bf-4733-44d7-aafa-00df4b23bb98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:29.553964 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8d9bf-4733-44d7-aafa-00df4b23bb98 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:29.554245 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8d9bf-4733-44d7-aafa-00df4b23bb98 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:29.554517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8d9bf-4733-44d7-aafa-00df4b23bb98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:29.564660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8d9bf-4733-44d7-aafa-00df4b23bb98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:29.566732 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8d9bf-4733-44d7-aafa-00df4b23bb98 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:29.583754 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 769/1516] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:37:30.217451 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc75895-e9ba-4791-99b8-67965e7aa614 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:30.218252 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc75895-e9ba-4791-99b8-67965e7aa614 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:30.218747 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc75895-e9ba-4791-99b8-67965e7aa614 None None] PATH_INFO: `/v3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:30.221079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 748/1517] 10.222.0.70 () {54 vars in 925 bytes} [Mon Aug 29 21:37:30 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:37:30.229144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ffb84-95db-4aca-9046-ce6fb2e5d7c2 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:30.229743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ffb84-95db-4aca-9046-ce6fb2e5d7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:30.234930 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ffb84-95db-4aca-9046-ce6fb2e5d7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:30.323319 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-bb4ffb84-95db-4aca-9046-ce6fb2e5d7c2 None None] MFA Rules not processed for user `a7911672bb2a471daf4f69ba940ef41d`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:30.325456 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-bb4ffb84-95db-4aca-9046-ce6fb2e5d7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:30.358231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:30.426194 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 770/1518] 10.222.0.70 () {58 vars in 1015 bytes} [Mon Aug 29 21:37:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:39.334094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=56 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:40.423081 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=23 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:40.964434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daa9fb-8285-45bf-b393-e48abdff95e9 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:40.965187 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daa9fb-8285-45bf-b393-e48abdff95e9 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:40.965187 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daa9fb-8285-45bf-b393-e48abdff95e9 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:40.966628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 749/1519] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:37:40.973977 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cf72e-acb3-418c-93de-d771b31caeef None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:40.974470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cf72e-acb3-418c-93de-d771b31caeef None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:40.974959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cf72e-acb3-418c-93de-d771b31caeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:41.008998 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-972cf72e-acb3-418c-93de-d771b31caeef None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:41.011312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-972cf72e-acb3-418c-93de-d771b31caeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:41.024641 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 771/1520] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:41.160449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6fc27-15ae-43b2-9de8-93ac908cae88 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:41.160786 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6fc27-15ae-43b2-9de8-93ac908cae88 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:41.161071 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6fc27-15ae-43b2-9de8-93ac908cae88 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:41.162453 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 750/1521] 10.222.0.69 () {54 vars in 961 bytes} [Mon Aug 29 21:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:37:41.169942 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f9d34-859e-49d5-95ec-fcd12d72c8f0 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:41.170381 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f9d34-859e-49d5-95ec-fcd12d72c8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:41.170796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f9d34-859e-49d5-95ec-fcd12d72c8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:41.196373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-448f9d34-859e-49d5-95ec-fcd12d72c8f0 None None] MFA Rules not processed for user `a7911672bb2a471daf4f69ba940ef41d`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:41.197673 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-448f9d34-859e-49d5-95ec-fcd12d72c8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:41.208975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 772/1522] 10.222.0.69 () {58 vars in 1058 bytes} [Mon Aug 29 21:37:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:41.222889 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6fc27-15ae-43b2-9de8-93ac908cae88 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:41.253015 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6fc27-15ae-43b2-9de8-93ac908cae88 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:41.260766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106189c-996b-440e-844d-9edc77a714f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7911672bb2a471daf4f69ba940ef41d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:41.261568 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106189c-996b-440e-844d-9edc77a714f9 service placement] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:41.262047 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106189c-996b-440e-844d-9edc77a714f9 service placement] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:41.262548 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106189c-996b-440e-844d-9edc77a714f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:41.279883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106189c-996b-440e-844d-9edc77a714f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:41.283408 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106189c-996b-440e-844d-9edc77a714f9 service placement] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:41.303503 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 751/1523] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:37:41.326188 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f9d34-859e-49d5-95ec-fcd12d72c8f0 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:41.352529 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f9d34-859e-49d5-95ec-fcd12d72c8f0 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:41.363633 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43607557-c1c7-4010-b8e4-44e482061ab0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:41.364716 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43607557-c1c7-4010-b8e4-44e482061ab0 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:41.365207 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43607557-c1c7-4010-b8e4-44e482061ab0 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:41.365723 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43607557-c1c7-4010-b8e4-44e482061ab0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:41.382364 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43607557-c1c7-4010-b8e4-44e482061ab0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:41.385549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43607557-c1c7-4010-b8e4-44e482061ab0 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:41.402322 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 773/1524] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:37:42.619933 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b46fa5-6421-4656-8618-d846fa45f240 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:42.620554 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b46fa5-6421-4656-8618-d846fa45f240 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:42.620932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b46fa5-6421-4656-8618-d846fa45f240 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:42.623480 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 752/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:37:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:37:42.629923 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec28a4-e3e9-4255-953e-572de850401a None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:42.630619 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec28a4-e3e9-4255-953e-572de850401a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:42.630619 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec28a4-e3e9-4255-953e-572de850401a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:42.651604 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-3aec28a4-e3e9-4255-953e-572de850401a None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:42.652868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3aec28a4-e3e9-4255-953e-572de850401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:42.664141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 774/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:42.823663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b46fa5-6421-4656-8618-d846fa45f240 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:42.839196 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b46fa5-6421-4656-8618-d846fa45f240 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:42.845940 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64919f-a9d5-4da5-a74a-59674a37dc2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:42.846571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64919f-a9d5-4da5-a74a-59674a37dc2d service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:42.847162 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64919f-a9d5-4da5-a74a-59674a37dc2d service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:42.847470 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64919f-a9d5-4da5-a74a-59674a37dc2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:42.857353 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64919f-a9d5-4da5-a74a-59674a37dc2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:42.859062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64919f-a9d5-4da5-a74a-59674a37dc2d service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:42.878961 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 753/1527] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:37:47.102997 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c5815-dd26-4ded-960d-22b0ea85f88d None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:47.103747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c5815-dd26-4ded-960d-22b0ea85f88d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:47.103747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c5815-dd26-4ded-960d-22b0ea85f88d None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:47.105550 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 775/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:37:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:37:47.112015 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7051b-c28d-40a4-8fa2-3c1160be5f19 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:47.112873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7051b-c28d-40a4-8fa2-3c1160be5f19 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:47.112873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7051b-c28d-40a4-8fa2-3c1160be5f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:47.137656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-70b7051b-c28d-40a4-8fa2-3c1160be5f19 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:47.138923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-70b7051b-c28d-40a4-8fa2-3c1160be5f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:47.150417 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 754/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:47.452143 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c5815-dd26-4ded-960d-22b0ea85f88d None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:47.454125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-080c5815-dd26-4ded-960d-22b0ea85f88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:47.550975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c5815-dd26-4ded-960d-22b0ea85f88d None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:47.555323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87079b66-6feb-42a9-9e3a-0035a865b257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:47.555959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87079b66-6feb-42a9-9e3a-0035a865b257 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:47.556290 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87079b66-6feb-42a9-9e3a-0035a865b257 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:47.556540 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87079b66-6feb-42a9-9e3a-0035a865b257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:47.567623 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87079b66-6feb-42a9-9e3a-0035a865b257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:47.569106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87079b66-6feb-42a9-9e3a-0035a865b257 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:47.580969 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 776/1530] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:37:49.668356 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30277965-aeec-4bb0-b01e-c6e0f36bb795 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:49.669013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30277965-aeec-4bb0-b01e-c6e0f36bb795 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:49.669013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30277965-aeec-4bb0-b01e-c6e0f36bb795 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:49.670272 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 755/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:37:49.676393 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443b182-875d-42b4-ae4a-104551c96195 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:49.677211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443b182-875d-42b4-ae4a-104551c96195 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:49.677386 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443b182-875d-42b4-ae4a-104551c96195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:49.698263 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-9443b182-875d-42b4-ae4a-104551c96195 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:49.699480 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9443b182-875d-42b4-ae4a-104551c96195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:49.708002 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 777/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:50.008995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30277965-aeec-4bb0-b01e-c6e0f36bb795 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:50.022561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30277965-aeec-4bb0-b01e-c6e0f36bb795 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:50.027267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577cf552-1cd1-433d-87a4-cf07c85b65b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:50.027924 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cf552-1cd1-433d-87a4-cf07c85b65b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:50.028226 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cf552-1cd1-433d-87a4-cf07c85b65b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:50.028504 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cf552-1cd1-433d-87a4-cf07c85b65b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:50.039115 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577cf552-1cd1-433d-87a4-cf07c85b65b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:50.040825 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577cf552-1cd1-433d-87a4-cf07c85b65b9 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:50.053089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 756/1533] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:37:53.675136 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb81175-7a93-41f2-a648-a952ab976d87 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:53.675923 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb81175-7a93-41f2-a648-a952ab976d87 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:53.675923 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb81175-7a93-41f2-a648-a952ab976d87 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:53.677397 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 778/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:37:53.685078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ad3e4-40ae-4d7f-83c1-08f62d1f6c95 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:53.685928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ad3e4-40ae-4d7f-83c1-08f62d1f6c95 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:53.685928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ad3e4-40ae-4d7f-83c1-08f62d1f6c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:53.708359 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-434ad3e4-40ae-4d7f-83c1-08f62d1f6c95 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:53.709791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-434ad3e4-40ae-4d7f-83c1-08f62d1f6c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:53.718429 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 757/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:37:54.307835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb81175-7a93-41f2-a648-a952ab976d87 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:54.309624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-beb81175-7a93-41f2-a648-a952ab976d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:54.414047 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb81175-7a93-41f2-a648-a952ab976d87 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:54.418065 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78273d-9ac8-43f6-897c-c03edc4485ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:54.418721 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78273d-9ac8-43f6-897c-c03edc4485ce service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:54.419005 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78273d-9ac8-43f6-897c-c03edc4485ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:54.419282 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78273d-9ac8-43f6-897c-c03edc4485ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:54.429621 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78273d-9ac8-43f6-897c-c03edc4485ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:54.431409 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78273d-9ac8-43f6-897c-c03edc4485ce service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:54.443856 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 779/1536] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:37:56.629470 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e37d4-290d-4474-bf5d-29f76df94e32 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:56.630259 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e37d4-290d-4474-bf5d-29f76df94e32 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:56.630259 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e37d4-290d-4474-bf5d-29f76df94e32 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:56.631434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 758/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:37:56.637952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4d19b-525b-4d21-be6b-5fe91d77e5ae None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:56.638552 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4d19b-525b-4d21-be6b-5fe91d77e5ae None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:56.638552 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4d19b-525b-4d21-be6b-5fe91d77e5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:56.662154 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-87b4d19b-525b-4d21-be6b-5fe91d77e5ae None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:37:56.663400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-87b4d19b-525b-4d21-be6b-5fe91d77e5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:56.672554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 780/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:37:57.288686 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e37d4-290d-4474-bf5d-29f76df94e32 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:37:57.288686 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f54e37d4-290d-4474-bf5d-29f76df94e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:37:57.311802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e37d4-290d-4474-bf5d-29f76df94e32 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:37:57.318802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8daab3-0d82-44de-8c4c-3dfa7845c665 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:37:57.319837 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8daab3-0d82-44de-8c4c-3dfa7845c665 service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:37:57.320587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8daab3-0d82-44de-8c4c-3dfa7845c665 service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:37:57.321025 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8daab3-0d82-44de-8c4c-3dfa7845c665 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:37:57.340841 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8daab3-0d82-44de-8c4c-3dfa7845c665 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:37:57.343725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8daab3-0d82-44de-8c4c-3dfa7845c665 service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:37:57.363205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 759/1539] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:37:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:38:06.654964 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=91 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:07.354610 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=30 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:34.804108 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d299c1-250d-4d6c-b15d-ecf8a9d46803 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:34.806090 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d299c1-250d-4d6c-b15d-ecf8a9d46803 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:34.807663 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d299c1-250d-4d6c-b15d-ecf8a9d46803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:34.874185 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d1d299c1-250d-4d6c-b15d-ecf8a9d46803 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:34.876461 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d1d299c1-250d-4d6c-b15d-ecf8a9d46803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:34.896918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 781/1540] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:34.911096 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ccd9e-37b6-4c5e-ad52-3febf8791efc None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:34.911746 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ccd9e-37b6-4c5e-ad52-3febf8791efc None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:34.911746 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ccd9e-37b6-4c5e-ad52-3febf8791efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:34.961964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-854ccd9e-37b6-4c5e-ad52-3febf8791efc None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:34.963462 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-854ccd9e-37b6-4c5e-ad52-3febf8791efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:34.975071 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 760/1541] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:34.981505 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d299c1-250d-4d6c-b15d-ecf8a9d46803 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:35.011417 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d299c1-250d-4d6c-b15d-ecf8a9d46803 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:35.027304 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93992850-c283-4ae4-9383-efcb0df87751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:35.028612 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93992850-c283-4ae4-9383-efcb0df87751 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:35.029126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93992850-c283-4ae4-9383-efcb0df87751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:35.029625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93992850-c283-4ae4-9383-efcb0df87751 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:35.030852 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93992850-c283-4ae4-9383-efcb0df87751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:39:35.032804 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93992850-c283-4ae4-9383-efcb0df87751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:35.037414 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93992850-c283-4ae4-9383-efcb0df87751 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:35.071891 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 782/1542] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:39:35.082801 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ccd9e-37b6-4c5e-ad52-3febf8791efc None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:35.091984 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191103c-7316-4731-8fa3-e6c9a3e27f79 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:35.092327 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191103c-7316-4731-8fa3-e6c9a3e27f79 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:35.092705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191103c-7316-4731-8fa3-e6c9a3e27f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:35.109045 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ccd9e-37b6-4c5e-ad52-3febf8791efc None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:35.118351 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ae5f1-7389-4e57-9128-45fbae16a7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:35.119024 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ae5f1-7389-4e57-9128-45fbae16a7cc admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:35.119309 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ae5f1-7389-4e57-9128-45fbae16a7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:35.119523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ae5f1-7389-4e57-9128-45fbae16a7cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:35.120217 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ae5f1-7389-4e57-9128-45fbae16a7cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:35.122206 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ae5f1-7389-4e57-9128-45fbae16a7cc admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:35.133411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-b191103c-7316-4731-8fa3-e6c9a3e27f79 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:35.134677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b191103c-7316-4731-8fa3-e6c9a3e27f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:35.158164 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 783/1543] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:39:35.167870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66abab-63f9-4e23-8a61-1e467d366712 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:35.168228 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66abab-63f9-4e23-8a61-1e467d366712 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:35.168566 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66abab-63f9-4e23-8a61-1e467d366712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:35.216925 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-df66abab-63f9-4e23-8a61-1e467d366712 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:35.218184 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-df66abab-63f9-4e23-8a61-1e467d366712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:35.247242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 784/1544] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:39:35.252223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66abab-63f9-4e23-8a61-1e467d366712 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:35.263413 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 761/1545] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:39:35 2022] POST /identity/v3/projects => generated 393 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:35.270709 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66abab-63f9-4e23-8a61-1e467d366712 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:35.271936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ae5f1-7389-4e57-9128-45fbae16a7cc admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:35.437044 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ebace-5f1c-46cb-859c-9138ff896334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:35.437700 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ebace-5f1c-46cb-859c-9138ff896334 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:35.437995 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ebace-5f1c-46cb-859c-9138ff896334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:35.438524 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ebace-5f1c-46cb-859c-9138ff896334 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:35.439565 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ebace-5f1c-46cb-859c-9138ff896334 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:39:35.439962 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ebace-5f1c-46cb-859c-9138ff896334 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:35.442337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ebace-5f1c-46cb-859c-9138ff896334 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:35.463767 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 785/1546] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:39:35.477303 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ebace-5f1c-46cb-859c-9138ff896334 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:35.486139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ae5f1-7389-4e57-9128-45fbae16a7cc admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:35.495347 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ebace-5f1c-46cb-859c-9138ff896334 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:35.504009 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359a9f2-aab5-41ce-810e-1b7f8aca735c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:35.508224 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359a9f2-aab5-41ce-810e-1b7f8aca735c admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:35.508224 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359a9f2-aab5-41ce-810e-1b7f8aca735c admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:35.508224 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359a9f2-aab5-41ce-810e-1b7f8aca735c admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:35.508683 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359a9f2-aab5-41ce-810e-1b7f8aca735c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:35.510473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: WARNING py.warnings [None req-d359a9f2-aab5-41ce-810e-1b7f8aca735c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:39:35.510473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: warnings.warn(msg) Aug 29 21:39:35.510473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: Aug 29 21:39:35.517109 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359a9f2-aab5-41ce-810e-1b7f8aca735c admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:35.533102 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce486a0-0de3-457f-9cb7-5e3f70d3234d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:35.533754 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce486a0-0de3-457f-9cb7-5e3f70d3234d admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:35.534045 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce486a0-0de3-457f-9cb7-5e3f70d3234d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:35.534343 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce486a0-0de3-457f-9cb7-5e3f70d3234d admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:35.535004 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce486a0-0de3-457f-9cb7-5e3f70d3234d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:35.536055 dv-cinder-854267-3-smb devstack@keystone.service[81658]: WARNING py.warnings [None req-6ce486a0-0de3-457f-9cb7-5e3f70d3234d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:39:35.536055 dv-cinder-854267-3-smb devstack@keystone.service[81658]: warnings.warn(msg) Aug 29 21:39:35.536055 dv-cinder-854267-3-smb devstack@keystone.service[81658]: Aug 29 21:39:35.537375 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce486a0-0de3-457f-9cb7-5e3f70d3234d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:35.590680 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 762/1547] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:39:35 2022] POST /identity/v3/users => generated 297 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:35.599298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359a9f2-aab5-41ce-810e-1b7f8aca735c admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:35.613411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 786/1548] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:39:35 2022] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:35.618686 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce486a0-0de3-457f-9cb7-5e3f70d3234d admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:35.637207 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359a9f2-aab5-41ce-810e-1b7f8aca735c admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:35.759921 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce486a0-0de3-457f-9cb7-5e3f70d3234d admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:35.775239 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d4e08-3642-411a-b151-9581fe23073e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:35.775897 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d4e08-3642-411a-b151-9581fe23073e admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:35.776272 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d4e08-3642-411a-b151-9581fe23073e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:35.776572 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d4e08-3642-411a-b151-9581fe23073e admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:35.777408 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d4e08-3642-411a-b151-9581fe23073e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:35.779730 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d4e08-3642-411a-b151-9581fe23073e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:35.790875 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675fa84-0c5a-459a-a92f-e5b57ebcc02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:35.792334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675fa84-0c5a-459a-a92f-e5b57ebcc02b admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:35.792719 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675fa84-0c5a-459a-a92f-e5b57ebcc02b admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:35.793320 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675fa84-0c5a-459a-a92f-e5b57ebcc02b admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:35.794664 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f675fa84-0c5a-459a-a92f-e5b57ebcc02b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:35.798187 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f675fa84-0c5a-459a-a92f-e5b57ebcc02b admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:35.821460 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 787/1549] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:39:35 2022] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:35.822805 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840f2ec-7c88-426b-b587-52e07b302dd7 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:35.823133 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840f2ec-7c88-426b-b587-52e07b302dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:35.823432 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840f2ec-7c88-426b-b587-52e07b302dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:35.833512 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 763/1550] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:35.834950 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675fa84-0c5a-459a-a92f-e5b57ebcc02b admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:35.867800 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675fa84-0c5a-459a-a92f-e5b57ebcc02b admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:35.872519 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-a840f2ec-7c88-426b-b587-52e07b302dd7 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:35.873922 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a840f2ec-7c88-426b-b587-52e07b302dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:35.886155 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97f51f-672e-4a13-9bdb-d2807c8edf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:35.887629 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97f51f-672e-4a13-9bdb-d2807c8edf5f admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:35.888142 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97f51f-672e-4a13-9bdb-d2807c8edf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:35.888699 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97f51f-672e-4a13-9bdb-d2807c8edf5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:35.889783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97f51f-672e-4a13-9bdb-d2807c8edf5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:35.893029 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97f51f-672e-4a13-9bdb-d2807c8edf5f admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:35.906858 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 788/1551] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:35.907821 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840f2ec-7c88-426b-b587-52e07b302dd7 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:35.919859 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 764/1552] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:35.923043 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7507403-28d4-4e88-98fd-598aff9af796 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:35.923524 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7507403-28d4-4e88-98fd-598aff9af796 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:35.924085 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7507403-28d4-4e88-98fd-598aff9af796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:35.928912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840f2ec-7c88-426b-b587-52e07b302dd7 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:35.939293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aba29d-20f7-482a-86a9-35be3c916c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:35.939938 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aba29d-20f7-482a-86a9-35be3c916c51 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:35.940244 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aba29d-20f7-482a-86a9-35be3c916c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:35.940523 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aba29d-20f7-482a-86a9-35be3c916c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:35.941236 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aba29d-20f7-482a-86a9-35be3c916c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:35.942905 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aba29d-20f7-482a-86a9-35be3c916c51 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:35.974781 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-c7507403-28d4-4e88-98fd-598aff9af796 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:35.976636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-c7507403-28d4-4e88-98fd-598aff9af796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:35.977630 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 789/1553] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:35.979195 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39127bc-496d-4d39-ae34-8cadf938b639 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:35.979486 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39127bc-496d-4d39-ae34-8cadf938b639 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:35.979766 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39127bc-496d-4d39-ae34-8cadf938b639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.005264 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 765/1554] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:36.005949 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7507403-28d4-4e88-98fd-598aff9af796 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:36.019652 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f39127bc-496d-4d39-ae34-8cadf938b639 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:36.020858 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f39127bc-496d-4d39-ae34-8cadf938b639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:36.024803 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7507403-28d4-4e88-98fd-598aff9af796 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:36.035777 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15219c0-cfa2-4381-ae4a-2cb5f39e2a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:36.036477 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15219c0-cfa2-4381-ae4a-2cb5f39e2a32 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:36.036757 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15219c0-cfa2-4381-ae4a-2cb5f39e2a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:36.037038 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15219c0-cfa2-4381-ae4a-2cb5f39e2a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.037718 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15219c0-cfa2-4381-ae4a-2cb5f39e2a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:36.039389 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15219c0-cfa2-4381-ae4a-2cb5f39e2a32 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:36.045308 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 790/1555] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:36.046744 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39127bc-496d-4d39-ae34-8cadf938b639 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:36.066915 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 766/1556] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:36.067245 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:36.071406 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fe633-1425-477f-a545-ed3a2c0eab5a None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:36.072035 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39127bc-496d-4d39-ae34-8cadf938b639 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:36.078219 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fe633-1425-477f-a545-ed3a2c0eab5a None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:36.078610 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fe633-1425-477f-a545-ed3a2c0eab5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.092010 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b6355-4fac-4d9d-9bc3-acf9a6bc1977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:36.097913 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b6355-4fac-4d9d-9bc3-acf9a6bc1977 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:36.098577 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b6355-4fac-4d9d-9bc3-acf9a6bc1977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:36.099032 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b6355-4fac-4d9d-9bc3-acf9a6bc1977 admin admin] PATH_INFO: `/v3/projects/f2a05eeed90743e7a757a87b6ebe81e4/users/fd2d58e660a940dd8fd31903ee5a6968/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.117672 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-485fe633-1425-477f-a545-ed3a2c0eab5a None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:36.119629 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-485fe633-1425-477f-a545-ed3a2c0eab5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:36.125834 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b6355-4fac-4d9d-9bc3-acf9a6bc1977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2a05eeed90743e7a757a87b6ebe81e4, user_id=fd2d58e660a940dd8fd31903ee5a6968, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:36.127028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: WARNING py.warnings [None req-ff0b6355-4fac-4d9d-9bc3-acf9a6bc1977 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:39:36.127028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: warnings.warn(msg) Aug 29 21:39:36.127028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: Aug 29 21:39:36.130380 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b6355-4fac-4d9d-9bc3-acf9a6bc1977 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:36.131636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 767/1557] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:36.132933 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fe633-1425-477f-a545-ed3a2c0eab5a None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:36.146289 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fe633-1425-477f-a545-ed3a2c0eab5a None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:36.153691 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545180a6-9252-4094-ade9-05fd92340607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:36.154795 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545180a6-9252-4094-ade9-05fd92340607 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:36.155297 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545180a6-9252-4094-ade9-05fd92340607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:36.155746 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545180a6-9252-4094-ade9-05fd92340607 admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.156686 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545180a6-9252-4094-ade9-05fd92340607 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:39:36.157233 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545180a6-9252-4094-ade9-05fd92340607 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:36.158728 dv-cinder-854267-3-smb devstack@keystone.service[81659]: WARNING py.warnings [None req-545180a6-9252-4094-ade9-05fd92340607 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:39:36.158728 dv-cinder-854267-3-smb devstack@keystone.service[81659]: warnings.warn(msg) Aug 29 21:39:36.158728 dv-cinder-854267-3-smb devstack@keystone.service[81659]: Aug 29 21:39:36.160683 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545180a6-9252-4094-ade9-05fd92340607 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:36.163828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 791/1558] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:39:36 2022] PUT /identity/v3/projects/f2a05eeed90743e7a757a87b6ebe81e4/users/fd2d58e660a940dd8fd31903ee5a6968/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:36.164891 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b6355-4fac-4d9d-9bc3-acf9a6bc1977 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:36.172971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:36.188464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 768/1559] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:39:36.191042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df34f01-69e8-4e1b-b376-5d1931d399c6 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:36.191577 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df34f01-69e8-4e1b-b376-5d1931d399c6 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:36.192094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df34f01-69e8-4e1b-b376-5d1931d399c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.231462 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-8df34f01-69e8-4e1b-b376-5d1931d399c6 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:36.233424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-8df34f01-69e8-4e1b-b376-5d1931d399c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:36.277763 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b6355-4fac-4d9d-9bc3-acf9a6bc1977 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:36.283510 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea091594-1f78-42be-bfa8-4c95e7878f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:36.285040 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea091594-1f78-42be-bfa8-4c95e7878f98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:36.285434 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea091594-1f78-42be-bfa8-4c95e7878f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:36.286487 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea091594-1f78-42be-bfa8-4c95e7878f98 admin admin] PATH_INFO: `/v3/projects/fe968d2a35a94c5f94d0b00097a17b01/users/07cf908926af48e8b7d96f96d026254a/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.310511 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea091594-1f78-42be-bfa8-4c95e7878f98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe968d2a35a94c5f94d0b00097a17b01, user_id=07cf908926af48e8b7d96f96d026254a, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:36.315836 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea091594-1f78-42be-bfa8-4c95e7878f98 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:36.318044 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 769/1560] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:36.320282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8909c-c508-444e-b103-09b32388ec73 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:36.320746 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8909c-c508-444e-b103-09b32388ec73 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:36.321197 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8909c-c508-444e-b103-09b32388ec73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.339910 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 792/1561] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:39:36 2022] PUT /identity/v3/projects/fe968d2a35a94c5f94d0b00097a17b01/users/07cf908926af48e8b7d96f96d026254a/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:36.343725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea091594-1f78-42be-bfa8-4c95e7878f98 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:36.351489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-81a8909c-c508-444e-b103-09b32388ec73 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:36.353142 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-81a8909c-c508-444e-b103-09b32388ec73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:36.447373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 770/1562] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:36.448131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea091594-1f78-42be-bfa8-4c95e7878f98 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:36.449384 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6ba55-e5a1-4cf2-94e2-279d9dd6eb79 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:36.449845 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6ba55-e5a1-4cf2-94e2-279d9dd6eb79 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:36.450501 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6ba55-e5a1-4cf2-94e2-279d9dd6eb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.454772 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7e52f-975f-44b8-a48a-89c635153a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:36.455418 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7e52f-975f-44b8-a48a-89c635153a85 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:36.455787 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7e52f-975f-44b8-a48a-89c635153a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:36.457314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7e52f-975f-44b8-a48a-89c635153a85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.457532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7e52f-975f-44b8-a48a-89c635153a85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:39:36.457706 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7e52f-975f-44b8-a48a-89c635153a85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:36.459460 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7e52f-975f-44b8-a48a-89c635153a85 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:36.478607 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 793/1563] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:39:36.478607 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b75cb2-bd7e-4f60-a2f7-31ebaefbc71c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:36.478607 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b75cb2-bd7e-4f60-a2f7-31ebaefbc71c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:36.478607 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b75cb2-bd7e-4f60-a2f7-31ebaefbc71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.480993 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-ace6ba55-e5a1-4cf2-94e2-279d9dd6eb79 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:36.482248 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-ace6ba55-e5a1-4cf2-94e2-279d9dd6eb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:36.492780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 771/1564] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:36.496451 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6ba55-e5a1-4cf2-94e2-279d9dd6eb79 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:36.501254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-28b75cb2-bd7e-4f60-a2f7-31ebaefbc71c None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:36.502956 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-28b75cb2-bd7e-4f60-a2f7-31ebaefbc71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:36.505080 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6ba55-e5a1-4cf2-94e2-279d9dd6eb79 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:36.510049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fac63-abe5-439b-adda-c65bd34427d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:36.510684 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fac63-abe5-439b-adda-c65bd34427d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:36.510990 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fac63-abe5-439b-adda-c65bd34427d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:36.511246 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fac63-abe5-439b-adda-c65bd34427d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.511892 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fac63-abe5-439b-adda-c65bd34427d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:36.512069 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 794/1565] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:36.513312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefaa770-c0fd-4878-bb5d-4f053101adf1 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:36.513628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefaa770-c0fd-4878-bb5d-4f053101adf1 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:36.513933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefaa770-c0fd-4878-bb5d-4f053101adf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.514110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fac63-abe5-439b-adda-c65bd34427d1 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:36.546201 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-fefaa770-c0fd-4878-bb5d-4f053101adf1 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:36.548166 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fefaa770-c0fd-4878-bb5d-4f053101adf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:36.550973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 772/1566] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:39:36 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:36.552543 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b7765-49ba-436f-9aa0-81b036ac1de9 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:36.553021 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b7765-49ba-436f-9aa0-81b036ac1de9 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:36.553315 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b7765-49ba-436f-9aa0-81b036ac1de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.578860 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-590b7765-49ba-436f-9aa0-81b036ac1de9 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:36.580128 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-590b7765-49ba-436f-9aa0-81b036ac1de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:36.613098 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:36.634152 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 795/1567] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:36.635940 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66b2f8-6728-4694-949a-7e8376721238 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:36.636406 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66b2f8-6728-4694-949a-7e8376721238 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:36.636775 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66b2f8-6728-4694-949a-7e8376721238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.661486 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-bf66b2f8-6728-4694-949a-7e8376721238 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:36.662736 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-bf66b2f8-6728-4694-949a-7e8376721238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:36.669004 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 773/1568] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:36.670528 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea9edf-df54-440c-a75d-ac793c4df18e None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:36.670910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea9edf-df54-440c-a75d-ac793c4df18e None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:36.671280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea9edf-df54-440c-a75d-ac793c4df18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.671479 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 796/1569] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:36.676985 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66b2f8-6728-4694-949a-7e8376721238 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:36.683202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66b2f8-6728-4694-949a-7e8376721238 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:36.688765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1501590-cc17-466b-a90b-d71edd68348d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:36.689554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1501590-cc17-466b-a90b-d71edd68348d admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:36.689961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1501590-cc17-466b-a90b-d71edd68348d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:36.690342 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1501590-cc17-466b-a90b-d71edd68348d admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.691678 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1501590-cc17-466b-a90b-d71edd68348d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:36.693759 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1501590-cc17-466b-a90b-d71edd68348d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:36.697540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-19ea9edf-df54-440c-a75d-ac793c4df18e None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:36.699300 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-19ea9edf-df54-440c-a75d-ac793c4df18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:36.710317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 774/1570] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:36.712804 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be05fc4-3d17-481e-beee-f3abaa136083 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:36.713395 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be05fc4-3d17-481e-beee-f3abaa136083 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:36.714833 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be05fc4-3d17-481e-beee-f3abaa136083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.729536 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 797/1571] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:39:36 2022] POST /identity/v3/projects => generated 399 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:36.730413 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1501590-cc17-466b-a90b-d71edd68348d admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:36.731898 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:36.735775 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f1501590-cc17-466b-a90b-d71edd68348d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:36.739362 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-4be05fc4-3d17-481e-beee-f3abaa136083 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:36.741699 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-4be05fc4-3d17-481e-beee-f3abaa136083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:36.807504 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1501590-cc17-466b-a90b-d71edd68348d admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:36.810684 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 775/1572] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:36.811704 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be05fc4-3d17-481e-beee-f3abaa136083 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:36.811887 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e01ec1-cc9c-442a-8105-c22aceeb0508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:36.812484 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e01ec1-cc9c-442a-8105-c22aceeb0508 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:36.812798 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e01ec1-cc9c-442a-8105-c22aceeb0508 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:36.813068 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e01ec1-cc9c-442a-8105-c22aceeb0508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.822786 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be05fc4-3d17-481e-beee-f3abaa136083 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:36.824657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e01ec1-cc9c-442a-8105-c22aceeb0508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:36.826127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e01ec1-cc9c-442a-8105-c22aceeb0508 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:36.828445 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6d75d-ac75-4e74-89a7-f9511ed7b91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:36.829310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6d75d-ac75-4e74-89a7-f9511ed7b91f admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:36.829776 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6d75d-ac75-4e74-89a7-f9511ed7b91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:36.830312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6d75d-ac75-4e74-89a7-f9511ed7b91f admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.830997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6d75d-ac75-4e74-89a7-f9511ed7b91f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:36.833891 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6d75d-ac75-4e74-89a7-f9511ed7b91f admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:36.841636 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 798/1573] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:36.845610 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441e82b-6570-4f7a-9a3d-4d919a24eea0 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:36.846287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441e82b-6570-4f7a-9a3d-4d919a24eea0 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:36.846804 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441e82b-6570-4f7a-9a3d-4d919a24eea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.864393 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 776/1574] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:39:36 2022] POST /identity/v3/users => generated 293 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:36.864393 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6d75d-ac75-4e74-89a7-f9511ed7b91f admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:36.876483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6d75d-ac75-4e74-89a7-f9511ed7b91f admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:36.882649 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b2a59-377c-4938-9e34-79bbc77da01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:36.883284 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b2a59-377c-4938-9e34-79bbc77da01f admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:36.883567 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b2a59-377c-4938-9e34-79bbc77da01f admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:36.883837 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b2a59-377c-4938-9e34-79bbc77da01f admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.884540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b2a59-377c-4938-9e34-79bbc77da01f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:39:36.884949 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b2a59-377c-4938-9e34-79bbc77da01f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:36.886857 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b2a59-377c-4938-9e34-79bbc77da01f admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:36.887562 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d441e82b-6570-4f7a-9a3d-4d919a24eea0 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:36.889994 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d441e82b-6570-4f7a-9a3d-4d919a24eea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:36.913516 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 777/1575] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:39:36.913798 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 799/1576] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:36.913798 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441e82b-6570-4f7a-9a3d-4d919a24eea0 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:36.914015 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b2a59-377c-4938-9e34-79bbc77da01f admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:36.925876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441e82b-6570-4f7a-9a3d-4d919a24eea0 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:36.927469 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b2a59-377c-4938-9e34-79bbc77da01f admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:36.932163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2d558-0f25-479f-8d30-fcaee3761f56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:36.933528 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2d558-0f25-479f-8d30-fcaee3761f56 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:36.933999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2d558-0f25-479f-8d30-fcaee3761f56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:36.934365 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2d558-0f25-479f-8d30-fcaee3761f56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.934500 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26453c5d-15d5-4918-a099-f1ccd54ae1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:36.935578 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26453c5d-15d5-4918-a099-f1ccd54ae1de admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:36.936155 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26453c5d-15d5-4918-a099-f1ccd54ae1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:36.936603 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26453c5d-15d5-4918-a099-f1ccd54ae1de admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.937828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26453c5d-15d5-4918-a099-f1ccd54ae1de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:39:36.938382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26453c5d-15d5-4918-a099-f1ccd54ae1de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:36.942095 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26453c5d-15d5-4918-a099-f1ccd54ae1de admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:36.947673 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2d558-0f25-479f-8d30-fcaee3761f56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:36.949599 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2d558-0f25-479f-8d30-fcaee3761f56 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:36.963701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 778/1577] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:36.966094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2d558-0f25-479f-8d30-fcaee3761f56 service neutron] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:36.974557 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 800/1578] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:39:36.974557 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26453c5d-15d5-4918-a099-f1ccd54ae1de admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:36.985048 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2d558-0f25-479f-8d30-fcaee3761f56 service neutron] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:36.992566 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d9fcc-e573-47bd-a89d-df640e5b84b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:36.993200 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d9fcc-e573-47bd-a89d-df640e5b84b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:36.993807 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d9fcc-e573-47bd-a89d-df640e5b84b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:36.994278 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26453c5d-15d5-4918-a099-f1ccd54ae1de admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:36.994599 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d9fcc-e573-47bd-a89d-df640e5b84b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:36.999062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d9fcc-e573-47bd-a89d-df640e5b84b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:36.999062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d9fcc-e573-47bd-a89d-df640e5b84b4 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:37.000165 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce197132-411d-43a8-ae82-a07b29e5b139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:37.000908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce197132-411d-43a8-ae82-a07b29e5b139 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:37.001298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce197132-411d-43a8-ae82-a07b29e5b139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:37.001459 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce197132-411d-43a8-ae82-a07b29e5b139 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:37.002259 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce197132-411d-43a8-ae82-a07b29e5b139 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:39:37.002631 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce197132-411d-43a8-ae82-a07b29e5b139 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:37.005177 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce197132-411d-43a8-ae82-a07b29e5b139 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:37.025197 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 801/1579] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:39:37.026102 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce197132-411d-43a8-ae82-a07b29e5b139 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:37.041927 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce197132-411d-43a8-ae82-a07b29e5b139 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:37.048976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d0064-0222-444c-a18e-c47faf6f1e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:37.049628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d0064-0222-444c-a18e-c47faf6f1e8e admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:37.049910 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d0064-0222-444c-a18e-c47faf6f1e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:37.050733 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d0064-0222-444c-a18e-c47faf6f1e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:37.051632 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d0064-0222-444c-a18e-c47faf6f1e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:37.052468 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 779/1580] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:39:36 2022] POST /identity/v3/users => generated 300 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:37.053165 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d0064-0222-444c-a18e-c47faf6f1e8e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:37.054460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d9fcc-e573-47bd-a89d-df640e5b84b4 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:37.066782 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 802/1581] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:37.067780 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d0064-0222-444c-a18e-c47faf6f1e8e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:37.069114 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d9fcc-e573-47bd-a89d-df640e5b84b4 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:37.075128 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93e59e-b34f-49fa-b24c-94c119d49bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:37.075857 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93e59e-b34f-49fa-b24c-94c119d49bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:37.076271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93e59e-b34f-49fa-b24c-94c119d49bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:37.076658 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93e59e-b34f-49fa-b24c-94c119d49bc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:37.077374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd93e59e-b34f-49fa-b24c-94c119d49bc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:37.079481 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd93e59e-b34f-49fa-b24c-94c119d49bc6 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:37.082339 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d0064-0222-444c-a18e-c47faf6f1e8e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:37.089388 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba288eab-443b-49c2-a226-fedd7043b8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:37.090150 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba288eab-443b-49c2-a226-fedd7043b8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:37.090542 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba288eab-443b-49c2-a226-fedd7043b8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:37.091033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba288eab-443b-49c2-a226-fedd7043b8f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:37.091819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba288eab-443b-49c2-a226-fedd7043b8f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:39:37.092274 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba288eab-443b-49c2-a226-fedd7043b8f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:37.094047 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba288eab-443b-49c2-a226-fedd7043b8f8 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:37.108298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 803/1582] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:39:37.109483 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba288eab-443b-49c2-a226-fedd7043b8f8 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:37.124835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba288eab-443b-49c2-a226-fedd7043b8f8 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:37.132099 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 780/1583] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:39:37 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:37.132099 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93e59e-b34f-49fa-b24c-94c119d49bc6 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:37.215273 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93e59e-b34f-49fa-b24c-94c119d49bc6 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:37.221238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081ada1-9644-4520-8d8c-2f1e42caa4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:37.222659 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081ada1-9644-4520-8d8c-2f1e42caa4c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:37.223073 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081ada1-9644-4520-8d8c-2f1e42caa4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:37.223448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081ada1-9644-4520-8d8c-2f1e42caa4c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:37.224320 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081ada1-9644-4520-8d8c-2f1e42caa4c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:37.226863 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081ada1-9644-4520-8d8c-2f1e42caa4c5 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:37.275705 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 781/1584] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:39:37 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:37.277052 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081ada1-9644-4520-8d8c-2f1e42caa4c5 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:37.278433 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a67a8-8fe8-425a-882f-716d5f676914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:37.281247 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a67a8-8fe8-425a-882f-716d5f676914 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:37.282048 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a67a8-8fe8-425a-882f-716d5f676914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:37.282941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a67a8-8fe8-425a-882f-716d5f676914 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:37.285032 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a67a8-8fe8-425a-882f-716d5f676914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:37.289650 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a67a8-8fe8-425a-882f-716d5f676914 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:37.292715 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:37.326384 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:37.360226 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 804/1585] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:39:37 2022] POST /identity/v3/projects => generated 377 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:37.360593 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a67a8-8fe8-425a-882f-716d5f676914 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:37.383414 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081ada1-9644-4520-8d8c-2f1e42caa4c5 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:37.535543 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9e1d5-23af-4f20-b7c3-514f4643befd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:37.536455 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9e1d5-23af-4f20-b7c3-514f4643befd admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:37.536924 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9e1d5-23af-4f20-b7c3-514f4643befd admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:37.537229 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9e1d5-23af-4f20-b7c3-514f4643befd admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:37.538015 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9e1d5-23af-4f20-b7c3-514f4643befd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:37.546164 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9e1d5-23af-4f20-b7c3-514f4643befd admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:37.555004 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a67a8-8fe8-425a-882f-716d5f676914 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:37.562588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 782/1586] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:37.563712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9e1d5-23af-4f20-b7c3-514f4643befd admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:37.572889 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef56c1d-979e-45fd-8bf3-9e83b46cae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:37.574224 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef56c1d-979e-45fd-8bf3-9e83b46cae44 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:37.574953 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef56c1d-979e-45fd-8bf3-9e83b46cae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:37.575486 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef56c1d-979e-45fd-8bf3-9e83b46cae44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:37.577103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef56c1d-979e-45fd-8bf3-9e83b46cae44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:37.582218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef56c1d-979e-45fd-8bf3-9e83b46cae44 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:37.583405 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9e1d5-23af-4f20-b7c3-514f4643befd admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:37.591238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628770ed-01b5-4e29-a865-d98ef8b54fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:37.592275 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628770ed-01b5-4e29-a865-d98ef8b54fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:37.593070 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628770ed-01b5-4e29-a865-d98ef8b54fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:37.593532 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628770ed-01b5-4e29-a865-d98ef8b54fc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:37.594375 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628770ed-01b5-4e29-a865-d98ef8b54fc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:37.599625 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628770ed-01b5-4e29-a865-d98ef8b54fc3 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:37.622408 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 805/1587] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:37.627136 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef56c1d-979e-45fd-8bf3-9e83b46cae44 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:37.671347 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef56c1d-979e-45fd-8bf3-9e83b46cae44 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:37.682119 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 783/1588] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:39:37 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:37.683440 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628770ed-01b5-4e29-a865-d98ef8b54fc3 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:37.856553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628770ed-01b5-4e29-a865-d98ef8b54fc3 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:37.863214 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48756d2-9d5c-48c5-8e4a-35d60e576ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:37.864334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48756d2-9d5c-48c5-8e4a-35d60e576ddd admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:37.864746 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48756d2-9d5c-48c5-8e4a-35d60e576ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:37.865229 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48756d2-9d5c-48c5-8e4a-35d60e576ddd admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:37.866659 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48756d2-9d5c-48c5-8e4a-35d60e576ddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:37.870625 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48756d2-9d5c-48c5-8e4a-35d60e576ddd admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:37.881958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb221f2-2a69-4cd7-95d1-c9233c4398a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:37.883196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb221f2-2a69-4cd7-95d1-c9233c4398a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:37.883493 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb221f2-2a69-4cd7-95d1-c9233c4398a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:37.883988 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb221f2-2a69-4cd7-95d1-c9233c4398a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:37.885521 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb221f2-2a69-4cd7-95d1-c9233c4398a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:37.890783 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb221f2-2a69-4cd7-95d1-c9233c4398a3 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:37.919070 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 784/1589] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:39:37 2022] POST /identity/v3/users => generated 283 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:37.930079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48756d2-9d5c-48c5-8e4a-35d60e576ddd admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:37.964584 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48756d2-9d5c-48c5-8e4a-35d60e576ddd admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:37.969717 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 806/1590] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:39:37 2022] POST /identity/v3/users => generated 287 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:37.977928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb221f2-2a69-4cd7-95d1-c9233c4398a3 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:37.981146 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f7b26-de8b-461b-8a6e-d1cf907af334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:37.987180 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f7b26-de8b-461b-8a6e-d1cf907af334 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:37.987515 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f7b26-de8b-461b-8a6e-d1cf907af334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:37.988051 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f7b26-de8b-461b-8a6e-d1cf907af334 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:37.990212 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f7b26-de8b-461b-8a6e-d1cf907af334 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:37.992393 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f7b26-de8b-461b-8a6e-d1cf907af334 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:38.022328 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb221f2-2a69-4cd7-95d1-c9233c4398a3 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:38.032965 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fcc92-40d5-4f49-9546-ed9acf8647ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:38.034036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fcc92-40d5-4f49-9546-ed9acf8647ad admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:38.034585 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fcc92-40d5-4f49-9546-ed9acf8647ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:38.035066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fcc92-40d5-4f49-9546-ed9acf8647ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:38.037295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fcc92-40d5-4f49-9546-ed9acf8647ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:38.040282 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fcc92-40d5-4f49-9546-ed9acf8647ad admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:38.053434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 785/1591] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:39:37 2022] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:38.055114 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f7b26-de8b-461b-8a6e-d1cf907af334 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:38.063011 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 807/1592] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:38.072108 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fcc92-40d5-4f49-9546-ed9acf8647ad admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:38.074057 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:38.095115 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f7b26-de8b-461b-8a6e-d1cf907af334 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:38.095786 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fcc92-40d5-4f49-9546-ed9acf8647ad admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:38.113161 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b604b4-4955-4600-85ec-49cc06b91967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:38.115299 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b604b4-4955-4600-85ec-49cc06b91967 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:38.116231 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b604b4-4955-4600-85ec-49cc06b91967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:38.117743 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b604b4-4955-4600-85ec-49cc06b91967 admin admin] PATH_INFO: `/v3/projects/d9860da48b4a47a2a2d6e88262fba995/users/ffcfd3bfdb8f40eabe52e61339610589/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:38.118262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08ef62-8ff4-47fa-b655-c734a91c603b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:38.119401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08ef62-8ff4-47fa-b655-c734a91c603b admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:38.119894 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08ef62-8ff4-47fa-b655-c734a91c603b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:38.120642 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08ef62-8ff4-47fa-b655-c734a91c603b admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:38.121572 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08ef62-8ff4-47fa-b655-c734a91c603b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:38.125574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08ef62-8ff4-47fa-b655-c734a91c603b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:38.178681 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b604b4-4955-4600-85ec-49cc06b91967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9860da48b4a47a2a2d6e88262fba995, user_id=ffcfd3bfdb8f40eabe52e61339610589, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:38.184837 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b604b4-4955-4600-85ec-49cc06b91967 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:38.195735 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 808/1593] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:39:38 2022] POST /identity/v3/users => generated 284 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:38.198581 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08ef62-8ff4-47fa-b655-c734a91c603b admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:38.242526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 786/1594] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:39:38 2022] PUT /identity/v3/projects/d9860da48b4a47a2a2d6e88262fba995/users/ffcfd3bfdb8f40eabe52e61339610589/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:38.244495 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b604b4-4955-4600-85ec-49cc06b91967 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:38.251392 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08ef62-8ff4-47fa-b655-c734a91c603b admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:38.417457 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b604b4-4955-4600-85ec-49cc06b91967 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:38.426090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455ce2a-e28a-4e2c-bf27-e9fac8e23535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:38.427403 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455ce2a-e28a-4e2c-bf27-e9fac8e23535 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:38.427963 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455ce2a-e28a-4e2c-bf27-e9fac8e23535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:38.428539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455ce2a-e28a-4e2c-bf27-e9fac8e23535 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:38.429884 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455ce2a-e28a-4e2c-bf27-e9fac8e23535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:38.432761 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455ce2a-e28a-4e2c-bf27-e9fac8e23535 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:38.447721 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 787/1595] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:38.449689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455ce2a-e28a-4e2c-bf27-e9fac8e23535 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:38.467623 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455ce2a-e28a-4e2c-bf27-e9fac8e23535 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:38.479973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a294e7f-2b26-4aa2-b195-ddca211194d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:38.481581 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a294e7f-2b26-4aa2-b195-ddca211194d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:38.482584 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a294e7f-2b26-4aa2-b195-ddca211194d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:38.483337 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a294e7f-2b26-4aa2-b195-ddca211194d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:38.484597 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a294e7f-2b26-4aa2-b195-ddca211194d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:38.486747 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a294e7f-2b26-4aa2-b195-ddca211194d2 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:38.495575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:38.517278 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 788/1596] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:38.517278 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a294e7f-2b26-4aa2-b195-ddca211194d2 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:38.528844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bafab4-5fd6-4c6b-a57a-3c802d309d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:38.530672 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bafab4-5fd6-4c6b-a57a-3c802d309d28 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:38.531559 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bafab4-5fd6-4c6b-a57a-3c802d309d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:38.532312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bafab4-5fd6-4c6b-a57a-3c802d309d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:38.533789 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bafab4-5fd6-4c6b-a57a-3c802d309d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:38.537283 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bafab4-5fd6-4c6b-a57a-3c802d309d28 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:38.556462 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a294e7f-2b26-4aa2-b195-ddca211194d2 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:38.566626 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 809/1597] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:38.568758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bafab4-5fd6-4c6b-a57a-3c802d309d28 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:38.576396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d76d1-f04a-4fc3-95f6-1d8d618e7e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:38.577470 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d76d1-f04a-4fc3-95f6-1d8d618e7e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:38.578111 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d76d1-f04a-4fc3-95f6-1d8d618e7e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:38.578750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d76d1-f04a-4fc3-95f6-1d8d618e7e26 admin admin] PATH_INFO: `/v3/projects/f2c8e8c1fe744e569533ef83311e5e53/users/cb31d2cb242b46c5b917ca5721575d90/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:38.590243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bafab4-5fd6-4c6b-a57a-3c802d309d28 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:38.599663 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2064e-a661-4b29-aa61-7da3a2a98928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:38.601838 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2064e-a661-4b29-aa61-7da3a2a98928 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:38.602845 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2064e-a661-4b29-aa61-7da3a2a98928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:38.603603 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2064e-a661-4b29-aa61-7da3a2a98928 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:38.605260 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2064e-a661-4b29-aa61-7da3a2a98928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:38.610446 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2064e-a661-4b29-aa61-7da3a2a98928 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:38.637743 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d76d1-f04a-4fc3-95f6-1d8d618e7e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2c8e8c1fe744e569533ef83311e5e53, user_id=cb31d2cb242b46c5b917ca5721575d90, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:38.639133 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 810/1598] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:38.644595 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d76d1-f04a-4fc3-95f6-1d8d618e7e26 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:38.647829 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ae1e3-09ea-42d2-b463-efa4933ca540 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:38.648516 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ae1e3-09ea-42d2-b463-efa4933ca540 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:38.649012 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ae1e3-09ea-42d2-b463-efa4933ca540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:38.681728 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 789/1599] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:39:38 2022] PUT /identity/v3/projects/f2c8e8c1fe744e569533ef83311e5e53/users/cb31d2cb242b46c5b917ca5721575d90/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:38.686993 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d76d1-f04a-4fc3-95f6-1d8d618e7e26 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:38.716022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-938ae1e3-09ea-42d2-b463-efa4933ca540 None None] MFA Rules not processed for user `ffcfd3bfdb8f40eabe52e61339610589`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:38.719810 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-938ae1e3-09ea-42d2-b463-efa4933ca540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:38.838083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d76d1-f04a-4fc3-95f6-1d8d618e7e26 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:38.843588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfd0dc-3bef-4c9c-8890-f64ea077d69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:38.844656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfd0dc-3bef-4c9c-8890-f64ea077d69b admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:38.845285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfd0dc-3bef-4c9c-8890-f64ea077d69b admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:38.845780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfd0dc-3bef-4c9c-8890-f64ea077d69b admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:38.846663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfd0dc-3bef-4c9c-8890-f64ea077d69b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:38.849609 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfd0dc-3bef-4c9c-8890-f64ea077d69b admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:38.865699 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 790/1600] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:38.866963 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfd0dc-3bef-4c9c-8890-f64ea077d69b admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:38.906720 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfd0dc-3bef-4c9c-8890-f64ea077d69b admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:38.915689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736811e9-6c33-4334-bf4d-388d765c7b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:38.916866 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736811e9-6c33-4334-bf4d-388d765c7b75 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:38.917395 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736811e9-6c33-4334-bf4d-388d765c7b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:38.917876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736811e9-6c33-4334-bf4d-388d765c7b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:38.924291 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 811/1601] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:38.924291 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ae1e3-09ea-42d2-b463-efa4933ca540 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:38.929047 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736811e9-6c33-4334-bf4d-388d765c7b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:38.931280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736811e9-6c33-4334-bf4d-388d765c7b75 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:38.947920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 791/1602] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:38.949294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736811e9-6c33-4334-bf4d-388d765c7b75 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:38.968013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736811e9-6c33-4334-bf4d-388d765c7b75 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:38.976093 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c7516-5f07-4f61-aba5-950cdf2590d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:38.976992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c7516-5f07-4f61-aba5-950cdf2590d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:38.977567 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c7516-5f07-4f61-aba5-950cdf2590d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:38.978563 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c7516-5f07-4f61-aba5-950cdf2590d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:38.980518 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c7516-5f07-4f61-aba5-950cdf2590d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:38.983819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c7516-5f07-4f61-aba5-950cdf2590d6 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:38.985100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ae1e3-09ea-42d2-b463-efa4933ca540 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:39.008020 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 792/1603] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:39.010483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147fd00-1e61-43b4-8d2b-b74db3608ed0 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:39.010918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147fd00-1e61-43b4-8d2b-b74db3608ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:39.011289 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147fd00-1e61-43b4-8d2b-b74db3608ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:39.014068 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9f027-edbe-42d1-85a1-20727b8cc260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:39.015096 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9f027-edbe-42d1-85a1-20727b8cc260 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:39.015594 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9f027-edbe-42d1-85a1-20727b8cc260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:39.015960 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9f027-edbe-42d1-85a1-20727b8cc260 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:39.016785 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea9f027-edbe-42d1-85a1-20727b8cc260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:39.018623 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea9f027-edbe-42d1-85a1-20727b8cc260 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:39.047308 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 812/1604] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:39.048158 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9f027-edbe-42d1-85a1-20727b8cc260 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:39.053371 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:39.058458 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-0147fd00-1e61-43b4-8d2b-b74db3608ed0 None None] MFA Rules not processed for user `cb31d2cb242b46c5b917ca5721575d90`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:39.063642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-0147fd00-1e61-43b4-8d2b-b74db3608ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:39.072680 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9f027-edbe-42d1-85a1-20727b8cc260 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:39.092420 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbb960-496e-46e9-85ac-05681730cdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:39.093124 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbb960-496e-46e9-85ac-05681730cdad admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:39.093411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbb960-496e-46e9-85ac-05681730cdad admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:39.093691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbb960-496e-46e9-85ac-05681730cdad admin admin] PATH_INFO: `/v3/projects/af8d745adeaf4d339d5f4834ec2d5c84/users/e23502d32dcb42c6a34c6ceb8e566af8/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:39.146720 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbb960-496e-46e9-85ac-05681730cdad admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8d745adeaf4d339d5f4834ec2d5c84, user_id=e23502d32dcb42c6a34c6ceb8e566af8, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:39.153051 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbb960-496e-46e9-85ac-05681730cdad admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:39.191894 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 793/1605] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:39 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:39.191894 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147fd00-1e61-43b4-8d2b-b74db3608ed0 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:39.199953 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 813/1606] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:39:39 2022] PUT /identity/v3/projects/af8d745adeaf4d339d5f4834ec2d5c84/users/e23502d32dcb42c6a34c6ceb8e566af8/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:39.202224 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147fd00-1e61-43b4-8d2b-b74db3608ed0 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:39.212642 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f23be1-6a1e-49a8-bc45-bfb26b9d1686 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:39.213152 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f23be1-6a1e-49a8-bc45-bfb26b9d1686 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:39.213656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f23be1-6a1e-49a8-bc45-bfb26b9d1686 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:39.216828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 814/1607] 10.222.0.69 () {54 vars in 962 bytes} [Mon Aug 29 21:39:39 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:39:39.218407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f23be1-6a1e-49a8-bc45-bfb26b9d1686 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:39.358642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a8976-8569-4500-8190-0b3256bf34d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:39.362254 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a8976-8569-4500-8190-0b3256bf34d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:39.363721 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a8976-8569-4500-8190-0b3256bf34d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:39.364261 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a8976-8569-4500-8190-0b3256bf34d7 admin admin] PATH_INFO: `/v3/projects/39069d6483c340759f651cfd94cdf8f0/users/879820719cb244f28f29b76947334112/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:39.395523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a8976-8569-4500-8190-0b3256bf34d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39069d6483c340759f651cfd94cdf8f0, user_id=879820719cb244f28f29b76947334112, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:39.398460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a8976-8569-4500-8190-0b3256bf34d7 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:39.417627 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 794/1608] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:39:39 2022] PUT /identity/v3/projects/39069d6483c340759f651cfd94cdf8f0/users/879820719cb244f28f29b76947334112/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:39.418827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a8976-8569-4500-8190-0b3256bf34d7 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:39.541209 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a8976-8569-4500-8190-0b3256bf34d7 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:39.543817 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f23be1-6a1e-49a8-bc45-bfb26b9d1686 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:39.548761 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23892a9-83c2-4dc1-89e9-de88035262be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:39.549689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23892a9-83c2-4dc1-89e9-de88035262be admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:39.551079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23892a9-83c2-4dc1-89e9-de88035262be admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:39.551507 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23892a9-83c2-4dc1-89e9-de88035262be admin admin] PATH_INFO: `/v3/projects/4a0579b784d14dad997a6c84e5cbaf3f/users/0ab91332bf544c9ebe1f6ca690b8489f/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:39.565581 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47694c04-42bf-41a3-bad9-d5e2a6ffe378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:39.569617 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47694c04-42bf-41a3-bad9-d5e2a6ffe378 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:39.572409 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47694c04-42bf-41a3-bad9-d5e2a6ffe378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:39.572974 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47694c04-42bf-41a3-bad9-d5e2a6ffe378 admin admin] PATH_INFO: `/v3/projects/2114b1ae62b1447fb87a04fdd39cbbc1/users/aad4dc4aa97d4f11981669a022d72b9c/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:39.577936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23892a9-83c2-4dc1-89e9-de88035262be admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a0579b784d14dad997a6c84e5cbaf3f, user_id=0ab91332bf544c9ebe1f6ca690b8489f, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:39.581106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23892a9-83c2-4dc1-89e9-de88035262be admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:39.617433 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47694c04-42bf-41a3-bad9-d5e2a6ffe378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2114b1ae62b1447fb87a04fdd39cbbc1, user_id=aad4dc4aa97d4f11981669a022d72b9c, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:39.624454 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47694c04-42bf-41a3-bad9-d5e2a6ffe378 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:39.629122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 795/1609] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:39:39 2022] PUT /identity/v3/projects/4a0579b784d14dad997a6c84e5cbaf3f/users/0ab91332bf544c9ebe1f6ca690b8489f/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:39.630259 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23892a9-83c2-4dc1-89e9-de88035262be admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:39.676291 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 815/1610] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:39:39 2022] PUT /identity/v3/projects/2114b1ae62b1447fb87a04fdd39cbbc1/users/aad4dc4aa97d4f11981669a022d72b9c/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:39.678307 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b7a5e-3e4b-42e1-ba80-51447fd22698 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:39.678804 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b7a5e-3e4b-42e1-ba80-51447fd22698 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:39.679291 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b7a5e-3e4b-42e1-ba80-51447fd22698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:39.679749 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:39.747583 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:39.756022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ac0b7a5e-3e4b-42e1-ba80-51447fd22698 None None] MFA Rules not processed for user `e23502d32dcb42c6a34c6ceb8e566af8`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:39.759896 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ac0b7a5e-3e4b-42e1-ba80-51447fd22698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:39.805499 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23892a9-83c2-4dc1-89e9-de88035262be admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:39.942272 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af4bf5-622b-40a3-baef-52d7ed64b6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:39.943357 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af4bf5-622b-40a3-baef-52d7ed64b6ae admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:39.943803 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af4bf5-622b-40a3-baef-52d7ed64b6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:39.944279 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af4bf5-622b-40a3-baef-52d7ed64b6ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:39.946140 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af4bf5-622b-40a3-baef-52d7ed64b6ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:39.952172 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af4bf5-622b-40a3-baef-52d7ed64b6ae admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:39.972681 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 816/1611] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:39.982452 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6927c36-4168-479a-b176-2429b2f7d76a None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:39.983479 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6927c36-4168-479a-b176-2429b2f7d76a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:39.983931 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6927c36-4168-479a-b176-2429b2f7d76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:40.044100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 796/1612] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:39:39 2022] POST /identity/v3/projects => generated 399 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:40.047131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667cff7-1ef6-4965-82cf-38c8ff9c9d1a None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:40.047455 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667cff7-1ef6-4965-82cf-38c8ff9c9d1a None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:40.047895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667cff7-1ef6-4965-82cf-38c8ff9c9d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:40.061801 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-c6927c36-4168-479a-b176-2429b2f7d76a None None] MFA Rules not processed for user `96c35c544cae4ad187f1a1be723e0d21`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:40.064585 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c6927c36-4168-479a-b176-2429b2f7d76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:40.084967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-6667cff7-1ef6-4965-82cf-38c8ff9c9d1a None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:40.087612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-6667cff7-1ef6-4965-82cf-38c8ff9c9d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:40.211519 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 817/1613] 10.222.0.69 () {58 vars in 1059 bytes} [Mon Aug 29 21:39:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:40.213860 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99ac95-d92b-4b0e-9040-b2349be67379 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:40.214347 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99ac95-d92b-4b0e-9040-b2349be67379 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:40.214840 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99ac95-d92b-4b0e-9040-b2349be67379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:40.219330 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 797/1614] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:40.221040 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7645583-ce07-4270-94c7-136b059da4f4 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:40.221360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7645583-ce07-4270-94c7-136b059da4f4 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:40.222033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7645583-ce07-4270-94c7-136b059da4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:40.272903 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-a7645583-ce07-4270-94c7-136b059da4f4 None None] MFA Rules not processed for user `aad4dc4aa97d4f11981669a022d72b9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:40.274334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a7645583-ce07-4270-94c7-136b059da4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:40.290262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-6b99ac95-d92b-4b0e-9040-b2349be67379 None None] MFA Rules not processed for user `0ab91332bf544c9ebe1f6ca690b8489f`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:40.294441 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-6b99ac95-d92b-4b0e-9040-b2349be67379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:40.382379 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:40.461933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 818/1615] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:40.464234 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5fde5-e96c-40da-9c2a-407b4a7c9239 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:40.464794 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5fde5-e96c-40da-9c2a-407b4a7c9239 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:40.465503 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5fde5-e96c-40da-9c2a-407b4a7c9239 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:40.468619 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 819/1616] 10.222.0.69 () {54 vars in 962 bytes} [Mon Aug 29 21:39:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:39:40.470090 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5fde5-e96c-40da-9c2a-407b4a7c9239 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:40.471162 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 798/1617] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:40.473232 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7645583-ce07-4270-94c7-136b059da4f4 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:40.514115 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7645583-ce07-4270-94c7-136b059da4f4 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:40.535429 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5fde5-e96c-40da-9c2a-407b4a7c9239 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:40.539689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c06159-b05f-400b-99f0-71b24785ff3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:40.540669 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c06159-b05f-400b-99f0-71b24785ff3e service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:40.541139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c06159-b05f-400b-99f0-71b24785ff3e service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:40.541608 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c06159-b05f-400b-99f0-71b24785ff3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:40.549008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac292ed-45a6-4d24-b4c9-c4dba513b9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:40.555314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac292ed-45a6-4d24-b4c9-c4dba513b9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:40.556070 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac292ed-45a6-4d24-b4c9-c4dba513b9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:40.557847 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac292ed-45a6-4d24-b4c9-c4dba513b9c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:40.559065 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac292ed-45a6-4d24-b4c9-c4dba513b9c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:40.561813 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac292ed-45a6-4d24-b4c9-c4dba513b9c0 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:40.579772 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:40.630835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 820/1618] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:39:40 2022] POST /identity/v3/users => generated 306 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:40.632706 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac292ed-45a6-4d24-b4c9-c4dba513b9c0 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:40.673840 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c06159-b05f-400b-99f0-71b24785ff3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:40.676128 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c06159-b05f-400b-99f0-71b24785ff3e service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:40.693249 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 799/1619] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:40.694065 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c06159-b05f-400b-99f0-71b24785ff3e service nova] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:40.709506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c06159-b05f-400b-99f0-71b24785ff3e service nova] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:40.721403 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd6846-c76a-4b16-8621-3936917cb7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:40.725859 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd6846-c76a-4b16-8621-3936917cb7ed admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:40.726169 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd6846-c76a-4b16-8621-3936917cb7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:40.726169 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd6846-c76a-4b16-8621-3936917cb7ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:40.734201 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd6846-c76a-4b16-8621-3936917cb7ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:40.743147 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd6846-c76a-4b16-8621-3936917cb7ed admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:40.853885 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac292ed-45a6-4d24-b4c9-c4dba513b9c0 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:40.860933 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 800/1620] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:39:40 2022] POST /identity/v3/projects => generated 361 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:40.872225 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5594c-b2c6-442b-a607-cc69a0d5f3e0 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:40.872225 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5594c-b2c6-442b-a607-cc69a0d5f3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:40.874461 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5594c-b2c6-442b-a607-cc69a0d5f3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:40.936652 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-06a5594c-b2c6-442b-a607-cc69a0d5f3e0 None None] MFA Rules not processed for user `96c35c544cae4ad187f1a1be723e0d21`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:40.937956 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-06a5594c-b2c6-442b-a607-cc69a0d5f3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:41.150079 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe23e3e-f2d4-43fb-8ba8-e2008dc06d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:41.150079 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe23e3e-f2d4-43fb-8ba8-e2008dc06d06 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:41.150079 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe23e3e-f2d4-43fb-8ba8-e2008dc06d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:41.150079 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe23e3e-f2d4-43fb-8ba8-e2008dc06d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:41.193744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 801/1621] 10.222.0.69 () {58 vars in 1059 bytes} [Mon Aug 29 21:39:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:41.195787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5594c-b2c6-442b-a607-cc69a0d5f3e0 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:41.346334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:41.380516 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5594c-b2c6-442b-a607-cc69a0d5f3e0 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:41.404949 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7c2a9-be53-433e-b289-09aa50c777e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:41.405891 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7c2a9-be53-433e-b289-09aa50c777e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:41.406177 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7c2a9-be53-433e-b289-09aa50c777e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:41.406455 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7c2a9-be53-433e-b289-09aa50c777e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:41.420756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe23e3e-f2d4-43fb-8ba8-e2008dc06d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:41.422362 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe23e3e-f2d4-43fb-8ba8-e2008dc06d06 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:41.473079 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 821/1622] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 841 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:41.475639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe23e3e-f2d4-43fb-8ba8-e2008dc06d06 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:41.513370 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe23e3e-f2d4-43fb-8ba8-e2008dc06d06 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:41.529359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f25acc-8336-464d-a53f-b592d7448cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:41.531245 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f25acc-8336-464d-a53f-b592d7448cfe admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:41.532320 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f25acc-8336-464d-a53f-b592d7448cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:41.533236 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f25acc-8336-464d-a53f-b592d7448cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:41.535012 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f25acc-8336-464d-a53f-b592d7448cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:41.539307 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f25acc-8336-464d-a53f-b592d7448cfe admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:41.541981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7c2a9-be53-433e-b289-09aa50c777e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:41.543550 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7c2a9-be53-433e-b289-09aa50c777e2 service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:41.568658 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 802/1623] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:41.569652 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7c2a9-be53-433e-b289-09aa50c777e2 service cinder] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:41.593787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7c2a9-be53-433e-b289-09aa50c777e2 service cinder] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:41.596478 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 822/1624] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:41.603551 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f25acc-8336-464d-a53f-b592d7448cfe admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:41.614970 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4dde1-a543-4d20-bf24-50b3b4c70668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:41.617208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4dde1-a543-4d20-bf24-50b3b4c70668 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:41.617553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4dde1-a543-4d20-bf24-50b3b4c70668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:41.617892 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4dde1-a543-4d20-bf24-50b3b4c70668 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:41.620129 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4dde1-a543-4d20-bf24-50b3b4c70668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:41.623882 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4dde1-a543-4d20-bf24-50b3b4c70668 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:41.668674 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f25acc-8336-464d-a53f-b592d7448cfe admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:41.680821 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 803/1625] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:39:41 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:41.682405 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cc790-6572-4a99-8b90-51ab84ab3ad9 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:41.682950 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cc790-6572-4a99-8b90-51ab84ab3ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:41.683328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cc790-6572-4a99-8b90-51ab84ab3ad9 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:41.690096 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 804/1626] 10.222.0.69 () {54 vars in 912 bytes} [Mon Aug 29 21:39:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:39:41.691667 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497cc790-6572-4a99-8b90-51ab84ab3ad9 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:41.704324 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244233ed-f604-490b-808c-3ec8402d8ef2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:41.705500 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244233ed-f604-490b-808c-3ec8402d8ef2 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:41.706019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244233ed-f604-490b-808c-3ec8402d8ef2 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:41.707246 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244233ed-f604-490b-808c-3ec8402d8ef2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:41.714314 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497cc790-6572-4a99-8b90-51ab84ab3ad9 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:41.720436 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9c10d-26f7-47bd-be8c-0960bb3fd9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:41.721169 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9c10d-26f7-47bd-be8c-0960bb3fd9b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:41.721507 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9c10d-26f7-47bd-be8c-0960bb3fd9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:41.721784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9c10d-26f7-47bd-be8c-0960bb3fd9b3 admin admin] PATH_INFO: `/v3/projects/52d2d08b7eb543579e86b6590b3d45d3/users/0201a5c7c1b647fa904d157538c57bdc/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:41.745595 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9c10d-26f7-47bd-be8c-0960bb3fd9b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52d2d08b7eb543579e86b6590b3d45d3, user_id=0201a5c7c1b647fa904d157538c57bdc, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:41.748999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9c10d-26f7-47bd-be8c-0960bb3fd9b3 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:41.780627 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 805/1627] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:39:41 2022] PUT /identity/v3/projects/52d2d08b7eb543579e86b6590b3d45d3/users/0201a5c7c1b647fa904d157538c57bdc/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:41.781991 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9c10d-26f7-47bd-be8c-0960bb3fd9b3 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:41.892530 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9c10d-26f7-47bd-be8c-0960bb3fd9b3 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:41.899569 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b513b-5e87-45f5-9468-288550c226dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:41.900832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b513b-5e87-45f5-9468-288550c226dc admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:41.901130 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b513b-5e87-45f5-9468-288550c226dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:41.901404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b513b-5e87-45f5-9468-288550c226dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:41.902084 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b513b-5e87-45f5-9468-288550c226dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:41.904070 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b513b-5e87-45f5-9468-288550c226dc admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:41.909125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:41.928701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 806/1628] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:41.930946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8c48d-7202-4159-a60c-a951924a62e5 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:41.934900 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8c48d-7202-4159-a60c-a951924a62e5 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:41.935254 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8c48d-7202-4159-a60c-a951924a62e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:41.952428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244233ed-f604-490b-808c-3ec8402d8ef2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:41.955468 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244233ed-f604-490b-808c-3ec8402d8ef2 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:41.971448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-71c8c48d-7202-4159-a60c-a951924a62e5 None None] MFA Rules not processed for user `96c35c544cae4ad187f1a1be723e0d21`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:41.974272 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-71c8c48d-7202-4159-a60c-a951924a62e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:41.995658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 823/1629] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:42.009844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244233ed-f604-490b-808c-3ec8402d8ef2 service nova] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:42.073384 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244233ed-f604-490b-808c-3ec8402d8ef2 service nova] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:42.087046 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:42.103336 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536fe27-d797-4c60-91d5-eccdc82dfbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:42.104145 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536fe27-d797-4c60-91d5-eccdc82dfbbc admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:42.104650 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536fe27-d797-4c60-91d5-eccdc82dfbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:42.105121 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536fe27-d797-4c60-91d5-eccdc82dfbbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:42.106265 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8536fe27-d797-4c60-91d5-eccdc82dfbbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:42.109148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8536fe27-d797-4c60-91d5-eccdc82dfbbc admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:42.146997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 807/1630] 10.222.0.69 () {58 vars in 1009 bytes} [Mon Aug 29 21:39:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:42.149203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8c48d-7202-4159-a60c-a951924a62e5 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:42.174973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 824/1631] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:42.181367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8c48d-7202-4159-a60c-a951924a62e5 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:42.187070 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536fe27-d797-4c60-91d5-eccdc82dfbbc admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:42.211623 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04bd72-64a8-470f-a621-9a5d98b69653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:42.213225 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04bd72-64a8-470f-a621-9a5d98b69653 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:42.214140 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04bd72-64a8-470f-a621-9a5d98b69653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:42.214781 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04bd72-64a8-470f-a621-9a5d98b69653 admin admin] PATH_INFO: `/v3/projects/732b4a7d282d47429c2b964a404797d8/users/13f64a2b6f9e409d8641db6401c68854/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:42.260108 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536fe27-d797-4c60-91d5-eccdc82dfbbc admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:42.266423 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04bd72-64a8-470f-a621-9a5d98b69653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=732b4a7d282d47429c2b964a404797d8, user_id=13f64a2b6f9e409d8641db6401c68854, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:42.274047 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04bd72-64a8-470f-a621-9a5d98b69653 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:42.279590 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e7016-7c55-433a-a8ad-95249802c08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:42.280421 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e7016-7c55-433a-a8ad-95249802c08d admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:42.280881 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e7016-7c55-433a-a8ad-95249802c08d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:42.281365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e7016-7c55-433a-a8ad-95249802c08d admin admin] PATH_INFO: `/v3/projects/52d2d08b7eb543579e86b6590b3d45d3/users/0201a5c7c1b647fa904d157538c57bdc/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:42.295754 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e7016-7c55-433a-a8ad-95249802c08d admin admin] RBAC: Authorizing `identity:create_grant(project_id=52d2d08b7eb543579e86b6590b3d45d3, user_id=0201a5c7c1b647fa904d157538c57bdc, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:42.302423 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e7016-7c55-433a-a8ad-95249802c08d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:42.371264 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 825/1632] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:39:42 2022] PUT /identity/v3/projects/52d2d08b7eb543579e86b6590b3d45d3/users/0201a5c7c1b647fa904d157538c57bdc/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:42.372876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e7016-7c55-433a-a8ad-95249802c08d admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:42.379802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 808/1633] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:39:42 2022] PUT /identity/v3/projects/732b4a7d282d47429c2b964a404797d8/users/13f64a2b6f9e409d8641db6401c68854/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:42.381849 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04bd72-64a8-470f-a621-9a5d98b69653 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:42.621704 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04bd72-64a8-470f-a621-9a5d98b69653 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:42.630186 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e7016-7c55-433a-a8ad-95249802c08d admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:42.646602 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf9399-71b4-40d5-87ad-c7e3e35961f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:42.647246 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf9399-71b4-40d5-87ad-c7e3e35961f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:42.647562 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf9399-71b4-40d5-87ad-c7e3e35961f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:42.647850 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf9399-71b4-40d5-87ad-c7e3e35961f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:42.895865 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf9399-71b4-40d5-87ad-c7e3e35961f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:42.901830 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf9399-71b4-40d5-87ad-c7e3e35961f7 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:42.951337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 826/1634] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:42.951337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f172c1f-d52a-4ae3-9175-27139b0a765e None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:42.951337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f172c1f-d52a-4ae3-9175-27139b0a765e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:42.951337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f172c1f-d52a-4ae3-9175-27139b0a765e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:42.991565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fb151-14d1-4f79-ac67-07de1f249e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:42.992642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fb151-14d1-4f79-ac67-07de1f249e4c admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:42.996467 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fb151-14d1-4f79-ac67-07de1f249e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:42.999745 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fb151-14d1-4f79-ac67-07de1f249e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:43.002603 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3fb151-14d1-4f79-ac67-07de1f249e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:43.020763 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3fb151-14d1-4f79-ac67-07de1f249e4c admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:43.077414 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-7f172c1f-d52a-4ae3-9175-27139b0a765e None None] MFA Rules not processed for user `0201a5c7c1b647fa904d157538c57bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:43.082964 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-7f172c1f-d52a-4ae3-9175-27139b0a765e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:43.131850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 809/1635] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 751 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:43.136882 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fb151-14d1-4f79-ac67-07de1f249e4c admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:43.184792 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fb151-14d1-4f79-ac67-07de1f249e4c admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:43.217307 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2baff0-2c70-4054-89a9-6077beb12a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:43.218470 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2baff0-2c70-4054-89a9-6077beb12a56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:43.218977 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2baff0-2c70-4054-89a9-6077beb12a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:43.219490 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2baff0-2c70-4054-89a9-6077beb12a56 admin admin] PATH_INFO: `/v3/projects/732b4a7d282d47429c2b964a404797d8/users/13f64a2b6f9e409d8641db6401c68854/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:43.240527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2baff0-2c70-4054-89a9-6077beb12a56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=732b4a7d282d47429c2b964a404797d8, user_id=13f64a2b6f9e409d8641db6401c68854, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:43.265807 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2baff0-2c70-4054-89a9-6077beb12a56 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:43.326400 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 810/1636] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:39:43 2022] PUT /identity/v3/projects/732b4a7d282d47429c2b964a404797d8/users/13f64a2b6f9e409d8641db6401c68854/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:43.345404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5eee6e-1a92-4d85-b6b6-9e2b41c4106c None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:43.346047 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5eee6e-1a92-4d85-b6b6-9e2b41c4106c None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:43.346934 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5eee6e-1a92-4d85-b6b6-9e2b41c4106c None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:43.351397 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 811/1637] 10.222.0.69 () {54 vars in 912 bytes} [Mon Aug 29 21:39:43 2022] GET /identity => generated 270 bytes in 26 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:39:43.355621 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae969a6e-4b35-416a-8ead-fc5567efe41c None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:43.356296 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae969a6e-4b35-416a-8ead-fc5567efe41c None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:43.356898 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae969a6e-4b35-416a-8ead-fc5567efe41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:43.501599 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:43.515115 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-ae969a6e-4b35-416a-8ead-fc5567efe41c None None] MFA Rules not processed for user `13f64a2b6f9e409d8641db6401c68854`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:43.522676 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-ae969a6e-4b35-416a-8ead-fc5567efe41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:43.595942 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 827/1638] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:42 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 655 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:43.595942 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d95d0-9cb3-4a46-a02c-a3ad5cee5473 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:43.595942 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d95d0-9cb3-4a46-a02c-a3ad5cee5473 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:43.609609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d95d0-9cb3-4a46-a02c-a3ad5cee5473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:43.657928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-361d95d0-9cb3-4a46-a02c-a3ad5cee5473 None None] MFA Rules not processed for user `96c35c544cae4ad187f1a1be723e0d21`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:43.661613 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-361d95d0-9cb3-4a46-a02c-a3ad5cee5473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:43.664912 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:43.759253 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 812/1639] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:43 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:43.760734 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae969a6e-4b35-416a-8ead-fc5567efe41c None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:43.818111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 828/1640] 10.222.0.69 () {58 vars in 1009 bytes} [Mon Aug 29 21:39:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:43.868606 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae969a6e-4b35-416a-8ead-fc5567efe41c None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:43.885069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3d679-61c9-46c1-9268-48376c8c5beb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:43.887554 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3d679-61c9-46c1-9268-48376c8c5beb service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:43.887884 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3d679-61c9-46c1-9268-48376c8c5beb service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:43.888170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3d679-61c9-46c1-9268-48376c8c5beb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:44.102337 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3d679-61c9-46c1-9268-48376c8c5beb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:44.104302 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3d679-61c9-46c1-9268-48376c8c5beb service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:44.150418 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 813/1641] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:43 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:44.243222 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d95d0-9cb3-4a46-a02c-a3ad5cee5473 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:44.256764 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d95d0-9cb3-4a46-a02c-a3ad5cee5473 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:44.268655 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b2608-3cdb-4000-af52-d3421c454eb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:44.270160 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b2608-3cdb-4000-af52-d3421c454eb0 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:44.270598 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b2608-3cdb-4000-af52-d3421c454eb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:44.271009 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b2608-3cdb-4000-af52-d3421c454eb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:44.306374 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b2608-3cdb-4000-af52-d3421c454eb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:44.308465 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b2608-3cdb-4000-af52-d3421c454eb0 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:44.341053 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 829/1642] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:44 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:44.480614 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3d679-61c9-46c1-9268-48376c8c5beb service cinder] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:44.513863 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3d679-61c9-46c1-9268-48376c8c5beb service cinder] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:44.538481 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f29c5a-faeb-41af-9cdd-ff209ad86724 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:44.539661 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f29c5a-faeb-41af-9cdd-ff209ad86724 service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:44.540302 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f29c5a-faeb-41af-9cdd-ff209ad86724 service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:44.540886 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f29c5a-faeb-41af-9cdd-ff209ad86724 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:44.590871 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f29c5a-faeb-41af-9cdd-ff209ad86724 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:44.593537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f29c5a-faeb-41af-9cdd-ff209ad86724 service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:44.658197 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 814/1643] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:44.806995 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b2608-3cdb-4000-af52-d3421c454eb0 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:44.817820 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b2608-3cdb-4000-af52-d3421c454eb0 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:44.824130 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5180c6f-1f42-4d6d-a95d-ef92ff5b6bbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:44.824921 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5180c6f-1f42-4d6d-a95d-ef92ff5b6bbe service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:44.825514 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5180c6f-1f42-4d6d-a95d-ef92ff5b6bbe service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:44.825514 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5180c6f-1f42-4d6d-a95d-ef92ff5b6bbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:44.857494 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f29c5a-faeb-41af-9cdd-ff209ad86724 service cinder] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:44.891564 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f29c5a-faeb-41af-9cdd-ff209ad86724 service cinder] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:44.916944 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e7466-94db-41f5-98ff-c894d4b4f389 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:44.918246 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e7466-94db-41f5-98ff-c894d4b4f389 service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:44.918861 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e7466-94db-41f5-98ff-c894d4b4f389 service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:44.919452 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e7466-94db-41f5-98ff-c894d4b4f389 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:44.973910 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5180c6f-1f42-4d6d-a95d-ef92ff5b6bbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:44.977597 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5180c6f-1f42-4d6d-a95d-ef92ff5b6bbe service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:45.004709 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 830/1644] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:44 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:45.071369 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e7466-94db-41f5-98ff-c894d4b4f389 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:45.073259 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e7466-94db-41f5-98ff-c894d4b4f389 service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:45.088519 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 815/1645] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:46.286298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5180c6f-1f42-4d6d-a95d-ef92ff5b6bbe service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:46.539572 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5180c6f-1f42-4d6d-a95d-ef92ff5b6bbe service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:46.553297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b930e2-6dcc-4744-9040-dd9db3ac7627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:46.554269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b930e2-6dcc-4744-9040-dd9db3ac7627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:46.554696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b930e2-6dcc-4744-9040-dd9db3ac7627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:46.555126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b930e2-6dcc-4744-9040-dd9db3ac7627 admin admin] PATH_INFO: `/v3/users/e23502d32dcb42c6a34c6ceb8e566af8` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:46.558476 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b930e2-6dcc-4744-9040-dd9db3ac7627 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e23502d32dcb42c6a34c6ceb8e566af8)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:46.559814 dv-cinder-854267-3-smb devstack@keystone.service[81658]: WARNING py.warnings [None req-f8b930e2-6dcc-4744-9040-dd9db3ac7627 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:39:46.559814 dv-cinder-854267-3-smb devstack@keystone.service[81658]: warnings.warn(msg) Aug 29 21:39:46.559814 dv-cinder-854267-3-smb devstack@keystone.service[81658]: Aug 29 21:39:46.562060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b930e2-6dcc-4744-9040-dd9db3ac7627 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:46.585043 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:46.767004 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f8b930e2-6dcc-4744-9040-dd9db3ac7627 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e23502d32dcb42c6a34c6ceb8e566af8'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:46.798217 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f8b930e2-6dcc-4744-9040-dd9db3ac7627 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e23502d32dcb42c6a34c6ceb8e566af8'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:46.817271 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f8b930e2-6dcc-4744-9040-dd9db3ac7627 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e23502d32dcb42c6a34c6ceb8e566af8'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:46.819731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f8b930e2-6dcc-4744-9040-dd9db3ac7627 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e23502d32dcb42c6a34c6ceb8e566af8'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:46.821877 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f8b930e2-6dcc-4744-9040-dd9db3ac7627 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e23502d32dcb42c6a34c6ceb8e566af8'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:46.985490 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded792e-77f1-4312-bf3f-c5b58cc1de42 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:46.987356 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded792e-77f1-4312-bf3f-c5b58cc1de42 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:46.988127 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded792e-77f1-4312-bf3f-c5b58cc1de42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:46.993938 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 831/1646] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:39:46 2022] DELETE /identity/v3/users/e23502d32dcb42c6a34c6ceb8e566af8 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:47.016593 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:47.033635 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-1ded792e-77f1-4312-bf3f-c5b58cc1de42 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:47.035946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-1ded792e-77f1-4312-bf3f-c5b58cc1de42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:47.193971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 816/1647] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:47.250594 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b930e2-6dcc-4744-9040-dd9db3ac7627 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:47.258533 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f8b930e2-6dcc-4744-9040-dd9db3ac7627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:47.584704 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b930e2-6dcc-4744-9040-dd9db3ac7627 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:47.604645 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b315c-d7db-45cf-8dca-7e942e22eb7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:47.606101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b315c-d7db-45cf-8dca-7e942e22eb7d service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:47.606101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b315c-d7db-45cf-8dca-7e942e22eb7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:47.606101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b315c-d7db-45cf-8dca-7e942e22eb7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:47.642444 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b315c-d7db-45cf-8dca-7e942e22eb7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:47.648408 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b315c-d7db-45cf-8dca-7e942e22eb7d service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:47.688844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 832/1648] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:50.599073 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2011e-29f8-4c30-8c97-5bd8b282cc6b None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:50.599949 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2011e-29f8-4c30-8c97-5bd8b282cc6b None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:50.600241 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2011e-29f8-4c30-8c97-5bd8b282cc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:50.716197 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-24e2011e-29f8-4c30-8c97-5bd8b282cc6b None None] MFA Rules not processed for user `fd2d58e660a940dd8fd31903ee5a6968`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:50.719961 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-24e2011e-29f8-4c30-8c97-5bd8b282cc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:50.971028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 817/1649] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:50.971206 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4072e9-4a4d-446f-8ee6-5e1f1a43b8a6 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:50.971816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4072e9-4a4d-446f-8ee6-5e1f1a43b8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:50.973554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4072e9-4a4d-446f-8ee6-5e1f1a43b8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:51.067388 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-4c4072e9-4a4d-446f-8ee6-5e1f1a43b8a6 None None] MFA Rules not processed for user `fd2d58e660a940dd8fd31903ee5a6968`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:51.073660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4c4072e9-4a4d-446f-8ee6-5e1f1a43b8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:51.131102 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 833/1650] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:51.226342 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2011e-29f8-4c30-8c97-5bd8b282cc6b None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:51.227865 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-24e2011e-29f8-4c30-8c97-5bd8b282cc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:51.464533 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2011e-29f8-4c30-8c97-5bd8b282cc6b None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:51.480633 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4dcbd-145b-4821-a254-730c8d7f3873 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:51.481508 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4dcbd-145b-4821-a254-730c8d7f3873 service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:51.482161 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4dcbd-145b-4821-a254-730c8d7f3873 service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:51.482661 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4dcbd-145b-4821-a254-730c8d7f3873 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:51.499658 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4dcbd-145b-4821-a254-730c8d7f3873 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:51.505548 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4dcbd-145b-4821-a254-730c8d7f3873 service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:51.523092 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 818/1651] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:51 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:39:51.830290 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4072e9-4a4d-446f-8ee6-5e1f1a43b8a6 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:51.832353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4c4072e9-4a4d-446f-8ee6-5e1f1a43b8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:51.872930 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4072e9-4a4d-446f-8ee6-5e1f1a43b8a6 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:51.887541 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d5411-e3c7-4f4c-843d-dc408ba3c8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:51.888223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d5411-e3c7-4f4c-843d-dc408ba3c8e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:51.888517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d5411-e3c7-4f4c-843d-dc408ba3c8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:51.888791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d5411-e3c7-4f4c-843d-dc408ba3c8e1 admin admin] PATH_INFO: `/v3/projects/af8d745adeaf4d339d5f4834ec2d5c84` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:51.905227 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d5411-e3c7-4f4c-843d-dc408ba3c8e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af8d745adeaf4d339d5f4834ec2d5c84)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:51.909725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d5411-e3c7-4f4c-843d-dc408ba3c8e1 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:52.228007 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-dc9d5411-e3c7-4f4c-843d-dc408ba3c8e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af8d745adeaf4d339d5f4834ec2d5c84', 'request_id': 'req-dc9d5411-e3c7-4f4c-843d-dc408ba3c8e1'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:52.241294 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-dc9d5411-e3c7-4f4c-843d-dc408ba3c8e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af8d745adeaf4d339d5f4834ec2d5c84', 'request_id': 'req-dc9d5411-e3c7-4f4c-843d-dc408ba3c8e1'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:52.256587 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-dc9d5411-e3c7-4f4c-843d-dc408ba3c8e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af8d745adeaf4d339d5f4834ec2d5c84', 'request_id': 'req-dc9d5411-e3c7-4f4c-843d-dc408ba3c8e1'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:52.298398 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-dc9d5411-e3c7-4f4c-843d-dc408ba3c8e1 admin admin] The token cache is being invalidate because project af8d745adeaf4d339d5f4834ec2d5c84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:39:52.302906 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-dc9d5411-e3c7-4f4c-843d-dc408ba3c8e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:52.304705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-dc9d5411-e3c7-4f4c-843d-dc408ba3c8e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:52.320645 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 834/1652] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:39:51 2022] DELETE /identity/v3/projects/af8d745adeaf4d339d5f4834ec2d5c84 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:39:52.330273 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cb735-06ac-4424-8c1a-269c6bf6eea6 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:52.330864 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cb735-06ac-4424-8c1a-269c6bf6eea6 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:52.331230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cb735-06ac-4424-8c1a-269c6bf6eea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:52.546486 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-3b2cb735-06ac-4424-8c1a-269c6bf6eea6 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:52.590339 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-3b2cb735-06ac-4424-8c1a-269c6bf6eea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:52.692159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:52.953223 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 819/1653] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 616 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:52.955069 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5f228-0413-4f1b-9eeb-375ef9731215 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:52.955634 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5f228-0413-4f1b-9eeb-375ef9731215 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:52.956601 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5f228-0413-4f1b-9eeb-375ef9731215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:52.980941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:53.039989 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-fce5f228-0413-4f1b-9eeb-375ef9731215 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:53.046167 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fce5f228-0413-4f1b-9eeb-375ef9731215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:53.087670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 835/1654] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:53.099623 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cb735-06ac-4424-8c1a-269c6bf6eea6 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:53.145473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cb735-06ac-4424-8c1a-269c6bf6eea6 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:53.148253 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5f228-0413-4f1b-9eeb-375ef9731215 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:53.150616 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fce5f228-0413-4f1b-9eeb-375ef9731215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:53.202431 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49b058-094c-496c-83fa-d3453bc49b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:53.203483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49b058-094c-496c-83fa-d3453bc49b72 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:53.205185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49b058-094c-496c-83fa-d3453bc49b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:53.208431 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49b058-094c-496c-83fa-d3453bc49b72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:53.210064 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49b058-094c-496c-83fa-d3453bc49b72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:39:53.214258 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49b058-094c-496c-83fa-d3453bc49b72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:53.229526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49b058-094c-496c-83fa-d3453bc49b72 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:53.232597 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5f228-0413-4f1b-9eeb-375ef9731215 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:53.263840 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17870b-8958-4df4-a40f-30692f063d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:53.265333 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17870b-8958-4df4-a40f-30692f063d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:53.266022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17870b-8958-4df4-a40f-30692f063d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:53.266738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17870b-8958-4df4-a40f-30692f063d6d admin admin] PATH_INFO: `/v3/users/cb31d2cb242b46c5b917ca5721575d90` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:53.271422 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17870b-8958-4df4-a40f-30692f063d6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb31d2cb242b46c5b917ca5721575d90)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:53.288409 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17870b-8958-4df4-a40f-30692f063d6d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:53.291586 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 820/1655] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:39:53.293543 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49b058-094c-496c-83fa-d3453bc49b72 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:53.365240 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49b058-094c-496c-83fa-d3453bc49b72 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:53.402286 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d64b1f-99e1-4792-80cb-f1dc1a901200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:53.403819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d64b1f-99e1-4792-80cb-f1dc1a901200 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:53.404638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d64b1f-99e1-4792-80cb-f1dc1a901200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:53.408721 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d64b1f-99e1-4792-80cb-f1dc1a901200 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:53.410825 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d64b1f-99e1-4792-80cb-f1dc1a901200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:53.422784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d64b1f-99e1-4792-80cb-f1dc1a901200 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:53.551930 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 821/1656] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:39:53 2022] POST /identity/v3/projects => generated 405 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:53.557636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ea1ad-40d5-4305-83e9-bf98b5a30c83 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:53.559066 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ea1ad-40d5-4305-83e9-bf98b5a30c83 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:53.560206 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ea1ad-40d5-4305-83e9-bf98b5a30c83 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:53.568470 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 822/1657] 10.222.0.69 () {54 vars in 912 bytes} [Mon Aug 29 21:39:53 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:39:53.569717 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ea1ad-40d5-4305-83e9-bf98b5a30c83 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:53.575977 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2d17870b-8958-4df4-a40f-30692f063d6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb31d2cb242b46c5b917ca5721575d90'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:53.602919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2d17870b-8958-4df4-a40f-30692f063d6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb31d2cb242b46c5b917ca5721575d90'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:53.627624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2d17870b-8958-4df4-a40f-30692f063d6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb31d2cb242b46c5b917ca5721575d90'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:53.630809 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2d17870b-8958-4df4-a40f-30692f063d6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb31d2cb242b46c5b917ca5721575d90'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:53.631553 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2d17870b-8958-4df4-a40f-30692f063d6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb31d2cb242b46c5b917ca5721575d90'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:53.666404 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 836/1658] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:39:53 2022] DELETE /identity/v3/users/cb31d2cb242b46c5b917ca5721575d90 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:39:53.667927 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d1e96-5566-4b4b-a470-c25468497594 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:53.668314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d1e96-5566-4b4b-a470-c25468497594 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:53.668596 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d1e96-5566-4b4b-a470-c25468497594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:53.750549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-033d1e96-5566-4b4b-a470-c25468497594 None None] MFA Rules not processed for user `dfa16ba58c0040f8bdfa5e46f2681395`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:53.752028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-033d1e96-5566-4b4b-a470-c25468497594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:53.892010 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 837/1659] 10.222.0.69 () {58 vars in 1009 bytes} [Mon Aug 29 21:39:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:53.905068 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac16ed-9735-416b-96d6-1bd7cc1ff06e None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:53.909465 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac16ed-9735-416b-96d6-1bd7cc1ff06e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:53.910213 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac16ed-9735-416b-96d6-1bd7cc1ff06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:53.984477 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ea1ad-40d5-4305-83e9-bf98b5a30c83 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:54.022149 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-37ac16ed-9735-416b-96d6-1bd7cc1ff06e None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:54.025084 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-37ac16ed-9735-416b-96d6-1bd7cc1ff06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:54.177197 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8eecf-0192-4496-b2ec-da768dde1dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:54.177859 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8eecf-0192-4496-b2ec-da768dde1dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:54.178146 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8eecf-0192-4496-b2ec-da768dde1dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:54.178429 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8eecf-0192-4496-b2ec-da768dde1dc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:54.179097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8eecf-0192-4496-b2ec-da768dde1dc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:54.181454 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8eecf-0192-4496-b2ec-da768dde1dc6 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:54.271130 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 823/1660] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:39:53 2022] POST /identity/v3/users => generated 303 bytes in 700 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:39:54.271602 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8eecf-0192-4496-b2ec-da768dde1dc6 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:54.278428 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-8df8eecf-0192-4496-b2ec-da768dde1dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:54.313329 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8eecf-0192-4496-b2ec-da768dde1dc6 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:54.327959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 838/1661] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:54.330936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac16ed-9735-416b-96d6-1bd7cc1ff06e None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:54.332412 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77499fb9-b8b2-4290-9f08-759447f2ec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:54.334785 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77499fb9-b8b2-4290-9f08-759447f2ec46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:54.335368 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-37ac16ed-9735-416b-96d6-1bd7cc1ff06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:54.337903 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77499fb9-b8b2-4290-9f08-759447f2ec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:54.338494 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77499fb9-b8b2-4290-9f08-759447f2ec46 admin admin] PATH_INFO: `/v3/users/ffcfd3bfdb8f40eabe52e61339610589` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:54.341201 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77499fb9-b8b2-4290-9f08-759447f2ec46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffcfd3bfdb8f40eabe52e61339610589)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:54.344902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77499fb9-b8b2-4290-9f08-759447f2ec46 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:54.384988 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac16ed-9735-416b-96d6-1bd7cc1ff06e None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:54.403482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c75236-38f5-48a3-b31e-2ba55b7ec60a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:54.404417 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c75236-38f5-48a3-b31e-2ba55b7ec60a service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:54.404822 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c75236-38f5-48a3-b31e-2ba55b7ec60a service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:54.405141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c75236-38f5-48a3-b31e-2ba55b7ec60a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:54.424326 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:54.436619 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:54.455601 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c75236-38f5-48a3-b31e-2ba55b7ec60a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:54.462247 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c75236-38f5-48a3-b31e-2ba55b7ec60a service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:54.506503 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 839/1662] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:54.507437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c75236-38f5-48a3-b31e-2ba55b7ec60a service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:54.524773 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-89c75236-38f5-48a3-b31e-2ba55b7ec60a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:54.542020 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-77499fb9-b8b2-4290-9f08-759447f2ec46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffcfd3bfdb8f40eabe52e61339610589'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:54.574825 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-77499fb9-b8b2-4290-9f08-759447f2ec46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffcfd3bfdb8f40eabe52e61339610589'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:54.589407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c75236-38f5-48a3-b31e-2ba55b7ec60a service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:54.614617 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eabbe6-4744-41fd-85fe-dd73e8b5e094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:54.615728 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eabbe6-4744-41fd-85fe-dd73e8b5e094 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:54.616821 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eabbe6-4744-41fd-85fe-dd73e8b5e094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:54.619709 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eabbe6-4744-41fd-85fe-dd73e8b5e094 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:54.622836 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eabbe6-4744-41fd-85fe-dd73e8b5e094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:54.626999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eabbe6-4744-41fd-85fe-dd73e8b5e094 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:54.633590 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-77499fb9-b8b2-4290-9f08-759447f2ec46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffcfd3bfdb8f40eabe52e61339610589'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:54.635575 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-77499fb9-b8b2-4290-9f08-759447f2ec46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffcfd3bfdb8f40eabe52e61339610589'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:54.638414 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-77499fb9-b8b2-4290-9f08-759447f2ec46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffcfd3bfdb8f40eabe52e61339610589'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:54.680089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 840/1663] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:54.683388 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eabbe6-4744-41fd-85fe-dd73e8b5e094 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:54.693744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 824/1664] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:39:54 2022] DELETE /identity/v3/users/ffcfd3bfdb8f40eabe52e61339610589 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:54.694444 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-65eabbe6-4744-41fd-85fe-dd73e8b5e094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:54.695401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77499fb9-b8b2-4290-9f08-759447f2ec46 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:54.701159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-77499fb9-b8b2-4290-9f08-759447f2ec46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:54.736895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eabbe6-4744-41fd-85fe-dd73e8b5e094 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:54.896634 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77499fb9-b8b2-4290-9f08-759447f2ec46 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:54.924514 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c98d8-f19a-4606-9916-7f465b41f344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:54.924514 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c98d8-f19a-4606-9916-7f465b41f344 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:54.924514 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c98d8-f19a-4606-9916-7f465b41f344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:54.924514 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c98d8-f19a-4606-9916-7f465b41f344 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:54.925007 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c98d8-f19a-4606-9916-7f465b41f344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:54.939487 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c98d8-f19a-4606-9916-7f465b41f344 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:54.940380 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461114b-4586-452d-99da-71b0f919a49f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:54.941305 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461114b-4586-452d-99da-71b0f919a49f service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:54.941794 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461114b-4586-452d-99da-71b0f919a49f service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:54.942074 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461114b-4586-452d-99da-71b0f919a49f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:54.944285 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9461114b-4586-452d-99da-71b0f919a49f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:54.984334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 825/1665] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:39:54.989392 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91333c48-fa37-4055-b010-a9d47e83ab6a None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:54.989770 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91333c48-fa37-4055-b010-a9d47e83ab6a None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:54.990061 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91333c48-fa37-4055-b010-a9d47e83ab6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:55.012138 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461114b-4586-452d-99da-71b0f919a49f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:55.013715 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461114b-4586-452d-99da-71b0f919a49f service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:55.044861 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 841/1666] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:55.045782 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461114b-4586-452d-99da-71b0f919a49f service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:55.079074 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461114b-4586-452d-99da-71b0f919a49f service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:55.088788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-91333c48-fa37-4055-b010-a9d47e83ab6a None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:55.094883 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f70903-47a4-4cf7-bfa0-f532b0edf4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:55.097119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f70903-47a4-4cf7-bfa0-f532b0edf4c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:55.098728 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f70903-47a4-4cf7-bfa0-f532b0edf4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:55.098892 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-91333c48-fa37-4055-b010-a9d47e83ab6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:55.099656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f70903-47a4-4cf7-bfa0-f532b0edf4c0 admin admin] PATH_INFO: `/v3/projects/2e38ad0716f04f4fbb9ee4ac7f80ac9a/users/af2db312464c45768e741e61062a99d1/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:55.174681 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f70903-47a4-4cf7-bfa0-f532b0edf4c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e38ad0716f04f4fbb9ee4ac7f80ac9a, user_id=af2db312464c45768e741e61062a99d1, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:55.177946 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f70903-47a4-4cf7-bfa0-f532b0edf4c0 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:55.201281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 826/1667] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:55.219805 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 842/1668] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:39:55 2022] PUT /identity/v3/projects/2e38ad0716f04f4fbb9ee4ac7f80ac9a/users/af2db312464c45768e741e61062a99d1/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:55.228702 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fec03f-b455-4cc9-8c62-4726bc178811 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:55.239455 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fec03f-b455-4cc9-8c62-4726bc178811 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:55.240125 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fec03f-b455-4cc9-8c62-4726bc178811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:55.339414 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-f9fec03f-b455-4cc9-8c62-4726bc178811 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:55.344272 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f9fec03f-b455-4cc9-8c62-4726bc178811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:55.429081 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f70903-47a4-4cf7-bfa0-f532b0edf4c0 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:55.431429 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-59f70903-47a4-4cf7-bfa0-f532b0edf4c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:55.611793 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 827/1669] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:55.621195 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f70903-47a4-4cf7-bfa0-f532b0edf4c0 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:55.634964 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba375b-c732-44f6-a672-0cb281202984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:55.635759 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba375b-c732-44f6-a672-0cb281202984 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:55.636090 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba375b-c732-44f6-a672-0cb281202984 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:55.636430 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba375b-c732-44f6-a672-0cb281202984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:55.682511 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba375b-c732-44f6-a672-0cb281202984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:55.684257 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba375b-c732-44f6-a672-0cb281202984 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:55.706127 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fec03f-b455-4cc9-8c62-4726bc178811 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:55.708613 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 843/1670] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:55.746939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fec03f-b455-4cc9-8c62-4726bc178811 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:55.766251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3087e1-3cf6-4fb6-926c-9eabf6f127f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:55.771520 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3087e1-3cf6-4fb6-926c-9eabf6f127f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:55.772878 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3087e1-3cf6-4fb6-926c-9eabf6f127f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:55.774173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3087e1-3cf6-4fb6-926c-9eabf6f127f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:55.827603 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3087e1-3cf6-4fb6-926c-9eabf6f127f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:55.830900 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3087e1-3cf6-4fb6-926c-9eabf6f127f8 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:55.888740 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 828/1671] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:56.272449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba375b-c732-44f6-a672-0cb281202984 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:56.274836 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9cba375b-c732-44f6-a672-0cb281202984 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:56.312171 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba375b-c732-44f6-a672-0cb281202984 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:56.334924 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eabc73-bec1-4eda-9f08-d7dededfc3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:56.335616 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eabc73-bec1-4eda-9f08-d7dededfc3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:56.335958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eabc73-bec1-4eda-9f08-d7dededfc3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:56.336264 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eabc73-bec1-4eda-9f08-d7dededfc3ae admin admin] PATH_INFO: `/v3/projects/f2c8e8c1fe744e569533ef83311e5e53` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:56.339202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eabc73-bec1-4eda-9f08-d7dededfc3ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2c8e8c1fe744e569533ef83311e5e53)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:56.341910 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eabc73-bec1-4eda-9f08-d7dededfc3ae admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:56.453028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-53eabc73-bec1-4eda-9f08-d7dededfc3ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2c8e8c1fe744e569533ef83311e5e53', 'request_id': 'req-53eabc73-bec1-4eda-9f08-d7dededfc3ae'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:56.466070 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-53eabc73-bec1-4eda-9f08-d7dededfc3ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2c8e8c1fe744e569533ef83311e5e53', 'request_id': 'req-53eabc73-bec1-4eda-9f08-d7dededfc3ae'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:56.475425 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:56.478093 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-53eabc73-bec1-4eda-9f08-d7dededfc3ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2c8e8c1fe744e569533ef83311e5e53', 'request_id': 'req-53eabc73-bec1-4eda-9f08-d7dededfc3ae'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:56.507575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-53eabc73-bec1-4eda-9f08-d7dededfc3ae admin admin] The token cache is being invalidate because project f2c8e8c1fe744e569533ef83311e5e53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:39:56.507872 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-53eabc73-bec1-4eda-9f08-d7dededfc3ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:56.508845 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-53eabc73-bec1-4eda-9f08-d7dededfc3ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:56.510716 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 844/1672] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:39:56 2022] DELETE /identity/v3/projects/f2c8e8c1fe744e569533ef83311e5e53 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:56.517277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3087e1-3cf6-4fb6-926c-9eabf6f127f8 service neutron] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:56.554568 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3087e1-3cf6-4fb6-926c-9eabf6f127f8 service neutron] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:56.586519 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:56.737912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eabc73-bec1-4eda-9f08-d7dededfc3ae admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:56.739919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-53eabc73-bec1-4eda-9f08-d7dededfc3ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:56.754257 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a7889-b13f-4763-b9fe-924a97a10d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:56.756390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a7889-b13f-4763-b9fe-924a97a10d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:56.757321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a7889-b13f-4763-b9fe-924a97a10d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:56.758065 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a7889-b13f-4763-b9fe-924a97a10d8b admin admin] PATH_INFO: `/v3/users/0201a5c7c1b647fa904d157538c57bdc` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:56.762112 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a7889-b13f-4763-b9fe-924a97a10d8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0201a5c7c1b647fa904d157538c57bdc)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:56.767123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a7889-b13f-4763-b9fe-924a97a10d8b admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:56.974921 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eabc73-bec1-4eda-9f08-d7dededfc3ae admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:56.975398 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-bd2a7889-b13f-4763-b9fe-924a97a10d8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0201a5c7c1b647fa904d157538c57bdc'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:56.977849 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-bd2a7889-b13f-4763-b9fe-924a97a10d8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0201a5c7c1b647fa904d157538c57bdc'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:57.001943 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5fc0b-6de4-4022-9eb3-78edeb750f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:57.007100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5fc0b-6de4-4022-9eb3-78edeb750f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:57.007657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5fc0b-6de4-4022-9eb3-78edeb750f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:57.008028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5fc0b-6de4-4022-9eb3-78edeb750f19 admin admin] PATH_INFO: `/v3/users/0ab91332bf544c9ebe1f6ca690b8489f` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:57.012129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5fc0b-6de4-4022-9eb3-78edeb750f19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab91332bf544c9ebe1f6ca690b8489f)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:57.016747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5fc0b-6de4-4022-9eb3-78edeb750f19 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:57.047806 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-bd2a7889-b13f-4763-b9fe-924a97a10d8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0201a5c7c1b647fa904d157538c57bdc'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:57.050239 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-bd2a7889-b13f-4763-b9fe-924a97a10d8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0201a5c7c1b647fa904d157538c57bdc'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:57.055226 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-bd2a7889-b13f-4763-b9fe-924a97a10d8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0201a5c7c1b647fa904d157538c57bdc'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:57.094816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 829/1673] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:39:56 2022] DELETE /identity/v3/users/0201a5c7c1b647fa904d157538c57bdc => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:39:57.094816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a7889-b13f-4763-b9fe-924a97a10d8b admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:57.096775 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-bd2a7889-b13f-4763-b9fe-924a97a10d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:57.189102 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4fc5fc0b-6de4-4022-9eb3-78edeb750f19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab91332bf544c9ebe1f6ca690b8489f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:57.229774 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4fc5fc0b-6de4-4022-9eb3-78edeb750f19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab91332bf544c9ebe1f6ca690b8489f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:57.248482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4fc5fc0b-6de4-4022-9eb3-78edeb750f19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab91332bf544c9ebe1f6ca690b8489f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:57.249743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4fc5fc0b-6de4-4022-9eb3-78edeb750f19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab91332bf544c9ebe1f6ca690b8489f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:57.250852 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4fc5fc0b-6de4-4022-9eb3-78edeb750f19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab91332bf544c9ebe1f6ca690b8489f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:57.277814 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a7889-b13f-4763-b9fe-924a97a10d8b admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:57.289103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c509ff-ac6b-45d6-a6ed-d164a393c155 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7911672bb2a471daf4f69ba940ef41d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:57.289103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c509ff-ac6b-45d6-a6ed-d164a393c155 service placement] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:57.289103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c509ff-ac6b-45d6-a6ed-d164a393c155 service placement] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:57.289103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c509ff-ac6b-45d6-a6ed-d164a393c155 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:57.291282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-95c509ff-ac6b-45d6-a6ed-d164a393c155 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:57.312853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c509ff-ac6b-45d6-a6ed-d164a393c155 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:57.316590 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c509ff-ac6b-45d6-a6ed-d164a393c155 service placement] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:57.339469 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 830/1674] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:57.341043 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a740e-0f43-4fa2-b3b6-4c17d76f1ca3 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:57.342060 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a740e-0f43-4fa2-b3b6-4c17d76f1ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:57.342357 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a740e-0f43-4fa2-b3b6-4c17d76f1ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:57.380702 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 845/1675] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:39:56 2022] DELETE /identity/v3/users/0ab91332bf544c9ebe1f6ca690b8489f => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:39:57.384812 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-943a740e-0f43-4fa2-b3b6-4c17d76f1ca3 None None] MFA Rules not processed for user `fd2d58e660a940dd8fd31903ee5a6968`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:57.386503 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d44177-a2ac-48d1-bac1-705282d62f0d None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:57.387568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d44177-a2ac-48d1-bac1-705282d62f0d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:57.388485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d44177-a2ac-48d1-bac1-705282d62f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:57.389192 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-943a740e-0f43-4fa2-b3b6-4c17d76f1ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:57.454668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:57.491434 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-b5d44177-a2ac-48d1-bac1-705282d62f0d None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:57.507625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b5d44177-a2ac-48d1-bac1-705282d62f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:57.581194 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 831/1676] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:57.720739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 846/1677] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:39:57.917608 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a740e-0f43-4fa2-b3b6-4c17d76f1ca3 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:57.924047 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-943a740e-0f43-4fa2-b3b6-4c17d76f1ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:57.954436 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ca552-0b1d-4a6c-928d-0f70e930133b None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:57.955909 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ca552-0b1d-4a6c-928d-0f70e930133b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:57.956383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ca552-0b1d-4a6c-928d-0f70e930133b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:58.018289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:58.131788 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-357ca552-0b1d-4a6c-928d-0f70e930133b None None] MFA Rules not processed for user `07cf908926af48e8b7d96f96d026254a`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:58.135097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-357ca552-0b1d-4a6c-928d-0f70e930133b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:58.255946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a740e-0f43-4fa2-b3b6-4c17d76f1ca3 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:58.275497 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c4513-ffeb-41f8-917b-194644c4ca31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:58.277573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c4513-ffeb-41f8-917b-194644c4ca31 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:58.278433 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c4513-ffeb-41f8-917b-194644c4ca31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:58.278975 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c4513-ffeb-41f8-917b-194644c4ca31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:58.298633 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c4513-ffeb-41f8-917b-194644c4ca31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:58.300824 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c4513-ffeb-41f8-917b-194644c4ca31 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:58.317386 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 832/1678] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:39:58.419795 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 847/1679] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:58.445388 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c4513-ffeb-41f8-917b-194644c4ca31 service neutron] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:58.447503 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-b28c4513-ffeb-41f8-917b-194644c4ca31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:58.610060 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c4513-ffeb-41f8-917b-194644c4ca31 service neutron] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:58.617882 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9bd1b-7e5b-40a3-95d8-678d64cfd43a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:58.618972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9bd1b-7e5b-40a3-95d8-678d64cfd43a service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:58.619491 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9bd1b-7e5b-40a3-95d8-678d64cfd43a service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:58.619983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9bd1b-7e5b-40a3-95d8-678d64cfd43a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:58.649421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9bd1b-7e5b-40a3-95d8-678d64cfd43a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:58.655516 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9bd1b-7e5b-40a3-95d8-678d64cfd43a service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:58.678863 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 833/1680] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:39:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:39:59.007806 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ca552-0b1d-4a6c-928d-0f70e930133b None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:59.013724 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-357ca552-0b1d-4a6c-928d-0f70e930133b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:59.045980 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ca552-0b1d-4a6c-928d-0f70e930133b None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:59.055797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cd759-fd07-4b17-946f-c48b04a50504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:59.057387 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cd759-fd07-4b17-946f-c48b04a50504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:59.058296 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cd759-fd07-4b17-946f-c48b04a50504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:59.059102 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cd759-fd07-4b17-946f-c48b04a50504 admin admin] PATH_INFO: `/v3/projects/d9860da48b4a47a2a2d6e88262fba995` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:59.062076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cd759-fd07-4b17-946f-c48b04a50504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9860da48b4a47a2a2d6e88262fba995)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:59.067260 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cd759-fd07-4b17-946f-c48b04a50504 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:59.173071 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9bd1b-7e5b-40a3-95d8-678d64cfd43a service nova] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:59.175144 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-deb9bd1b-7e5b-40a3-95d8-678d64cfd43a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:59.220091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-967cd759-fd07-4b17-946f-c48b04a50504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9860da48b4a47a2a2d6e88262fba995', 'request_id': 'req-967cd759-fd07-4b17-946f-c48b04a50504'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:59.231099 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-967cd759-fd07-4b17-946f-c48b04a50504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9860da48b4a47a2a2d6e88262fba995', 'request_id': 'req-967cd759-fd07-4b17-946f-c48b04a50504'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:59.243163 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-967cd759-fd07-4b17-946f-c48b04a50504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9860da48b4a47a2a2d6e88262fba995', 'request_id': 'req-967cd759-fd07-4b17-946f-c48b04a50504'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:59.246266 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9bd1b-7e5b-40a3-95d8-678d64cfd43a service nova] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:59.273968 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-967cd759-fd07-4b17-946f-c48b04a50504 admin admin] The token cache is being invalidate because project d9860da48b4a47a2a2d6e88262fba995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:39:59.275048 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-967cd759-fd07-4b17-946f-c48b04a50504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:59.277581 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-967cd759-fd07-4b17-946f-c48b04a50504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:59.281221 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 848/1681] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:39:59 2022] DELETE /identity/v3/projects/d9860da48b4a47a2a2d6e88262fba995 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:39:59.296459 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73610428-f15c-497b-952d-c73bc779557e None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:59.297357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73610428-f15c-497b-952d-c73bc779557e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:59.299526 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73610428-f15c-497b-952d-c73bc779557e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:59.358729 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-73610428-f15c-497b-952d-c73bc779557e None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:59.365656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-73610428-f15c-497b-952d-c73bc779557e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:59.434582 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:59.453839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26014b2b-5a88-4229-a601-1c6187c5e998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:59.456725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26014b2b-5a88-4229-a601-1c6187c5e998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:59.458015 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26014b2b-5a88-4229-a601-1c6187c5e998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:59.459085 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26014b2b-5a88-4229-a601-1c6187c5e998 admin admin] PATH_INFO: `/v3/users/aad4dc4aa97d4f11981669a022d72b9c` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:59.463038 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26014b2b-5a88-4229-a601-1c6187c5e998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aad4dc4aa97d4f11981669a022d72b9c)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:59.469483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26014b2b-5a88-4229-a601-1c6187c5e998 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:59.542015 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 849/1682] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:59.555575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81458eaf-c27a-46f6-9e3a-52245832bd67 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:59.556019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81458eaf-c27a-46f6-9e3a-52245832bd67 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:59.556624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81458eaf-c27a-46f6-9e3a-52245832bd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:59.596699 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-26014b2b-5a88-4229-a601-1c6187c5e998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad4dc4aa97d4f11981669a022d72b9c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:59.627371 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-26014b2b-5a88-4229-a601-1c6187c5e998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad4dc4aa97d4f11981669a022d72b9c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:59.629064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-81458eaf-c27a-46f6-9e3a-52245832bd67 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:59.634802 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-81458eaf-c27a-46f6-9e3a-52245832bd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:59.661350 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 850/1683] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:39:59.665364 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81458eaf-c27a-46f6-9e3a-52245832bd67 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:59.667695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-26014b2b-5a88-4229-a601-1c6187c5e998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad4dc4aa97d4f11981669a022d72b9c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:59.670818 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-26014b2b-5a88-4229-a601-1c6187c5e998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad4dc4aa97d4f11981669a022d72b9c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:59.672959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-26014b2b-5a88-4229-a601-1c6187c5e998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad4dc4aa97d4f11981669a022d72b9c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:39:59.689193 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81458eaf-c27a-46f6-9e3a-52245832bd67 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:59.695794 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734364b8-e125-4992-9359-50aa04b67f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:39:59.706010 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 834/1684] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:39:59 2022] DELETE /identity/v3/users/aad4dc4aa97d4f11981669a022d72b9c => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:39:59.708061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734364b8-e125-4992-9359-50aa04b67f5c admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:59.708506 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734364b8-e125-4992-9359-50aa04b67f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:59.708882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734364b8-e125-4992-9359-50aa04b67f5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:59.709947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734364b8-e125-4992-9359-50aa04b67f5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:39:59.711846 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c5146-d9c7-4bc7-bf8b-80fbc5c2d333 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:39:59.712447 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c5146-d9c7-4bc7-bf8b-80fbc5c2d333 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:39:59.712823 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c5146-d9c7-4bc7-bf8b-80fbc5c2d333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:39:59.714691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734364b8-e125-4992-9359-50aa04b67f5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:39:59.719152 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734364b8-e125-4992-9359-50aa04b67f5c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:39:59.742155 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:59.755445 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 851/1685] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:39:59.759870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734364b8-e125-4992-9359-50aa04b67f5c admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:39:59.764560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-734364b8-e125-4992-9359-50aa04b67f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:59.767371 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-ac3c5146-d9c7-4bc7-bf8b-80fbc5c2d333 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:39:59.773952 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-ac3c5146-d9c7-4bc7-bf8b-80fbc5c2d333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:39:59.800512 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734364b8-e125-4992-9359-50aa04b67f5c admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:39:59.949664 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 835/1686] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:40:00.028747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb48b16-56be-4f7d-a202-dcebc1cf1af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:00.030096 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb48b16-56be-4f7d-a202-dcebc1cf1af3 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:00.030547 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb48b16-56be-4f7d-a202-dcebc1cf1af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:00.031041 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb48b16-56be-4f7d-a202-dcebc1cf1af3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:00.032286 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb48b16-56be-4f7d-a202-dcebc1cf1af3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:00.035863 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c5146-d9c7-4bc7-bf8b-80fbc5c2d333 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:00.037987 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-ac3c5146-d9c7-4bc7-bf8b-80fbc5c2d333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:00.050377 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb48b16-56be-4f7d-a202-dcebc1cf1af3 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:00.225553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c5146-d9c7-4bc7-bf8b-80fbc5c2d333 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:00.236998 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 852/1687] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:39:59 2022] POST /identity/v3/projects => generated 373 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:00.243846 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb48b16-56be-4f7d-a202-dcebc1cf1af3 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:00.328621 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:00.417739 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608da91-c802-443a-ba89-29fe01ee7bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:00.418476 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608da91-c802-443a-ba89-29fe01ee7bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:00.418827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608da91-c802-443a-ba89-29fe01ee7bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:00.419125 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608da91-c802-443a-ba89-29fe01ee7bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:00.498618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb48b16-56be-4f7d-a202-dcebc1cf1af3 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:00.511165 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc2155-bebf-40b5-b908-46ac8442a8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:00.511791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc2155-bebf-40b5-b908-46ac8442a8cb admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:00.512154 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc2155-bebf-40b5-b908-46ac8442a8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:00.513158 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc2155-bebf-40b5-b908-46ac8442a8cb admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:00.513861 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc2155-bebf-40b5-b908-46ac8442a8cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:00.518436 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc2155-bebf-40b5-b908-46ac8442a8cb admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:00.565324 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 853/1688] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:00 2022] POST /identity/v3/users => generated 287 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:00.568022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc2155-bebf-40b5-b908-46ac8442a8cb admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:00.573610 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-87dc2155-bebf-40b5-b908-46ac8442a8cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:00.605598 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc2155-bebf-40b5-b908-46ac8442a8cb admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:00.622880 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7c104-5442-41be-bfb8-c42b103dde67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:00.623564 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7c104-5442-41be-bfb8-c42b103dde67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:00.624031 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7c104-5442-41be-bfb8-c42b103dde67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:00.624527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7c104-5442-41be-bfb8-c42b103dde67 admin admin] PATH_INFO: `/v3/projects/52d2d08b7eb543579e86b6590b3d45d3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:00.628205 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7c104-5442-41be-bfb8-c42b103dde67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52d2d08b7eb543579e86b6590b3d45d3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:00.634073 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7c104-5442-41be-bfb8-c42b103dde67 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:00.646885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2608da91-c802-443a-ba89-29fe01ee7bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:00.655454 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2608da91-c802-443a-ba89-29fe01ee7bb4 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:00.738110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 836/1689] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 703 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:40:00.746130 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc8bdb-c239-42fa-b375-9df9378c9d0a None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:00.748641 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc8bdb-c239-42fa-b375-9df9378c9d0a None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:00.749872 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc8bdb-c239-42fa-b375-9df9378c9d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:00.755660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d5a7c104-5442-41be-bfb8-c42b103dde67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52d2d08b7eb543579e86b6590b3d45d3', 'request_id': 'req-d5a7c104-5442-41be-bfb8-c42b103dde67'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:00.773115 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d5a7c104-5442-41be-bfb8-c42b103dde67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52d2d08b7eb543579e86b6590b3d45d3', 'request_id': 'req-d5a7c104-5442-41be-bfb8-c42b103dde67'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:00.799837 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d5a7c104-5442-41be-bfb8-c42b103dde67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52d2d08b7eb543579e86b6590b3d45d3', 'request_id': 'req-d5a7c104-5442-41be-bfb8-c42b103dde67'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:00.823583 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:00.830707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d5a7c104-5442-41be-bfb8-c42b103dde67 admin admin] The token cache is being invalidate because project 52d2d08b7eb543579e86b6590b3d45d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:40:00.833258 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d5a7c104-5442-41be-bfb8-c42b103dde67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:00.835252 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d5a7c104-5442-41be-bfb8-c42b103dde67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:00.837793 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 854/1690] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:00 2022] DELETE /identity/v3/projects/52d2d08b7eb543579e86b6590b3d45d3 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:00.838601 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7c104-5442-41be-bfb8-c42b103dde67 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:00.843384 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d5a7c104-5442-41be-bfb8-c42b103dde67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:00.849903 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-e3dc8bdb-c239-42fa-b375-9df9378c9d0a None None] MFA Rules not processed for user `af2db312464c45768e741e61062a99d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:00.853688 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-e3dc8bdb-c239-42fa-b375-9df9378c9d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:01.128609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7c104-5442-41be-bfb8-c42b103dde67 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:01.163482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc88ef0-d717-4f8f-b7b0-597cde04b6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:01.164239 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 837/1691] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:00 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:01.166797 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab3a92-26f3-41cc-b05a-1aff54d99aa4 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:01.167309 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab3a92-26f3-41cc-b05a-1aff54d99aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:01.167845 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab3a92-26f3-41cc-b05a-1aff54d99aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:01.173228 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc88ef0-d717-4f8f-b7b0-597cde04b6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:01.173228 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc88ef0-d717-4f8f-b7b0-597cde04b6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:01.173228 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc88ef0-d717-4f8f-b7b0-597cde04b6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:01.175137 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc88ef0-d717-4f8f-b7b0-597cde04b6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:01.182305 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc88ef0-d717-4f8f-b7b0-597cde04b6c6 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:01.241496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 855/1692] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:01.247407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc88ef0-d717-4f8f-b7b0-597cde04b6c6 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:01.251959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fcc88ef0-d717-4f8f-b7b0-597cde04b6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:01.298513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-0cab3a92-26f3-41cc-b05a-1aff54d99aa4 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:01.305698 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-0cab3a92-26f3-41cc-b05a-1aff54d99aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:01.318148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc88ef0-d717-4f8f-b7b0-597cde04b6c6 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:01.349520 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b07794-3512-45cd-9567-99a772b8d5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:01.350467 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b07794-3512-45cd-9567-99a772b8d5ac admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:01.350960 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b07794-3512-45cd-9567-99a772b8d5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:01.351444 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b07794-3512-45cd-9567-99a772b8d5ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:01.352680 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b07794-3512-45cd-9567-99a772b8d5ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:01.370727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b07794-3512-45cd-9567-99a772b8d5ac admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:01.379670 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 838/1693] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:01.381763 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab3a92-26f3-41cc-b05a-1aff54d99aa4 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:01.452609 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab3a92-26f3-41cc-b05a-1aff54d99aa4 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:01.489970 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19247dc3-afbc-4d11-9a1a-ccd7cd3d4483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:01.491479 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19247dc3-afbc-4d11-9a1a-ccd7cd3d4483 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:01.492075 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19247dc3-afbc-4d11-9a1a-ccd7cd3d4483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:01.492706 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19247dc3-afbc-4d11-9a1a-ccd7cd3d4483 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:01.494077 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19247dc3-afbc-4d11-9a1a-ccd7cd3d4483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:01.503130 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19247dc3-afbc-4d11-9a1a-ccd7cd3d4483 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:01.505116 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 856/1694] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:40:01 2022] POST /identity/v3/projects => generated 405 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:01.507647 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647a468-2e41-435f-904c-b544ceee7d2d None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:01.508129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647a468-2e41-435f-904c-b544ceee7d2d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:01.508678 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647a468-2e41-435f-904c-b544ceee7d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:01.551739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d647a468-2e41-435f-904c-b544ceee7d2d None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:01.554599 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d647a468-2e41-435f-904c-b544ceee7d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:01.568562 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 839/1695] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:01.581197 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19247dc3-afbc-4d11-9a1a-ccd7cd3d4483 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:01.638004 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19247dc3-afbc-4d11-9a1a-ccd7cd3d4483 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:01.834399 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:01.843479 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 857/1696] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:01.846659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647a468-2e41-435f-904c-b544ceee7d2d None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:01.877014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd116f-2721-4127-a0bc-644a77fe506e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:01.877710 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd116f-2721-4127-a0bc-644a77fe506e admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:01.877946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd116f-2721-4127-a0bc-644a77fe506e admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:01.884455 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd116f-2721-4127-a0bc-644a77fe506e admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:01.885279 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd116f-2721-4127-a0bc-644a77fe506e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:01.891635 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd116f-2721-4127-a0bc-644a77fe506e admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:01.925154 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647a468-2e41-435f-904c-b544ceee7d2d None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:01.953493 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21fe10-575d-4083-bc21-a4f2ec5cff56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:01.954923 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21fe10-575d-4083-bc21-a4f2ec5cff56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:01.956820 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21fe10-575d-4083-bc21-a4f2ec5cff56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:01.961461 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21fe10-575d-4083-bc21-a4f2ec5cff56 admin admin] PATH_INFO: `/v3/projects/e1071034fd3d4d64a55bd17877a94df3/users/e740a601ac33439499856f11d76085f3/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:01.965982 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 840/1697] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:01 2022] POST /identity/v3/users => generated 309 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:01.969942 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd116f-2721-4127-a0bc-644a77fe506e admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:01.991994 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd116f-2721-4127-a0bc-644a77fe506e admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:02.006302 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a1d01-78e8-47c2-ae0a-c568dd36d416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:02.007022 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a1d01-78e8-47c2-ae0a-c568dd36d416 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:02.007471 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a1d01-78e8-47c2-ae0a-c568dd36d416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:02.007633 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a1d01-78e8-47c2-ae0a-c568dd36d416 admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:02.008214 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a1d01-78e8-47c2-ae0a-c568dd36d416 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:40:02.008523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a1d01-78e8-47c2-ae0a-c568dd36d416 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:02.013368 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a1d01-78e8-47c2-ae0a-c568dd36d416 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:02.045797 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 841/1698] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:40:02.046116 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21fe10-575d-4083-bc21-a4f2ec5cff56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1071034fd3d4d64a55bd17877a94df3, user_id=e740a601ac33439499856f11d76085f3, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:02.050584 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a1d01-78e8-47c2-ae0a-c568dd36d416 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:02.063621 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21fe10-575d-4083-bc21-a4f2ec5cff56 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:02.092330 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a1d01-78e8-47c2-ae0a-c568dd36d416 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:02.117875 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4754bd4-d3de-479b-9159-be7bdaceacf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:02.118672 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4754bd4-d3de-479b-9159-be7bdaceacf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:02.121203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4754bd4-d3de-479b-9159-be7bdaceacf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:02.121764 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4754bd4-d3de-479b-9159-be7bdaceacf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:02.123886 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4754bd4-d3de-479b-9159-be7bdaceacf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:02.133229 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4754bd4-d3de-479b-9159-be7bdaceacf1 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:02.133914 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 858/1699] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:01 2022] PUT /identity/v3/projects/e1071034fd3d4d64a55bd17877a94df3/users/e740a601ac33439499856f11d76085f3/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:02.135894 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21fe10-575d-4083-bc21-a4f2ec5cff56 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:02.212855 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 842/1700] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:02.214008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117416c-63f1-462f-b1fa-d027af20c5aa None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:02.214762 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117416c-63f1-462f-b1fa-d027af20c5aa None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:02.216020 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117416c-63f1-462f-b1fa-d027af20c5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:02.434284 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-8117416c-63f1-462f-b1fa-d027af20c5aa None None] MFA Rules not processed for user `e740a601ac33439499856f11d76085f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:02.441020 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-8117416c-63f1-462f-b1fa-d027af20c5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:02.463064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:02.539076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21fe10-575d-4083-bc21-a4f2ec5cff56 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:02.573578 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedee55-678a-4dcc-9258-dd1b50f8a1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:02.574630 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedee55-678a-4dcc-9258-dd1b50f8a1d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:02.575111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedee55-678a-4dcc-9258-dd1b50f8a1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:02.575567 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedee55-678a-4dcc-9258-dd1b50f8a1d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:02.576842 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedee55-678a-4dcc-9258-dd1b50f8a1d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:02.588992 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedee55-678a-4dcc-9258-dd1b50f8a1d6 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:02.776829 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 859/1701] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:40:02 2022] POST /identity/v3/projects => generated 385 bytes in 642 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:02.786587 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedee55-678a-4dcc-9258-dd1b50f8a1d6 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:02.865032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 843/1702] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 656 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:02.867545 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e016113-39ad-472b-b3eb-437cab46df3f None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:02.868064 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e016113-39ad-472b-b3eb-437cab46df3f None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:02.868607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e016113-39ad-472b-b3eb-437cab46df3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:03.038132 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedee55-678a-4dcc-9258-dd1b50f8a1d6 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:03.038641 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-3e016113-39ad-472b-b3eb-437cab46df3f None None] MFA Rules not processed for user `540e06e694524c4a9e84ebebd45956d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:03.039926 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-3e016113-39ad-472b-b3eb-437cab46df3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:03.050554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09850315-a153-4792-b451-a614b5cf6e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:03.051834 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09850315-a153-4792-b451-a614b5cf6e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:03.052114 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09850315-a153-4792-b451-a614b5cf6e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:03.054894 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09850315-a153-4792-b451-a614b5cf6e5b admin admin] PATH_INFO: `/v3/projects/dcc3c9a21edf4351b014da3a084b289e/users/a994f39277be45ad809f23653bfcf351/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:03.100896 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09850315-a153-4792-b451-a614b5cf6e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcc3c9a21edf4351b014da3a084b289e, user_id=a994f39277be45ad809f23653bfcf351, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:03.103618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09850315-a153-4792-b451-a614b5cf6e5b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:03.135106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 860/1703] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:02 2022] PUT /identity/v3/projects/dcc3c9a21edf4351b014da3a084b289e/users/a994f39277be45ad809f23653bfcf351/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:03.136670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09850315-a153-4792-b451-a614b5cf6e5b admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:03.141342 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-09850315-a153-4792-b451-a614b5cf6e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:03.278104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 844/1704] 10.222.0.69 () {58 vars in 1009 bytes} [Mon Aug 29 21:40:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:03.286901 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e016113-39ad-472b-b3eb-437cab46df3f None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:03.329899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e016113-39ad-472b-b3eb-437cab46df3f None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:03.339730 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09850315-a153-4792-b451-a614b5cf6e5b admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:03.349074 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34ce4f-e7f3-406f-b3ee-0a4b7c259ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:03.349720 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34ce4f-e7f3-406f-b3ee-0a4b7c259ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:03.350002 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34ce4f-e7f3-406f-b3ee-0a4b7c259ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:03.350278 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34ce4f-e7f3-406f-b3ee-0a4b7c259ac6 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:03.350963 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34ce4f-e7f3-406f-b3ee-0a4b7c259ac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:03.353015 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34ce4f-e7f3-406f-b3ee-0a4b7c259ac6 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:03.366798 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe1b7a-8ac7-4853-aa34-c7aa322f04e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:03.367618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe1b7a-8ac7-4853-aa34-c7aa322f04e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:03.367904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe1b7a-8ac7-4853-aa34-c7aa322f04e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:03.368224 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe1b7a-8ac7-4853-aa34-c7aa322f04e6 admin admin] PATH_INFO: `/v3/projects/2114b1ae62b1447fb87a04fdd39cbbc1` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:03.378791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe1b7a-8ac7-4853-aa34-c7aa322f04e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2114b1ae62b1447fb87a04fdd39cbbc1)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:03.380991 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe1b7a-8ac7-4853-aa34-c7aa322f04e6 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:03.477369 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 845/1705] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:03 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:03.482345 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34ce4f-e7f3-406f-b3ee-0a4b7c259ac6 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:03.514240 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:03.531491 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34ce4f-e7f3-406f-b3ee-0a4b7c259ac6 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:03.544554 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5de844-bbd3-4aa8-a062-efaec25bb093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:03.545302 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5de844-bbd3-4aa8-a062-efaec25bb093 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:03.545606 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5de844-bbd3-4aa8-a062-efaec25bb093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:03.546987 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5de844-bbd3-4aa8-a062-efaec25bb093 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:03.547722 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5de844-bbd3-4aa8-a062-efaec25bb093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:03.553721 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5de844-bbd3-4aa8-a062-efaec25bb093 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:03.645995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 846/1706] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:40:03 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:03.649273 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5de844-bbd3-4aa8-a062-efaec25bb093 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:03.657242 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-5d5de844-bbd3-4aa8-a062-efaec25bb093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:03.719133 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-99fe1b7a-8ac7-4853-aa34-c7aa322f04e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2114b1ae62b1447fb87a04fdd39cbbc1', 'request_id': 'req-99fe1b7a-8ac7-4853-aa34-c7aa322f04e6'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:03.776922 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-99fe1b7a-8ac7-4853-aa34-c7aa322f04e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2114b1ae62b1447fb87a04fdd39cbbc1', 'request_id': 'req-99fe1b7a-8ac7-4853-aa34-c7aa322f04e6'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:03.820132 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:03.840068 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-99fe1b7a-8ac7-4853-aa34-c7aa322f04e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2114b1ae62b1447fb87a04fdd39cbbc1', 'request_id': 'req-99fe1b7a-8ac7-4853-aa34-c7aa322f04e6'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:03.948220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-99fe1b7a-8ac7-4853-aa34-c7aa322f04e6 admin admin] The token cache is being invalidate because project 2114b1ae62b1447fb87a04fdd39cbbc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:40:03.948821 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-99fe1b7a-8ac7-4853-aa34-c7aa322f04e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:03.973593 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-99fe1b7a-8ac7-4853-aa34-c7aa322f04e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:03.981892 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 861/1707] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:03 2022] DELETE /identity/v3/projects/2114b1ae62b1447fb87a04fdd39cbbc1 => generated 0 bytes in 846 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:03.989467 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe1b7a-8ac7-4853-aa34-c7aa322f04e6 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:04.003784 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-99fe1b7a-8ac7-4853-aa34-c7aa322f04e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:04.024777 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5de844-bbd3-4aa8-a062-efaec25bb093 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:04.044728 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e4f64-b71c-42eb-95a1-e83df4ddf71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:04.050451 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e4f64-b71c-42eb-95a1-e83df4ddf71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:04.051300 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e4f64-b71c-42eb-95a1-e83df4ddf71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:04.051585 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e4f64-b71c-42eb-95a1-e83df4ddf71a admin admin] PATH_INFO: `/v3/projects/4a0579b784d14dad997a6c84e5cbaf3f` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:04.054139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e4f64-b71c-42eb-95a1-e83df4ddf71a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a0579b784d14dad997a6c84e5cbaf3f)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:04.058905 dv-cinder-854267-3-smb devstack@keystone.service[81659]: WARNING py.warnings [None req-6b2e4f64-b71c-42eb-95a1-e83df4ddf71a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:40:04.058905 dv-cinder-854267-3-smb devstack@keystone.service[81659]: warnings.warn(msg) Aug 29 21:40:04.058905 dv-cinder-854267-3-smb devstack@keystone.service[81659]: Aug 29 21:40:04.060010 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e4f64-b71c-42eb-95a1-e83df4ddf71a admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:04.319704 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6b2e4f64-b71c-42eb-95a1-e83df4ddf71a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a0579b784d14dad997a6c84e5cbaf3f', 'request_id': 'req-6b2e4f64-b71c-42eb-95a1-e83df4ddf71a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:04.397573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6b2e4f64-b71c-42eb-95a1-e83df4ddf71a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a0579b784d14dad997a6c84e5cbaf3f', 'request_id': 'req-6b2e4f64-b71c-42eb-95a1-e83df4ddf71a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:04.418009 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe1b7a-8ac7-4853-aa34-c7aa322f04e6 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:04.434151 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6b2e4f64-b71c-42eb-95a1-e83df4ddf71a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a0579b784d14dad997a6c84e5cbaf3f', 'request_id': 'req-6b2e4f64-b71c-42eb-95a1-e83df4ddf71a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:04.489603 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6b2e4f64-b71c-42eb-95a1-e83df4ddf71a admin admin] The token cache is being invalidate because project 4a0579b784d14dad997a6c84e5cbaf3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:40:04.490534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6b2e4f64-b71c-42eb-95a1-e83df4ddf71a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:04.499798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6b2e4f64-b71c-42eb-95a1-e83df4ddf71a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:04.512260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 847/1708] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:03 2022] DELETE /identity/v3/projects/4a0579b784d14dad997a6c84e5cbaf3f => generated 0 bytes in 865 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:04.515914 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e4f64-b71c-42eb-95a1-e83df4ddf71a admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:04.517601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-6b2e4f64-b71c-42eb-95a1-e83df4ddf71a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:04.632242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bb1ad-7959-4f16-b8b4-d63fae57af2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:04.633208 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bb1ad-7959-4f16-b8b4-d63fae57af2d admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:04.633646 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bb1ad-7959-4f16-b8b4-d63fae57af2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:04.634096 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bb1ad-7959-4f16-b8b4-d63fae57af2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:04.634935 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bb1ad-7959-4f16-b8b4-d63fae57af2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:04.640129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bb1ad-7959-4f16-b8b4-d63fae57af2d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:04.674851 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 862/1709] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 692 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:04.681538 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bb1ad-7959-4f16-b8b4-d63fae57af2d admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:04.684681 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-933bb1ad-7959-4f16-b8b4-d63fae57af2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:04.734878 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e4f64-b71c-42eb-95a1-e83df4ddf71a admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:04.740059 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bb1ad-7959-4f16-b8b4-d63fae57af2d admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:04.757696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a58b7-f04c-4f38-bfbb-596734aa9f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:04.761337 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d15b09-b894-4244-b516-1ed1ddab46ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:04.762327 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d15b09-b894-4244-b516-1ed1ddab46ad admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:04.762612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d15b09-b894-4244-b516-1ed1ddab46ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:04.763551 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d15b09-b894-4244-b516-1ed1ddab46ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:04.763697 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d15b09-b894-4244-b516-1ed1ddab46ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:04.766392 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d15b09-b894-4244-b516-1ed1ddab46ad admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:04.771701 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a58b7-f04c-4f38-bfbb-596734aa9f4b admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:04.773970 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a58b7-f04c-4f38-bfbb-596734aa9f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:04.778348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a58b7-f04c-4f38-bfbb-596734aa9f4b admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:04.779429 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a58b7-f04c-4f38-bfbb-596734aa9f4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:04.786388 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a58b7-f04c-4f38-bfbb-596734aa9f4b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:04.794614 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 848/1710] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:04.795733 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d15b09-b894-4244-b516-1ed1ddab46ad admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:04.798501 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-85d15b09-b894-4244-b516-1ed1ddab46ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:04.825095 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:04.856682 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 863/1711] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:04 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:04.859133 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5ffca-10c8-41f8-b632-36c15b7543bf None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:04.859133 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5ffca-10c8-41f8-b632-36c15b7543bf None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:04.859133 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5ffca-10c8-41f8-b632-36c15b7543bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:04.909766 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-81f5ffca-10c8-41f8-b632-36c15b7543bf None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:04.912881 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-81f5ffca-10c8-41f8-b632-36c15b7543bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:04.942569 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 864/1712] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:04.949989 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5ffca-10c8-41f8-b632-36c15b7543bf None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:04.961552 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-81f5ffca-10c8-41f8-b632-36c15b7543bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:04.985841 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5ffca-10c8-41f8-b632-36c15b7543bf None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:05.003656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978e73a-3077-4bc7-977e-28c6e6bc1c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:05.005067 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978e73a-3077-4bc7-977e-28c6e6bc1c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:05.005585 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978e73a-3077-4bc7-977e-28c6e6bc1c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:05.006049 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978e73a-3077-4bc7-977e-28c6e6bc1c90 admin admin] PATH_INFO: `/v3/users/13f64a2b6f9e409d8641db6401c68854` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:05.008999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978e73a-3077-4bc7-977e-28c6e6bc1c90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13f64a2b6f9e409d8641db6401c68854)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:05.011306 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978e73a-3077-4bc7-977e-28c6e6bc1c90 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:05.159956 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2978e73a-3077-4bc7-977e-28c6e6bc1c90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13f64a2b6f9e409d8641db6401c68854'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:05.181398 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2978e73a-3077-4bc7-977e-28c6e6bc1c90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13f64a2b6f9e409d8641db6401c68854'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:05.193846 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:DELETE=10,keystone:SELECT=85,keystone:INSERT=5 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:05.205100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d15b09-b894-4244-b516-1ed1ddab46ad admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:05.223375 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2978e73a-3077-4bc7-977e-28c6e6bc1c90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13f64a2b6f9e409d8641db6401c68854'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:05.227238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac5aaf-5939-43ff-87e6-1c77f9391507 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '714a2ba019144211931dbe853f1960aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:05.227543 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2978e73a-3077-4bc7-977e-28c6e6bc1c90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13f64a2b6f9e409d8641db6401c68854'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:05.227992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac5aaf-5939-43ff-87e6-1c77f9391507 service swift] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:05.228400 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac5aaf-5939-43ff-87e6-1c77f9391507 service swift] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:05.228640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2978e73a-3077-4bc7-977e-28c6e6bc1c90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13f64a2b6f9e409d8641db6401c68854'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:05.229010 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac5aaf-5939-43ff-87e6-1c77f9391507 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:05.232044 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-ebac5aaf-5939-43ff-87e6-1c77f9391507 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:05.266979 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 865/1713] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:40:04 2022] DELETE /identity/v3/users/13f64a2b6f9e409d8641db6401c68854 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:05.272300 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978e73a-3077-4bc7-977e-28c6e6bc1c90 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:05.273947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2978e73a-3077-4bc7-977e-28c6e6bc1c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:05.369961 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac5aaf-5939-43ff-87e6-1c77f9391507 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:05.371622 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac5aaf-5939-43ff-87e6-1c77f9391507 service swift] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:05.406324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 849/1714] 10.222.0.69 () {60 vars in 1384 bytes} [Mon Aug 29 21:40:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:40:05.407234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac5aaf-5939-43ff-87e6-1c77f9391507 service swift] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:05.409399 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-ebac5aaf-5939-43ff-87e6-1c77f9391507 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:05.429538 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978e73a-3077-4bc7-977e-28c6e6bc1c90 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:05.438224 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d3b4f-f140-43da-8c94-eea02735ea41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:05.439215 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d3b4f-f140-43da-8c94-eea02735ea41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:05.439653 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d3b4f-f140-43da-8c94-eea02735ea41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:05.441304 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d3b4f-f140-43da-8c94-eea02735ea41 admin admin] PATH_INFO: `/v3/projects/dcc3c9a21edf4351b014da3a084b289e/users/a994f39277be45ad809f23653bfcf351/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:05.444859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d3b4f-f140-43da-8c94-eea02735ea41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcc3c9a21edf4351b014da3a084b289e, user_id=a994f39277be45ad809f23653bfcf351, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:05.451467 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac5aaf-5939-43ff-87e6-1c77f9391507 service swift] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:05.466815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a569e07-d649-4c40-8cd0-a6c1129eec22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:05.467259 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a569e07-d649-4c40-8cd0-a6c1129eec22 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:05.467803 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a569e07-d649-4c40-8cd0-a6c1129eec22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:05.468267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a569e07-d649-4c40-8cd0-a6c1129eec22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:05.468931 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a569e07-d649-4c40-8cd0-a6c1129eec22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:05.470626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a569e07-d649-4c40-8cd0-a6c1129eec22 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:05.477797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d3b4f-f140-43da-8c94-eea02735ea41 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:05.501247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 850/1715] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:05.506750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a569e07-d649-4c40-8cd0-a6c1129eec22 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:05.510703 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-9a569e07-d649-4c40-8cd0-a6c1129eec22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:05.543361 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 866/1716] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:05 2022] PUT /identity/v3/projects/dcc3c9a21edf4351b014da3a084b289e/users/a994f39277be45ad809f23653bfcf351/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:05.546032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a569e07-d649-4c40-8cd0-a6c1129eec22 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:05.549727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18bb16-391c-4a4d-968a-791a597c16dd None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:05.551640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18bb16-391c-4a4d-968a-791a597c16dd None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:05.552950 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18bb16-391c-4a4d-968a-791a597c16dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:05.682486 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-be18bb16-391c-4a4d-968a-791a597c16dd None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:05.686040 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-be18bb16-391c-4a4d-968a-791a597c16dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:05.818569 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455e914-2d42-472f-93fb-e5733278656d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:05.821618 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455e914-2d42-472f-93fb-e5733278656d admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:05.829483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455e914-2d42-472f-93fb-e5733278656d admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:05.830165 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455e914-2d42-472f-93fb-e5733278656d admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:05.833545 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455e914-2d42-472f-93fb-e5733278656d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:05.835540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455e914-2d42-472f-93fb-e5733278656d admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:05.907779 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 851/1717] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:05.909440 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ee1c8-6d0a-4351-9bca-e5fb4ef6bd85 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:05.916781 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ee1c8-6d0a-4351-9bca-e5fb4ef6bd85 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:05.918963 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ee1c8-6d0a-4351-9bca-e5fb4ef6bd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:06.002889 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-e35ee1c8-6d0a-4351-9bca-e5fb4ef6bd85 None None] MFA Rules not processed for user `07cf908926af48e8b7d96f96d026254a`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:06.011535 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-e35ee1c8-6d0a-4351-9bca-e5fb4ef6bd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:06.051925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:06.114985 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 867/1718] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 571 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:06.144086 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18bb16-391c-4a4d-968a-791a597c16dd None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:06.206089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18bb16-391c-4a4d-968a-791a597c16dd None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:06.250500 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d41a0-eb3e-40b2-a41f-16bb84c68ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:06.256618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d41a0-eb3e-40b2-a41f-16bb84c68ede admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:06.260054 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d41a0-eb3e-40b2-a41f-16bb84c68ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:06.266498 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d41a0-eb3e-40b2-a41f-16bb84c68ede admin admin] PATH_INFO: `/v3/projects/510e7ba9e7f84d76a98ebb82899d8ed3/users/9a6feb6779f748afb293a12b2195c09b/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:06.294368 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 852/1719] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:06.295633 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ee1c8-6d0a-4351-9bca-e5fb4ef6bd85 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:06.347341 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ee1c8-6d0a-4351-9bca-e5fb4ef6bd85 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:06.371356 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee31028-bd38-4c33-9e40-87deb089da77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:06.372056 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee31028-bd38-4c33-9e40-87deb089da77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:06.372448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee31028-bd38-4c33-9e40-87deb089da77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:06.372753 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee31028-bd38-4c33-9e40-87deb089da77 admin admin] PATH_INFO: `/v3/projects/b2c76b97605c4197b2dbeae75d8660f0/users/f7ac32ba9f5948518856d1e93df7f3a9/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:06.421372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee31028-bd38-4c33-9e40-87deb089da77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2c76b97605c4197b2dbeae75d8660f0, user_id=f7ac32ba9f5948518856d1e93df7f3a9, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:06.434913 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee31028-bd38-4c33-9e40-87deb089da77 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:06.457872 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d41a0-eb3e-40b2-a41f-16bb84c68ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=510e7ba9e7f84d76a98ebb82899d8ed3, user_id=9a6feb6779f748afb293a12b2195c09b, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:06.479138 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d41a0-eb3e-40b2-a41f-16bb84c68ede admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:06.572359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 868/1721] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:06 2022] PUT /identity/v3/projects/510e7ba9e7f84d76a98ebb82899d8ed3/users/9a6feb6779f748afb293a12b2195c09b/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:06.572359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d41a0-eb3e-40b2-a41f-16bb84c68ede admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:06.572768 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 853/1721] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:06 2022] PUT /identity/v3/projects/b2c76b97605c4197b2dbeae75d8660f0/users/f7ac32ba9f5948518856d1e93df7f3a9/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:06.574228 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de21284-87cf-4e71-863c-d37cec9b0fd9 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:06.586013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de21284-87cf-4e71-863c-d37cec9b0fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:06.587975 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de21284-87cf-4e71-863c-d37cec9b0fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:06.689812 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-7de21284-87cf-4e71-863c-d37cec9b0fd9 None None] MFA Rules not processed for user `dfa16ba58c0040f8bdfa5e46f2681395`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:06.705460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-7de21284-87cf-4e71-863c-d37cec9b0fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:06.852747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:06.910929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d41a0-eb3e-40b2-a41f-16bb84c68ede admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:06.937641 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bdc76-952a-4ed6-9d3e-3b636e3da4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:06.938893 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bdc76-952a-4ed6-9d3e-3b636e3da4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:06.939364 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bdc76-952a-4ed6-9d3e-3b636e3da4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:06.939852 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bdc76-952a-4ed6-9d3e-3b636e3da4f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:06.941132 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546bdc76-952a-4ed6-9d3e-3b636e3da4f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:40:06.941691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546bdc76-952a-4ed6-9d3e-3b636e3da4f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:06.944813 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546bdc76-952a-4ed6-9d3e-3b636e3da4f0 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:06.987693 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 854/1722] 10.222.0.70 () {58 vars in 1015 bytes} [Mon Aug 29 21:40:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:06.992274 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694d157-60d7-442d-a9aa-b4ed9fb60959 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:06.992754 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694d157-60d7-442d-a9aa-b4ed9fb60959 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:06.993239 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694d157-60d7-442d-a9aa-b4ed9fb60959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:06.999749 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 869/1723] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:40:07.005112 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bdc76-952a-4ed6-9d3e-3b636e3da4f0 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:07.046537 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bdc76-952a-4ed6-9d3e-3b636e3da4f0 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:07.067268 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af67c9-8139-4d7a-a33e-1d01ace3b444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:07.068295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af67c9-8139-4d7a-a33e-1d01ace3b444 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:07.068762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af67c9-8139-4d7a-a33e-1d01ace3b444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:07.069206 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af67c9-8139-4d7a-a33e-1d01ace3b444 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:07.070654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af67c9-8139-4d7a-a33e-1d01ace3b444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:07.077164 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af67c9-8139-4d7a-a33e-1d01ace3b444 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:07.126342 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 870/1724] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:07.131451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7014f-60fe-4ee7-925c-7802153c4e69 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:07.131870 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-6694d157-60d7-442d-a9aa-b4ed9fb60959 None None] MFA Rules not processed for user `879820719cb244f28f29b76947334112`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:07.132027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7014f-60fe-4ee7-925c-7802153c4e69 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:07.132351 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7014f-60fe-4ee7-925c-7802153c4e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:07.138639 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-6694d157-60d7-442d-a9aa-b4ed9fb60959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:07.250984 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-34a7014f-60fe-4ee7-925c-7802153c4e69 None None] MFA Rules not processed for user `9a6feb6779f748afb293a12b2195c09b`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:07.253808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-34a7014f-60fe-4ee7-925c-7802153c4e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:07.506254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 871/1725] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:07.507973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 855/1726] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 520 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:07.509033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694d157-60d7-442d-a9aa-b4ed9fb60959 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:07.509283 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7014f-60fe-4ee7-925c-7802153c4e69 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:07.530347 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7014f-60fe-4ee7-925c-7802153c4e69 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:07.540921 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694d157-60d7-442d-a9aa-b4ed9fb60959 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:07.541392 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917851d-baf0-4c4e-82d1-a166914951de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:07.542357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917851d-baf0-4c4e-82d1-a166914951de admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:07.542945 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917851d-baf0-4c4e-82d1-a166914951de admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:07.543452 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917851d-baf0-4c4e-82d1-a166914951de admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:07.544383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917851d-baf0-4c4e-82d1-a166914951de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:07.547451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917851d-baf0-4c4e-82d1-a166914951de admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:07.558012 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2adfbb-5f93-4ad7-970c-e6588916ece5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:07.558599 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2adfbb-5f93-4ad7-970c-e6588916ece5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:07.558755 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2adfbb-5f93-4ad7-970c-e6588916ece5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:07.559041 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2adfbb-5f93-4ad7-970c-e6588916ece5 admin admin] PATH_INFO: `/v3/projects/b2c76b97605c4197b2dbeae75d8660f0/users/f7ac32ba9f5948518856d1e93df7f3a9/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:07.575247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2adfbb-5f93-4ad7-970c-e6588916ece5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2c76b97605c4197b2dbeae75d8660f0, user_id=f7ac32ba9f5948518856d1e93df7f3a9, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:07.578384 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2adfbb-5f93-4ad7-970c-e6588916ece5 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:07.609766 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 872/1727] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:40:07 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:07.610744 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917851d-baf0-4c4e-82d1-a166914951de admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:07.616256 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4917851d-baf0-4c4e-82d1-a166914951de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:07.624398 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 856/1728] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:07 2022] PUT /identity/v3/projects/b2c76b97605c4197b2dbeae75d8660f0/users/f7ac32ba9f5948518856d1e93df7f3a9/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:07.625654 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2adfbb-5f93-4ad7-970c-e6588916ece5 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:07.671647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:07.752005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2adfbb-5f93-4ad7-970c-e6588916ece5 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:07.804597 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917851d-baf0-4c4e-82d1-a166914951de admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:07.815611 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d8c84-e50e-49c7-86be-c54b41208d80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:07.818863 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d8c84-e50e-49c7-86be-c54b41208d80 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:07.819298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d8c84-e50e-49c7-86be-c54b41208d80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:07.819657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d8c84-e50e-49c7-86be-c54b41208d80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:07.840320 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d8c84-e50e-49c7-86be-c54b41208d80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:07.841434 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d8c84-e50e-49c7-86be-c54b41208d80 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:07.867373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 873/1729] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:07.869061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8759f-3c12-44d7-ab20-86c0252716d2 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:07.871825 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8759f-3c12-44d7-ab20-86c0252716d2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:07.872102 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8759f-3c12-44d7-ab20-86c0252716d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:07.886136 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06074193-21f4-4708-9b35-2af7aaea3a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:07.886788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06074193-21f4-4708-9b35-2af7aaea3a87 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:07.887071 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06074193-21f4-4708-9b35-2af7aaea3a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:07.887349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06074193-21f4-4708-9b35-2af7aaea3a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:07.888002 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06074193-21f4-4708-9b35-2af7aaea3a87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:07.890022 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06074193-21f4-4708-9b35-2af7aaea3a87 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:07.916864 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-24b8759f-3c12-44d7-ab20-86c0252716d2 None None] MFA Rules not processed for user `879820719cb244f28f29b76947334112`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:07.918143 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-24b8759f-3c12-44d7-ab20-86c0252716d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:07.999367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 857/1730] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:40:07 2022] POST /identity/v3/projects => generated 383 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:08.000479 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06074193-21f4-4708-9b35-2af7aaea3a87 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:08.021808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:08.068168 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 874/1731] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:08.069859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabd437-82fe-444b-834c-055234049c54 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:08.070153 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabd437-82fe-444b-834c-055234049c54 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:08.070436 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabd437-82fe-444b-834c-055234049c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:08.149529 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-cdabd437-82fe-444b-834c-055234049c54 None None] MFA Rules not processed for user `f7ac32ba9f5948518856d1e93df7f3a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:08.151379 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cdabd437-82fe-444b-834c-055234049c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:08.312207 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06074193-21f4-4708-9b35-2af7aaea3a87 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:08.321873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734fa4f-d4ef-49e7-8cfc-267f6bf6c71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:08.322663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734fa4f-d4ef-49e7-8cfc-267f6bf6c71f admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:08.322957 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734fa4f-d4ef-49e7-8cfc-267f6bf6c71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:08.323289 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734fa4f-d4ef-49e7-8cfc-267f6bf6c71f admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:08.324120 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734fa4f-d4ef-49e7-8cfc-267f6bf6c71f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:08.331196 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734fa4f-d4ef-49e7-8cfc-267f6bf6c71f admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:08.348889 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 875/1732] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:08.350816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabd437-82fe-444b-834c-055234049c54 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:08.384849 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 858/1733] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:07 2022] POST /identity/v3/users => generated 284 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:08.385877 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734fa4f-d4ef-49e7-8cfc-267f6bf6c71f admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:08.388513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-0734fa4f-d4ef-49e7-8cfc-267f6bf6c71f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:08.388771 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabd437-82fe-444b-834c-055234049c54 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:08.427230 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a02718-9827-4d3b-b01b-8f03b417c56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:08.428224 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a02718-9827-4d3b-b01b-8f03b417c56e admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:08.428677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a02718-9827-4d3b-b01b-8f03b417c56e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:08.429017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a02718-9827-4d3b-b01b-8f03b417c56e admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:08.429952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a02718-9827-4d3b-b01b-8f03b417c56e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:08.433109 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a02718-9827-4d3b-b01b-8f03b417c56e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:08.509649 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:08.518920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 876/1734] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:08 2022] POST /identity/v3/users => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:08.521579 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a02718-9827-4d3b-b01b-8f03b417c56e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:08.561438 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a02718-9827-4d3b-b01b-8f03b417c56e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:08.570236 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734fa4f-d4ef-49e7-8cfc-267f6bf6c71f admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:08.580759 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c5239-b68a-4d4f-a9e9-d907834a789a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:08.584993 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c5239-b68a-4d4f-a9e9-d907834a789a service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:08.585897 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c5239-b68a-4d4f-a9e9-d907834a789a service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:08.586363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c5239-b68a-4d4f-a9e9-d907834a789a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:08.587418 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8afc2-fc0a-483e-ba0b-c5c1f05c0bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:08.588165 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8afc2-fc0a-483e-ba0b-c5c1f05c0bad admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:08.588436 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8afc2-fc0a-483e-ba0b-c5c1f05c0bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:08.588720 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8afc2-fc0a-483e-ba0b-c5c1f05c0bad admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:08.589600 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8afc2-fc0a-483e-ba0b-c5c1f05c0bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:08.591244 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8afc2-fc0a-483e-ba0b-c5c1f05c0bad admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:08.636070 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 877/1735] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:08.637036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8afc2-fc0a-483e-ba0b-c5c1f05c0bad admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:08.650953 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cfe8afc2-fc0a-483e-ba0b-c5c1f05c0bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:08.680783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c5239-b68a-4d4f-a9e9-d907834a789a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:08.683125 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c5239-b68a-4d4f-a9e9-d907834a789a service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:08.702746 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 859/1736] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:08.704419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c5239-b68a-4d4f-a9e9-d907834a789a service nova] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:08.744215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c5239-b68a-4d4f-a9e9-d907834a789a service nova] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:08.764515 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4d0a0-1fcc-4802-89cb-fcb1b1838ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:08.765194 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4d0a0-1fcc-4802-89cb-fcb1b1838ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:08.765475 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4d0a0-1fcc-4802-89cb-fcb1b1838ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:08.765748 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4d0a0-1fcc-4802-89cb-fcb1b1838ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:08.766440 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4d0a0-1fcc-4802-89cb-fcb1b1838ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:08.769625 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4d0a0-1fcc-4802-89cb-fcb1b1838ba0 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:08.797941 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 860/1737] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:08.798941 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4d0a0-1fcc-4802-89cb-fcb1b1838ba0 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:08.827442 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4d0a0-1fcc-4802-89cb-fcb1b1838ba0 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:08.849555 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8afc2-fc0a-483e-ba0b-c5c1f05c0bad admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:08.855685 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdc762-4ca6-4a6a-9cdb-0a6ccc6e321e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:08.857660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e35ab-049b-4d6a-ad24-bd67d9de3364 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:08.858872 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdc762-4ca6-4a6a-9cdb-0a6ccc6e321e admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:08.859752 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e35ab-049b-4d6a-ad24-bd67d9de3364 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:08.860034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e35ab-049b-4d6a-ad24-bd67d9de3364 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:08.860659 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdc762-4ca6-4a6a-9cdb-0a6ccc6e321e admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:08.860960 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdc762-4ca6-4a6a-9cdb-0a6ccc6e321e admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:08.861345 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e35ab-049b-4d6a-ad24-bd67d9de3364 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:08.862434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbdc762-4ca6-4a6a-9cdb-0a6ccc6e321e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:08.870721 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbdc762-4ca6-4a6a-9cdb-0a6ccc6e321e admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:08.892930 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e35ab-049b-4d6a-ad24-bd67d9de3364 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:08.894381 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e35ab-049b-4d6a-ad24-bd67d9de3364 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:08.914353 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 861/1738] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:08.914353 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdc762-4ca6-4a6a-9cdb-0a6ccc6e321e admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:08.930309 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 878/1739] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:08.931215 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e35ab-049b-4d6a-ad24-bd67d9de3364 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:08.935829 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdc762-4ca6-4a6a-9cdb-0a6ccc6e321e admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:08.952327 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e35ab-049b-4d6a-ad24-bd67d9de3364 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:08.954354 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd93d4e-1e10-40cc-a03c-05082fdbd125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:08.955392 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd93d4e-1e10-40cc-a03c-05082fdbd125 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:08.956288 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd93d4e-1e10-40cc-a03c-05082fdbd125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:08.956867 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd93d4e-1e10-40cc-a03c-05082fdbd125 admin admin] PATH_INFO: `/v3/projects/0a68c4bf2a2a4eae88d90728ebb46df5/users/e692d8890f884ee0aebbf510a41da09e/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:08.966409 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62529f13-5273-4b6e-a493-0faa69426a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:08.967585 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62529f13-5273-4b6e-a493-0faa69426a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:08.967925 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62529f13-5273-4b6e-a493-0faa69426a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:08.968389 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62529f13-5273-4b6e-a493-0faa69426a97 admin admin] PATH_INFO: `/v3/projects/76b6a49c587743d1ada58abc255c059a/users/3aa42fad882e4e31b612c6141b5cf946/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:09.014837 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62529f13-5273-4b6e-a493-0faa69426a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b6a49c587743d1ada58abc255c059a, user_id=3aa42fad882e4e31b612c6141b5cf946, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:09.021507 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62529f13-5273-4b6e-a493-0faa69426a97 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:09.036247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd93d4e-1e10-40cc-a03c-05082fdbd125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a68c4bf2a2a4eae88d90728ebb46df5, user_id=e692d8890f884ee0aebbf510a41da09e, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:09.049099 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd93d4e-1e10-40cc-a03c-05082fdbd125 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:09.067391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 879/1740] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:08 2022] PUT /identity/v3/projects/76b6a49c587743d1ada58abc255c059a/users/3aa42fad882e4e31b612c6141b5cf946/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:09.072224 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc6b84-df00-4d2f-9866-2dbf65fb2f14 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:09.072224 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc6b84-df00-4d2f-9866-2dbf65fb2f14 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:09.072224 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc6b84-df00-4d2f-9866-2dbf65fb2f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:09.107907 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 862/1741] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:08 2022] PUT /identity/v3/projects/0a68c4bf2a2a4eae88d90728ebb46df5/users/e692d8890f884ee0aebbf510a41da09e/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:09.114416 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd93d4e-1e10-40cc-a03c-05082fdbd125 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:09.185379 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-b7bc6b84-df00-4d2f-9866-2dbf65fb2f14 None None] MFA Rules not processed for user `3aa42fad882e4e31b612c6141b5cf946`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:09.186992 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b7bc6b84-df00-4d2f-9866-2dbf65fb2f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:09.242955 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:09.410016 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd93d4e-1e10-40cc-a03c-05082fdbd125 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:09.412349 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 880/1742] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:40:09.413727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc6b84-df00-4d2f-9866-2dbf65fb2f14 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:09.425943 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009b4b4-9484-49d8-83fb-d16ec050ba8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:09.429834 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009b4b4-9484-49d8-83fb-d16ec050ba8d admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:09.431009 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009b4b4-9484-49d8-83fb-d16ec050ba8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:09.431849 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009b4b4-9484-49d8-83fb-d16ec050ba8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:09.434157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009b4b4-9484-49d8-83fb-d16ec050ba8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:09.438756 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009b4b4-9484-49d8-83fb-d16ec050ba8d admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:09.482076 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 863/1743] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:40:09.484158 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009b4b4-9484-49d8-83fb-d16ec050ba8d admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:09.519387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009b4b4-9484-49d8-83fb-d16ec050ba8d admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:09.529354 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16363b78-8a23-405d-9bf7-d7eca678d875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:09.531056 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16363b78-8a23-405d-9bf7-d7eca678d875 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:09.531507 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16363b78-8a23-405d-9bf7-d7eca678d875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:09.533968 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16363b78-8a23-405d-9bf7-d7eca678d875 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:09.537420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16363b78-8a23-405d-9bf7-d7eca678d875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:09.541808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16363b78-8a23-405d-9bf7-d7eca678d875 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:09.561597 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc6b84-df00-4d2f-9866-2dbf65fb2f14 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:09.566364 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab702f6-c75c-41b1-a52c-aa7f09303483 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:09.567495 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab702f6-c75c-41b1-a52c-aa7f09303483 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:09.567782 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab702f6-c75c-41b1-a52c-aa7f09303483 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:09.568061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab702f6-c75c-41b1-a52c-aa7f09303483 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:09.570252 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5ab702f6-c75c-41b1-a52c-aa7f09303483 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:09.655525 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 864/1744] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:40:09 2022] POST /identity/v3/projects => generated 369 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:09.658341 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16363b78-8a23-405d-9bf7-d7eca678d875 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:09.702258 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:09.761484 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab702f6-c75c-41b1-a52c-aa7f09303483 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:09.764900 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab702f6-c75c-41b1-a52c-aa7f09303483 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:09.805303 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 881/1745] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:09.805303 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab702f6-c75c-41b1-a52c-aa7f09303483 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:09.805962 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5ab702f6-c75c-41b1-a52c-aa7f09303483 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:09.827922 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab702f6-c75c-41b1-a52c-aa7f09303483 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:09.949916 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16363b78-8a23-405d-9bf7-d7eca678d875 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:09.961702 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4ab56-7739-4835-ae55-f7627d55a63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:09.962908 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4ab56-7739-4835-ae55-f7627d55a63c admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:09.963385 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4ab56-7739-4835-ae55-f7627d55a63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:09.963839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4ab56-7739-4835-ae55-f7627d55a63c admin admin] PATH_INFO: `/v3/projects/0a68c4bf2a2a4eae88d90728ebb46df5/users/e692d8890f884ee0aebbf510a41da09e/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:09.968948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4ab56-7739-4835-ae55-f7627d55a63c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a68c4bf2a2a4eae88d90728ebb46df5, user_id=e692d8890f884ee0aebbf510a41da09e, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:09.979941 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4ab56-7739-4835-ae55-f7627d55a63c admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:10.015680 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 865/1746] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:09 2022] PUT /identity/v3/projects/0a68c4bf2a2a4eae88d90728ebb46df5/users/e692d8890f884ee0aebbf510a41da09e/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:10.017165 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4ab56-7739-4835-ae55-f7627d55a63c admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:10.129573 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232086d-1a46-4d61-9f90-5df990903cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:10.130424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232086d-1a46-4d61-9f90-5df990903cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:10.130782 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232086d-1a46-4d61-9f90-5df990903cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:10.131198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232086d-1a46-4d61-9f90-5df990903cda admin admin] PATH_INFO: `/v3/projects/732b4a7d282d47429c2b964a404797d8` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:10.137295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232086d-1a46-4d61-9f90-5df990903cda admin admin] RBAC: Authorizing `identity:delete_project(project_id=732b4a7d282d47429c2b964a404797d8)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:10.139386 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232086d-1a46-4d61-9f90-5df990903cda admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:10.161128 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:10.312388 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d232086d-1a46-4d61-9f90-5df990903cda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '732b4a7d282d47429c2b964a404797d8', 'request_id': 'req-d232086d-1a46-4d61-9f90-5df990903cda'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:10.335166 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d232086d-1a46-4d61-9f90-5df990903cda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '732b4a7d282d47429c2b964a404797d8', 'request_id': 'req-d232086d-1a46-4d61-9f90-5df990903cda'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:10.351407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d232086d-1a46-4d61-9f90-5df990903cda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '732b4a7d282d47429c2b964a404797d8', 'request_id': 'req-d232086d-1a46-4d61-9f90-5df990903cda'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:10.373281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d232086d-1a46-4d61-9f90-5df990903cda admin admin] The token cache is being invalidate because project 732b4a7d282d47429c2b964a404797d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:40:10.373568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d232086d-1a46-4d61-9f90-5df990903cda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:10.378343 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d232086d-1a46-4d61-9f90-5df990903cda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:10.380996 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 882/1747] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:09 2022] DELETE /identity/v3/projects/732b4a7d282d47429c2b964a404797d8 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:10.382697 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fac9bc-6bda-4d25-b107-06c63ac3421b None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:10.383185 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fac9bc-6bda-4d25-b107-06c63ac3421b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:10.385918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fac9bc-6bda-4d25-b107-06c63ac3421b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:10.468472 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-e6fac9bc-6bda-4d25-b107-06c63ac3421b None None] MFA Rules not processed for user `a994f39277be45ad809f23653bfcf351`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:10.470341 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e6fac9bc-6bda-4d25-b107-06c63ac3421b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:10.655511 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 883/1748] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:10 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:10.657926 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748fc44-0312-4ba3-955d-01a898cf1464 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:10.658464 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748fc44-0312-4ba3-955d-01a898cf1464 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:10.658957 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748fc44-0312-4ba3-955d-01a898cf1464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:10.697665 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4ab56-7739-4835-ae55-f7627d55a63c admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:10.742152 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d748fc44-0312-4ba3-955d-01a898cf1464 None None] MFA Rules not processed for user `e692d8890f884ee0aebbf510a41da09e`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:10.747345 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d748fc44-0312-4ba3-955d-01a898cf1464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:11.007392 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 884/1749] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:11.009049 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10df41-8476-40af-b3fe-a16944112122 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:11.009459 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10df41-8476-40af-b3fe-a16944112122 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:11.009836 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10df41-8476-40af-b3fe-a16944112122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:11.056136 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:11.063174 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-da10df41-8476-40af-b3fe-a16944112122 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:11.065023 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-da10df41-8476-40af-b3fe-a16944112122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:11.095829 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df5a61-a0a3-49cb-8cea-7fc52716248b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:11.098028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df5a61-a0a3-49cb-8cea-7fc52716248b admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:11.098028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df5a61-a0a3-49cb-8cea-7fc52716248b admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:11.099953 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df5a61-a0a3-49cb-8cea-7fc52716248b admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:11.104142 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df5a61-a0a3-49cb-8cea-7fc52716248b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:11.119222 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df5a61-a0a3-49cb-8cea-7fc52716248b admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:11.184026 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 885/1750] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:11.185330 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10df41-8476-40af-b3fe-a16944112122 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:11.187031 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-da10df41-8476-40af-b3fe-a16944112122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:11.241564 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 866/1751] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:10 2022] POST /identity/v3/users => generated 291 bytes in 1226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:11.247359 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1621e80-cf1a-4f90-8343-d43ae56ff1d8 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:11.247719 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1621e80-cf1a-4f90-8343-d43ae56ff1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:11.248003 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1621e80-cf1a-4f90-8343-d43ae56ff1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:11.334335 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-d1621e80-cf1a-4f90-8343-d43ae56ff1d8 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:11.337262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-d1621e80-cf1a-4f90-8343-d43ae56ff1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:11.341474 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10df41-8476-40af-b3fe-a16944112122 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:11.366884 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb70cd-412b-47f6-a8e8-e9fb65db7301 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:11.367685 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb70cd-412b-47f6-a8e8-e9fb65db7301 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:11.368040 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb70cd-412b-47f6-a8e8-e9fb65db7301 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:11.368410 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb70cd-412b-47f6-a8e8-e9fb65db7301 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:11.373937 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5ddb70cd-412b-47f6-a8e8-e9fb65db7301 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:11.374712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 867/1752] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:11.378519 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1621e80-cf1a-4f90-8343-d43ae56ff1d8 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:11.384326 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-d1621e80-cf1a-4f90-8343-d43ae56ff1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:11.437419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1621e80-cf1a-4f90-8343-d43ae56ff1d8 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:11.475607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65b1fa-7867-4865-a4d0-d5754e6f85ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:11.477375 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65b1fa-7867-4865-a4d0-d5754e6f85ca admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:11.477651 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65b1fa-7867-4865-a4d0-d5754e6f85ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:11.486874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65b1fa-7867-4865-a4d0-d5754e6f85ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:11.487758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65b1fa-7867-4865-a4d0-d5754e6f85ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:11.490866 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65b1fa-7867-4865-a4d0-d5754e6f85ca admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:11.559910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 868/1753] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:11.568525 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65b1fa-7867-4865-a4d0-d5754e6f85ca admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:11.611465 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb70cd-412b-47f6-a8e8-e9fb65db7301 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:11.621758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb70cd-412b-47f6-a8e8-e9fb65db7301 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:11.654381 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65b1fa-7867-4865-a4d0-d5754e6f85ca admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:11.710987 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 886/1754] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:11.719656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53853bdf-b678-4090-b32c-c99706890d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:11.721724 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53853bdf-b678-4090-b32c-c99706890d3d admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:11.724246 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53853bdf-b678-4090-b32c-c99706890d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:11.726769 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53853bdf-b678-4090-b32c-c99706890d3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:11.727970 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf3b93-689b-4dd7-b78b-30c338e387b7 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:11.730568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf3b93-689b-4dd7-b78b-30c338e387b7 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:11.731911 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf3b93-689b-4dd7-b78b-30c338e387b7 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:11.732597 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53853bdf-b678-4090-b32c-c99706890d3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:40:11.734942 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53853bdf-b678-4090-b32c-c99706890d3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:11.747347 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53853bdf-b678-4090-b32c-c99706890d3d admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:11.761301 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 887/1755] 10.222.0.69 () {54 vars in 912 bytes} [Mon Aug 29 21:40:11 2022] GET /identity => generated 270 bytes in 49 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:40:11.764216 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf3b93-689b-4dd7-b78b-30c338e387b7 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:11.808944 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf3b93-689b-4dd7-b78b-30c338e387b7 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:11.828054 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91758b-d769-4332-85c3-99d2ec688b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:11.829141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91758b-d769-4332-85c3-99d2ec688b68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:11.829827 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91758b-d769-4332-85c3-99d2ec688b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:11.830516 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91758b-d769-4332-85c3-99d2ec688b68 admin admin] PATH_INFO: `/v3/projects/48621a6c00b1442cbb1c0f54a956b760/users/e44a075756b0406289c6fba9873e136a/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:11.833431 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 869/1756] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:40:11.838883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf82c5-9d3b-49d6-82db-7af36ea9e021 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:11.842886 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf82c5-9d3b-49d6-82db-7af36ea9e021 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:11.843687 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf82c5-9d3b-49d6-82db-7af36ea9e021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:11.870891 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91758b-d769-4332-85c3-99d2ec688b68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48621a6c00b1442cbb1c0f54a956b760, user_id=e44a075756b0406289c6fba9873e136a, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:11.881330 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91758b-d769-4332-85c3-99d2ec688b68 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:11.906279 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:11.915555 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 888/1757] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:11 2022] PUT /identity/v3/projects/48621a6c00b1442cbb1c0f54a956b760/users/e44a075756b0406289c6fba9873e136a/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:11.915555 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91758b-d769-4332-85c3-99d2ec688b68 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:11.930750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-94bf82c5-9d3b-49d6-82db-7af36ea9e021 None None] MFA Rules not processed for user `dfa16ba58c0040f8bdfa5e46f2681395`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:11.934914 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-94bf82c5-9d3b-49d6-82db-7af36ea9e021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:12.044396 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:12.136139 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91758b-d769-4332-85c3-99d2ec688b68 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:12.182098 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317dbabb-ad22-480c-a0fb-3f84ad346d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:12.183517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dbabb-ad22-480c-a0fb-3f84ad346d0d admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:12.189412 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dbabb-ad22-480c-a0fb-3f84ad346d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:12.191675 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dbabb-ad22-480c-a0fb-3f84ad346d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:12.197283 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317dbabb-ad22-480c-a0fb-3f84ad346d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:12.231219 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317dbabb-ad22-480c-a0fb-3f84ad346d0d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:12.275798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 870/1758] 10.222.0.69 () {58 vars in 1009 bytes} [Mon Aug 29 21:40:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:12.281669 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf82c5-9d3b-49d6-82db-7af36ea9e021 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:12.379114 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf82c5-9d3b-49d6-82db-7af36ea9e021 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:12.409527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa12d4-7bff-4432-bcb1-8f5bd16ea653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:12.417419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa12d4-7bff-4432-bcb1-8f5bd16ea653 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:12.418295 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa12d4-7bff-4432-bcb1-8f5bd16ea653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:12.418911 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa12d4-7bff-4432-bcb1-8f5bd16ea653 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:12.423173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa12d4-7bff-4432-bcb1-8f5bd16ea653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:12.435118 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa12d4-7bff-4432-bcb1-8f5bd16ea653 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:12.435356 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 889/1759] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:40:11 2022] POST /identity/v3/projects => generated 369 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:12.438883 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317dbabb-ad22-480c-a0fb-3f84ad346d0d admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:12.494667 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 871/1760] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:12.499701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa12d4-7bff-4432-bcb1-8f5bd16ea653 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:12.513068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-80fa12d4-7bff-4432-bcb1-8f5bd16ea653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:12.580939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa12d4-7bff-4432-bcb1-8f5bd16ea653 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:12.816138 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687693c-68d9-47ad-b183-5604c689722b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:12.818644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687693c-68d9-47ad-b183-5604c689722b service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:12.819096 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687693c-68d9-47ad-b183-5604c689722b service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:12.820159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687693c-68d9-47ad-b183-5604c689722b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:12.867649 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687693c-68d9-47ad-b183-5604c689722b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:12.869207 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687693c-68d9-47ad-b183-5604c689722b service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:12.874825 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317dbabb-ad22-480c-a0fb-3f84ad346d0d admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:12.891022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465ffde-616c-48d7-a7ec-2283b772c06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:12.892026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 872/1761] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:12.892919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465ffde-616c-48d7-a7ec-2283b772c06c admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:12.894192 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465ffde-616c-48d7-a7ec-2283b772c06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:12.895432 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465ffde-616c-48d7-a7ec-2283b772c06c admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:12.896864 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465ffde-616c-48d7-a7ec-2283b772c06c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:12.897052 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687693c-68d9-47ad-b183-5604c689722b service neutron] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:12.899738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465ffde-616c-48d7-a7ec-2283b772c06c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:12.916474 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687693c-68d9-47ad-b183-5604c689722b service neutron] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:12.927618 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49419ec-0a12-4e9f-8e5a-85637e59df6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:12.927618 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49419ec-0a12-4e9f-8e5a-85637e59df6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:12.927618 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49419ec-0a12-4e9f-8e5a-85637e59df6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:12.927618 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49419ec-0a12-4e9f-8e5a-85637e59df6a admin admin] PATH_INFO: `/v3/projects/48621a6c00b1442cbb1c0f54a956b760/users/e44a075756b0406289c6fba9873e136a/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:12.929831 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49419ec-0a12-4e9f-8e5a-85637e59df6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=48621a6c00b1442cbb1c0f54a956b760, user_id=e44a075756b0406289c6fba9873e136a, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:12.949421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49419ec-0a12-4e9f-8e5a-85637e59df6a admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:12.952366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 890/1762] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:12 2022] POST /identity/v3/users => generated 285 bytes in 516 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:12.978177 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465ffde-616c-48d7-a7ec-2283b772c06c admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:12.982286 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 873/1763] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:12 2022] PUT /identity/v3/projects/48621a6c00b1442cbb1c0f54a956b760/users/e44a075756b0406289c6fba9873e136a/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:12.998772 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669dd1f-7093-424b-a328-5dac7aa60f75 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:13.001839 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465ffde-616c-48d7-a7ec-2283b772c06c admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:13.008282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669dd1f-7093-424b-a328-5dac7aa60f75 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:13.011389 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669dd1f-7093-424b-a328-5dac7aa60f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:13.119310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-6669dd1f-7093-424b-a328-5dac7aa60f75 None None] MFA Rules not processed for user `e44a075756b0406289c6fba9873e136a`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:13.128715 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-6669dd1f-7093-424b-a328-5dac7aa60f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:13.340396 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf117f-b079-40fd-98db-13a8e6199014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:13.359542 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf117f-b079-40fd-98db-13a8e6199014 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:13.359882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf117f-b079-40fd-98db-13a8e6199014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:13.360112 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf117f-b079-40fd-98db-13a8e6199014 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:13.371643 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf117f-b079-40fd-98db-13a8e6199014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:13.387920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf117f-b079-40fd-98db-13a8e6199014 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:13.447171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 874/1764] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:13.453482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 891/1765] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 495 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:13.465302 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669dd1f-7093-424b-a328-5dac7aa60f75 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:13.466730 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf117f-b079-40fd-98db-13a8e6199014 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:13.504033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf117f-b079-40fd-98db-13a8e6199014 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:13.517688 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:13.518487 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257eebb9-b9ea-46b5-91ab-da4dc0a7ffcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:13.520451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257eebb9-b9ea-46b5-91ab-da4dc0a7ffcf admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:13.521546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257eebb9-b9ea-46b5-91ab-da4dc0a7ffcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:13.523018 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257eebb9-b9ea-46b5-91ab-da4dc0a7ffcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:13.526929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257eebb9-b9ea-46b5-91ab-da4dc0a7ffcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:13.532087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257eebb9-b9ea-46b5-91ab-da4dc0a7ffcf admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:13.573126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 892/1766] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:13.577647 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257eebb9-b9ea-46b5-91ab-da4dc0a7ffcf admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:13.601899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257eebb9-b9ea-46b5-91ab-da4dc0a7ffcf admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:13.618451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ee5b4-4033-46a9-ac8f-1d2be6a15681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:13.619334 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ee5b4-4033-46a9-ac8f-1d2be6a15681 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:13.619641 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ee5b4-4033-46a9-ac8f-1d2be6a15681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:13.619962 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ee5b4-4033-46a9-ac8f-1d2be6a15681 admin admin] PATH_INFO: `/v3/projects/cce6233da9d4460b82be60c0382a51eb/users/2d54fd7d64834bf6860c686df26164bf/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:13.645332 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669dd1f-7093-424b-a328-5dac7aa60f75 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:13.659987 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ee5b4-4033-46a9-ac8f-1d2be6a15681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce6233da9d4460b82be60c0382a51eb, user_id=2d54fd7d64834bf6860c686df26164bf, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:13.665269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ee5b4-4033-46a9-ac8f-1d2be6a15681 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:13.667180 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0e6c6-65c4-4fad-88b1-23786fb732ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:13.670244 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0e6c6-65c4-4fad-88b1-23786fb732ec service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:13.672798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0e6c6-65c4-4fad-88b1-23786fb732ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:13.673544 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0e6c6-65c4-4fad-88b1-23786fb732ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:13.705288 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 893/1767] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:13 2022] PUT /identity/v3/projects/cce6233da9d4460b82be60c0382a51eb/users/2d54fd7d64834bf6860c686df26164bf/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:40:13.707077 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c4559-2301-411d-9600-69179acc6723 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:13.707507 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c4559-2301-411d-9600-69179acc6723 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:13.707754 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c4559-2301-411d-9600-69179acc6723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:13.715163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0e6c6-65c4-4fad-88b1-23786fb732ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:13.722004 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0e6c6-65c4-4fad-88b1-23786fb732ec service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:13.771820 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:13.781465 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d60c4559-2301-411d-9600-69179acc6723 None None] MFA Rules not processed for user `2d54fd7d64834bf6860c686df26164bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:13.783203 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d60c4559-2301-411d-9600-69179acc6723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:13.818237 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 875/1768] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:13.981438 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0e6c6-65c4-4fad-88b1-23786fb732ec service cinder] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:14.021316 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0e6c6-65c4-4fad-88b1-23786fb732ec service cinder] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:14.117340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 894/1769] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:14.125268 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c4559-2301-411d-9600-69179acc6723 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:14.291399 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48146b56-d7f0-4a9e-9010-00bea1cab536 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:14.296401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48146b56-d7f0-4a9e-9010-00bea1cab536 service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:14.297680 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48146b56-d7f0-4a9e-9010-00bea1cab536 service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:14.298076 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48146b56-d7f0-4a9e-9010-00bea1cab536 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:14.303653 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-48146b56-d7f0-4a9e-9010-00bea1cab536 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:14.494598 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c4559-2301-411d-9600-69179acc6723 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:14.513464 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53a605-d6c7-418a-a13c-2db80379ecbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:14.517406 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53a605-d6c7-418a-a13c-2db80379ecbc admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:14.518916 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53a605-d6c7-418a-a13c-2db80379ecbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:14.522543 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53a605-d6c7-418a-a13c-2db80379ecbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:14.525670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53a605-d6c7-418a-a13c-2db80379ecbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:14.533252 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53a605-d6c7-418a-a13c-2db80379ecbc admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:14.640682 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48146b56-d7f0-4a9e-9010-00bea1cab536 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:14.640682 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48146b56-d7f0-4a9e-9010-00bea1cab536 service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:14.642934 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 895/1770] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:40:14 2022] POST /identity/v3/projects => generated 367 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:14.654689 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53a605-d6c7-418a-a13c-2db80379ecbc admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:14.676680 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 876/1771] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:14.757917 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53a605-d6c7-418a-a13c-2db80379ecbc admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:14.771450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b9647-6992-493e-a015-1b6a07821fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:14.773047 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b9647-6992-493e-a015-1b6a07821fde admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:14.774393 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b9647-6992-493e-a015-1b6a07821fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:14.774833 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b9647-6992-493e-a015-1b6a07821fde admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:14.776503 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b9647-6992-493e-a015-1b6a07821fde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:14.779488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b9647-6992-493e-a015-1b6a07821fde admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:14.822279 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 896/1772] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:14 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:14.825552 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48146b56-d7f0-4a9e-9010-00bea1cab536 service cinder] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:14.839876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48146b56-d7f0-4a9e-9010-00bea1cab536 service cinder] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:14.849733 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ed4a1-2260-42a0-a7ba-e1cfe0a0602b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:14.850536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ed4a1-2260-42a0-a7ba-e1cfe0a0602b admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:14.851788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ed4a1-2260-42a0-a7ba-e1cfe0a0602b admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:14.851788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ed4a1-2260-42a0-a7ba-e1cfe0a0602b admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:14.852306 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ed4a1-2260-42a0-a7ba-e1cfe0a0602b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:14.854232 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ed4a1-2260-42a0-a7ba-e1cfe0a0602b admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:14.867740 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 877/1773] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:14.872872 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b9647-6992-493e-a015-1b6a07821fde admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:14.890983 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b9647-6992-493e-a015-1b6a07821fde admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:14.907995 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707733b9-dc45-4e7d-b36d-22863b041661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:14.910651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707733b9-dc45-4e7d-b36d-22863b041661 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:14.911729 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707733b9-dc45-4e7d-b36d-22863b041661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:14.912873 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707733b9-dc45-4e7d-b36d-22863b041661 admin admin] PATH_INFO: `/v3/projects/cb2410a89e564b7d9ecf3c4501fd4026/users/1bfc3b9974ad4054b2b98b78e627811e/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:14.955461 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707733b9-dc45-4e7d-b36d-22863b041661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb2410a89e564b7d9ecf3c4501fd4026, user_id=1bfc3b9974ad4054b2b98b78e627811e, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:14.961888 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707733b9-dc45-4e7d-b36d-22863b041661 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:14.996976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:15.025246 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 897/1774] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:14 2022] PUT /identity/v3/projects/cb2410a89e564b7d9ecf3c4501fd4026/users/1bfc3b9974ad4054b2b98b78e627811e/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:15.029803 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ed4a1-2260-42a0-a7ba-e1cfe0a0602b admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:15.043396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ed4a1-2260-42a0-a7ba-e1cfe0a0602b admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:15.183706 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837bba4-a63c-44da-96b1-b45e28d0c707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:15.185217 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837bba4-a63c-44da-96b1-b45e28d0c707 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:15.186515 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837bba4-a63c-44da-96b1-b45e28d0c707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:15.187253 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837bba4-a63c-44da-96b1-b45e28d0c707 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:15.190475 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837bba4-a63c-44da-96b1-b45e28d0c707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:15.193332 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837bba4-a63c-44da-96b1-b45e28d0c707 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:15.221362 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 878/1775] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:15.226629 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707733b9-dc45-4e7d-b36d-22863b041661 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:15.255584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707733b9-dc45-4e7d-b36d-22863b041661 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:15.268606 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d116cca-5e5f-45d8-9182-8f6b4feaa2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:15.269965 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d116cca-5e5f-45d8-9182-8f6b4feaa2fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:15.269965 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d116cca-5e5f-45d8-9182-8f6b4feaa2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:15.270829 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d116cca-5e5f-45d8-9182-8f6b4feaa2fc admin admin] PATH_INFO: `/v3/projects/cb2410a89e564b7d9ecf3c4501fd4026/users/1bfc3b9974ad4054b2b98b78e627811e/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:15.309338 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d116cca-5e5f-45d8-9182-8f6b4feaa2fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb2410a89e564b7d9ecf3c4501fd4026, user_id=1bfc3b9974ad4054b2b98b78e627811e, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:15.315391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d116cca-5e5f-45d8-9182-8f6b4feaa2fc admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:15.395906 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 898/1776] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:15 2022] PUT /identity/v3/projects/cb2410a89e564b7d9ecf3c4501fd4026/users/1bfc3b9974ad4054b2b98b78e627811e/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:15.412229 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3c0c3-11ed-4880-83c1-cdf3ce702049 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:15.412621 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3c0c3-11ed-4880-83c1-cdf3ce702049 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:15.413061 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3c0c3-11ed-4880-83c1-cdf3ce702049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:15.422775 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:15.482882 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-88b3c0c3-11ed-4880-83c1-cdf3ce702049 None None] MFA Rules not processed for user `1bfc3b9974ad4054b2b98b78e627811e`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:15.484761 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-88b3c0c3-11ed-4880-83c1-cdf3ce702049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:15.539730 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9e6df-9a1d-4863-a23b-3873737e475d None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:15.540620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9e6df-9a1d-4863-a23b-3873737e475d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:15.541324 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9e6df-9a1d-4863-a23b-3873737e475d None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:15.544682 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 899/1777] 10.222.0.69 () {54 vars in 921 bytes} [Mon Aug 29 21:40:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:40:15.563096 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fed11-4e76-4853-bdd8-46929f984b4c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:15.564014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fed11-4e76-4853-bdd8-46929f984b4c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:15.564784 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fed11-4e76-4853-bdd8-46929f984b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:15.640763 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-527fed11-4e76-4853-bdd8-46929f984b4c None None] MFA Rules not processed for user `96c35c544cae4ad187f1a1be723e0d21`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:15.647835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-527fed11-4e76-4853-bdd8-46929f984b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:15.823540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 879/1778] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:15 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:15.862032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3c0c3-11ed-4880-83c1-cdf3ce702049 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:16.134689 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 900/1779] 10.222.0.69 () {58 vars in 1018 bytes} [Mon Aug 29 21:40:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 574 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:40:16.377258 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3c0c3-11ed-4880-83c1-cdf3ce702049 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:16.423771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e15087-8c76-413b-bd2c-964edcd136b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:16.424548 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e15087-8c76-413b-bd2c-964edcd136b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:16.429794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e15087-8c76-413b-bd2c-964edcd136b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:16.433641 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e15087-8c76-413b-bd2c-964edcd136b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:16.513922 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e15087-8c76-413b-bd2c-964edcd136b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:16.516075 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e15087-8c76-413b-bd2c-964edcd136b6 service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:16.584924 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 880/1780] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 721 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:40:16.856859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dc9bf-6e34-4145-8ee5-1fb69883ba71 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:16.857736 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dc9bf-6e34-4145-8ee5-1fb69883ba71 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:16.858746 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dc9bf-6e34-4145-8ee5-1fb69883ba71 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:16.868934 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 901/1781] 10.222.0.69 () {54 vars in 921 bytes} [Mon Aug 29 21:40:16 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:40:17.367583 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e15087-8c76-413b-bd2c-964edcd136b6 service cinder] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:17.370232 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-e2e15087-8c76-413b-bd2c-964edcd136b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:17.443751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e15087-8c76-413b-bd2c-964edcd136b6 service cinder] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:17.499628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365c934-aa7a-40cd-8801-4b89fa556e1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:17.503817 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365c934-aa7a-40cd-8801-4b89fa556e1a service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:17.509345 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365c934-aa7a-40cd-8801-4b89fa556e1a service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:17.510085 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365c934-aa7a-40cd-8801-4b89fa556e1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:17.549155 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365c934-aa7a-40cd-8801-4b89fa556e1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:17.557296 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365c934-aa7a-40cd-8801-4b89fa556e1a service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:17.636892 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 881/1782] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:17.964795 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa837c8-4249-4565-8878-2c7973b6b8f7 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:17.965582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa837c8-4249-4565-8878-2c7973b6b8f7 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:17.965582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa837c8-4249-4565-8878-2c7973b6b8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:18.162275 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-efa837c8-4249-4565-8878-2c7973b6b8f7 None None] MFA Rules not processed for user `96c35c544cae4ad187f1a1be723e0d21`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:18.163867 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-efa837c8-4249-4565-8878-2c7973b6b8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:18.199586 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 902/1783] 10.222.0.69 () {58 vars in 1018 bytes} [Mon Aug 29 21:40:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:40:18.537082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca5a7d-8cd0-4ec2-9974-63986b521422 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:18.538641 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca5a7d-8cd0-4ec2-9974-63986b521422 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:18.539309 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca5a7d-8cd0-4ec2-9974-63986b521422 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:18.542683 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 882/1784] 10.222.0.69 () {54 vars in 921 bytes} [Mon Aug 29 21:40:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:40:18.944005 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89bde4-621f-46db-878c-64342bdfe709 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:18.946729 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89bde4-621f-46db-878c-64342bdfe709 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:18.946729 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89bde4-621f-46db-878c-64342bdfe709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:19.091361 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-cd89bde4-621f-46db-878c-64342bdfe709 None None] MFA Rules not processed for user `a7911672bb2a471daf4f69ba940ef41d`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:19.107119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cd89bde4-621f-46db-878c-64342bdfe709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:19.507372 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 903/1785] 10.222.0.69 () {58 vars in 1018 bytes} [Mon Aug 29 21:40:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 563 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:19.696503 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca5a7d-8cd0-4ec2-9974-63986b521422 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:19.776027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da10f49-ad01-479e-b2d3-1d03d6de83a5 None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:19.776482 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca5a7d-8cd0-4ec2-9974-63986b521422 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:19.776691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da10f49-ad01-479e-b2d3-1d03d6de83a5 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:19.778941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da10f49-ad01-479e-b2d3-1d03d6de83a5 None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:19.784386 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 904/1786] 10.222.0.69 () {54 vars in 961 bytes} [Mon Aug 29 21:40:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:40:19.797971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a10698-5995-4b74-8824-612739a1ee04 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:19.799094 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a10698-5995-4b74-8824-612739a1ee04 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:19.800027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a10698-5995-4b74-8824-612739a1ee04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:19.854705 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e822c99-4da2-4918-bd00-8249b559027d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:19.855565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e822c99-4da2-4918-bd00-8249b559027d service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:19.856017 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e822c99-4da2-4918-bd00-8249b559027d service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:19.856507 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e822c99-4da2-4918-bd00-8249b559027d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:19.902065 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e822c99-4da2-4918-bd00-8249b559027d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:19.917330 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e822c99-4da2-4918-bd00-8249b559027d service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:19.942708 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-e2a10698-5995-4b74-8824-612739a1ee04 None None] MFA Rules not processed for user `a7911672bb2a471daf4f69ba940ef41d`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:19.950816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e2a10698-5995-4b74-8824-612739a1ee04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:19.965780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 883/1787] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:20.043726 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 905/1788] 10.222.0.69 () {58 vars in 1058 bytes} [Mon Aug 29 21:40:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:20.059998 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e822c99-4da2-4918-bd00-8249b559027d service nova] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:20.120973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e822c99-4da2-4918-bd00-8249b559027d service nova] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:20.149124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec7008-c461-4869-96bf-99f604a15680 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7911672bb2a471daf4f69ba940ef41d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:20.151576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec7008-c461-4869-96bf-99f604a15680 service placement] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:20.152340 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec7008-c461-4869-96bf-99f604a15680 service placement] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:20.164957 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec7008-c461-4869-96bf-99f604a15680 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:20.242601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec7008-c461-4869-96bf-99f604a15680 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:20.246466 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec7008-c461-4869-96bf-99f604a15680 service placement] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:20.328692 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 884/1789] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:40:21.867195 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a10698-5995-4b74-8824-612739a1ee04 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:21.903593 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a10698-5995-4b74-8824-612739a1ee04 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:21.929395 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0fc43-7fed-4ca6-b609-da0393d15674 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:21.931734 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0fc43-7fed-4ca6-b609-da0393d15674 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:21.933750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0fc43-7fed-4ca6-b609-da0393d15674 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:21.935906 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0fc43-7fed-4ca6-b609-da0393d15674 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:22.106603 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:22.145972 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0fc43-7fed-4ca6-b609-da0393d15674 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:22.151031 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0fc43-7fed-4ca6-b609-da0393d15674 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:22.187078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 906/1790] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:40:23.281632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec7008-c461-4869-96bf-99f604a15680 service placement] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:23.286848 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-81ec7008-c461-4869-96bf-99f604a15680 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:23.631150 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:23.676428 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec7008-c461-4869-96bf-99f604a15680 service placement] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:23.716751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61219130-8064-457d-be27-b6d487c0801d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:23.716751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61219130-8064-457d-be27-b6d487c0801d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:23.716751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61219130-8064-457d-be27-b6d487c0801d admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:23.716751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61219130-8064-457d-be27-b6d487c0801d admin admin] PATH_INFO: `/v3/users/af2db312464c45768e741e61062a99d1` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:23.717338 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61219130-8064-457d-be27-b6d487c0801d admin admin] RBAC: Authorizing `identity:delete_user(user_id=af2db312464c45768e741e61062a99d1)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:23.717338 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61219130-8064-457d-be27-b6d487c0801d admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:23.977600 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-61219130-8064-457d-be27-b6d487c0801d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af2db312464c45768e741e61062a99d1'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:24.028989 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-61219130-8064-457d-be27-b6d487c0801d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af2db312464c45768e741e61062a99d1'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:24.112043 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-61219130-8064-457d-be27-b6d487c0801d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af2db312464c45768e741e61062a99d1'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:24.112888 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-61219130-8064-457d-be27-b6d487c0801d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af2db312464c45768e741e61062a99d1'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:24.113551 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-61219130-8064-457d-be27-b6d487c0801d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af2db312464c45768e741e61062a99d1'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:24.190519 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 885/1791] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:40:23 2022] DELETE /identity/v3/users/af2db312464c45768e741e61062a99d1 => generated 0 bytes in 911 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:25.157202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0fc43-7fed-4ca6-b609-da0393d15674 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:25.201410 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0fc43-7fed-4ca6-b609-da0393d15674 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:25.526485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197b1c5-fe41-4e29-9a48-46a51a9e7e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:25.527176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197b1c5-fe41-4e29-9a48-46a51a9e7e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:25.527984 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197b1c5-fe41-4e29-9a48-46a51a9e7e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:25.529538 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197b1c5-fe41-4e29-9a48-46a51a9e7e78 admin admin] PATH_INFO: `/v3/users/3aa42fad882e4e31b612c6141b5cf946` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:25.532640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197b1c5-fe41-4e29-9a48-46a51a9e7e78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aa42fad882e4e31b612c6141b5cf946)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:25.535110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197b1c5-fe41-4e29-9a48-46a51a9e7e78 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:25.651875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9197b1c5-fe41-4e29-9a48-46a51a9e7e78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aa42fad882e4e31b612c6141b5cf946'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:25.658448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61219130-8064-457d-be27-b6d487c0801d admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:25.663078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-61219130-8064-457d-be27-b6d487c0801d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:25.683024 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9197b1c5-fe41-4e29-9a48-46a51a9e7e78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aa42fad882e4e31b612c6141b5cf946'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:25.716889 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61219130-8064-457d-be27-b6d487c0801d admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:25.719888 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9197b1c5-fe41-4e29-9a48-46a51a9e7e78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aa42fad882e4e31b612c6141b5cf946'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:25.721019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9197b1c5-fe41-4e29-9a48-46a51a9e7e78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aa42fad882e4e31b612c6141b5cf946'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:25.722333 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9197b1c5-fe41-4e29-9a48-46a51a9e7e78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aa42fad882e4e31b612c6141b5cf946'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:25.741044 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ddf01a-b10e-424e-8d25-d53f5990175c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:25.742214 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddf01a-b10e-424e-8d25-d53f5990175c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:25.744719 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddf01a-b10e-424e-8d25-d53f5990175c admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:25.745238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddf01a-b10e-424e-8d25-d53f5990175c admin admin] PATH_INFO: `/v3/projects/2e38ad0716f04f4fbb9ee4ac7f80ac9a` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:25.747815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ddf01a-b10e-424e-8d25-d53f5990175c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e38ad0716f04f4fbb9ee4ac7f80ac9a)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:25.754172 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ddf01a-b10e-424e-8d25-d53f5990175c admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:25.767075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 907/1792] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:40:25 2022] DELETE /identity/v3/users/3aa42fad882e4e31b612c6141b5cf946 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:25.779953 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31520766-de66-4289-8922-a9469a03b1ae None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:25.780865 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31520766-de66-4289-8922-a9469a03b1ae None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:25.784246 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31520766-de66-4289-8922-a9469a03b1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:25.852555 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-31520766-de66-4289-8922-a9469a03b1ae None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:25.855190 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-31520766-de66-4289-8922-a9469a03b1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:25.898414 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-61ddf01a-b10e-424e-8d25-d53f5990175c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e38ad0716f04f4fbb9ee4ac7f80ac9a', 'request_id': 'req-61ddf01a-b10e-424e-8d25-d53f5990175c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:25.918333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-61ddf01a-b10e-424e-8d25-d53f5990175c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e38ad0716f04f4fbb9ee4ac7f80ac9a', 'request_id': 'req-61ddf01a-b10e-424e-8d25-d53f5990175c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:25.936023 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-61ddf01a-b10e-424e-8d25-d53f5990175c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e38ad0716f04f4fbb9ee4ac7f80ac9a', 'request_id': 'req-61ddf01a-b10e-424e-8d25-d53f5990175c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:25.961633 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-61ddf01a-b10e-424e-8d25-d53f5990175c admin admin] The token cache is being invalidate because project 2e38ad0716f04f4fbb9ee4ac7f80ac9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:40:25.962387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-61ddf01a-b10e-424e-8d25-d53f5990175c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:25.963488 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-61ddf01a-b10e-424e-8d25-d53f5990175c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:25.965760 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 886/1793] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:25 2022] DELETE /identity/v3/projects/2e38ad0716f04f4fbb9ee4ac7f80ac9a => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:25.967464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ddf01a-b10e-424e-8d25-d53f5990175c admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:25.970533 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-61ddf01a-b10e-424e-8d25-d53f5990175c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:25.978121 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 908/1794] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:25.979321 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31520766-de66-4289-8922-a9469a03b1ae None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:25.981477 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-31520766-de66-4289-8922-a9469a03b1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:26.002056 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ddf01a-b10e-424e-8d25-d53f5990175c admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:26.002646 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31520766-de66-4289-8922-a9469a03b1ae None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:26.012723 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea33b4-aa27-4bcd-88ab-002fb7d92b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:26.013716 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea33b4-aa27-4bcd-88ab-002fb7d92b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:26.013907 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b1472-e6b5-47af-8149-2e299c71fd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:26.015197 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b1472-e6b5-47af-8149-2e299c71fd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:26.015567 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea33b4-aa27-4bcd-88ab-002fb7d92b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:26.016263 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b1472-e6b5-47af-8149-2e299c71fd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:26.016634 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea33b4-aa27-4bcd-88ab-002fb7d92b3f admin admin] PATH_INFO: `/v3/users/a994f39277be45ad809f23653bfcf351` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:26.017447 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b1472-e6b5-47af-8149-2e299c71fd24 admin admin] PATH_INFO: `/v3/users/2d54fd7d64834bf6860c686df26164bf` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:26.019012 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea33b4-aa27-4bcd-88ab-002fb7d92b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a994f39277be45ad809f23653bfcf351)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:26.019881 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b1472-e6b5-47af-8149-2e299c71fd24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d54fd7d64834bf6860c686df26164bf)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:26.022180 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea33b4-aa27-4bcd-88ab-002fb7d92b3f admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:26.024384 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b1472-e6b5-47af-8149-2e299c71fd24 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:26.025442 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:26.137293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4cea33b4-aa27-4bcd-88ab-002fb7d92b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a994f39277be45ad809f23653bfcf351'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:26.151917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-395b1472-e6b5-47af-8149-2e299c71fd24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d54fd7d64834bf6860c686df26164bf'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:26.155802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=74,keystone:DELETE=24,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:26.163972 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4cea33b4-aa27-4bcd-88ab-002fb7d92b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a994f39277be45ad809f23653bfcf351'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:26.187766 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4cea33b4-aa27-4bcd-88ab-002fb7d92b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a994f39277be45ad809f23653bfcf351'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:26.190227 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4cea33b4-aa27-4bcd-88ab-002fb7d92b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a994f39277be45ad809f23653bfcf351'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:26.191411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4cea33b4-aa27-4bcd-88ab-002fb7d92b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a994f39277be45ad809f23653bfcf351'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:26.209818 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-395b1472-e6b5-47af-8149-2e299c71fd24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d54fd7d64834bf6860c686df26164bf'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:26.258326 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 909/1795] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:40:25 2022] DELETE /identity/v3/users/a994f39277be45ad809f23653bfcf351 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:26.260373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea33b4-aa27-4bcd-88ab-002fb7d92b3f admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:26.263169 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4cea33b4-aa27-4bcd-88ab-002fb7d92b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:26.273449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-395b1472-e6b5-47af-8149-2e299c71fd24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d54fd7d64834bf6860c686df26164bf'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:26.274895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-395b1472-e6b5-47af-8149-2e299c71fd24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d54fd7d64834bf6860c686df26164bf'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:26.276105 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-395b1472-e6b5-47af-8149-2e299c71fd24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d54fd7d64834bf6860c686df26164bf'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:26.327472 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 887/1796] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:40:25 2022] DELETE /identity/v3/users/2d54fd7d64834bf6860c686df26164bf => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:26.334678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992fa72-d213-4fac-8b07-28379a3cf82d None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:26.335362 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992fa72-d213-4fac-8b07-28379a3cf82d None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:26.335807 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992fa72-d213-4fac-8b07-28379a3cf82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:26.455059 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-f992fa72-d213-4fac-8b07-28379a3cf82d None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:26.463852 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f992fa72-d213-4fac-8b07-28379a3cf82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:26.530380 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea33b4-aa27-4bcd-88ab-002fb7d92b3f admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:26.689363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 888/1797] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:26.721494 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d776f6-b114-44f4-a29a-cbb814c0d488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:26.722571 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d776f6-b114-44f4-a29a-cbb814c0d488 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:26.724082 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d776f6-b114-44f4-a29a-cbb814c0d488 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:26.724082 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d776f6-b114-44f4-a29a-cbb814c0d488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:26.725626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992fa72-d213-4fac-8b07-28379a3cf82d None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:26.727233 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f992fa72-d213-4fac-8b07-28379a3cf82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:26.738821 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e0d776f6-b114-44f4-a29a-cbb814c0d488 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:26.764712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992fa72-d213-4fac-8b07-28379a3cf82d None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:26.782685 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a02531-77e8-4ef7-a877-ea4418d38254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:26.783711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d776f6-b114-44f4-a29a-cbb814c0d488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:26.783982 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a02531-77e8-4ef7-a877-ea4418d38254 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:26.784550 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a02531-77e8-4ef7-a877-ea4418d38254 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:26.785051 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a02531-77e8-4ef7-a877-ea4418d38254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:26.785339 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d776f6-b114-44f4-a29a-cbb814c0d488 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:26.813344 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a02531-77e8-4ef7-a877-ea4418d38254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:26.820717 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a02531-77e8-4ef7-a877-ea4418d38254 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:26.821145 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 910/1798] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:26.835276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 889/1799] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:27.317738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d776f6-b114-44f4-a29a-cbb814c0d488 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:27.319399 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e0d776f6-b114-44f4-a29a-cbb814c0d488 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:27.333250 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d776f6-b114-44f4-a29a-cbb814c0d488 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:27.349629 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a26747-fab5-4bf6-9a40-c4fcc13319b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:27.350590 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a26747-fab5-4bf6-9a40-c4fcc13319b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:27.350837 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a26747-fab5-4bf6-9a40-c4fcc13319b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:27.351513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a26747-fab5-4bf6-9a40-c4fcc13319b0 admin admin] PATH_INFO: `/v3/projects/dcc3c9a21edf4351b014da3a084b289e` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:27.353259 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a26747-fab5-4bf6-9a40-c4fcc13319b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcc3c9a21edf4351b014da3a084b289e)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:27.355187 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a26747-fab5-4bf6-9a40-c4fcc13319b0 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:27.410685 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:27.429097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-39a26747-fab5-4bf6-9a40-c4fcc13319b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcc3c9a21edf4351b014da3a084b289e', 'request_id': 'req-39a26747-fab5-4bf6-9a40-c4fcc13319b0'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:27.439868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-39a26747-fab5-4bf6-9a40-c4fcc13319b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcc3c9a21edf4351b014da3a084b289e', 'request_id': 'req-39a26747-fab5-4bf6-9a40-c4fcc13319b0'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:27.452136 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-39a26747-fab5-4bf6-9a40-c4fcc13319b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcc3c9a21edf4351b014da3a084b289e', 'request_id': 'req-39a26747-fab5-4bf6-9a40-c4fcc13319b0'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:27.521256 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-39a26747-fab5-4bf6-9a40-c4fcc13319b0 admin admin] The token cache is being invalidate because project dcc3c9a21edf4351b014da3a084b289e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:40:27.523212 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-39a26747-fab5-4bf6-9a40-c4fcc13319b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:27.527749 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-39a26747-fab5-4bf6-9a40-c4fcc13319b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:27.538404 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 911/1800] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:27 2022] DELETE /identity/v3/projects/dcc3c9a21edf4351b014da3a084b289e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:40:27.538616 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffaca5-828d-4b92-ae54-0ecc513a4e3d None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:27.538813 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffaca5-828d-4b92-ae54-0ecc513a4e3d None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:27.539262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffaca5-828d-4b92-ae54-0ecc513a4e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:27.562697 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-98ffaca5-828d-4b92-ae54-0ecc513a4e3d None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:27.564301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-98ffaca5-828d-4b92-ae54-0ecc513a4e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:27.680281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973799f-3248-49ac-8df3-396af891a617 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:27.680680 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973799f-3248-49ac-8df3-396af891a617 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:27.681069 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973799f-3248-49ac-8df3-396af891a617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:27.690587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 890/1801] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:27.725667 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-4973799f-3248-49ac-8df3-396af891a617 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:27.729297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4973799f-3248-49ac-8df3-396af891a617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:27.750783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffaca5-828d-4b92-ae54-0ecc513a4e3d None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:27.762321 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 912/1802] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:27.794789 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffaca5-828d-4b92-ae54-0ecc513a4e3d None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:27.802154 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62214f8-d6c5-47e6-8f69-c7bac9ba3b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:27.803016 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62214f8-d6c5-47e6-8f69-c7bac9ba3b21 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:27.803410 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62214f8-d6c5-47e6-8f69-c7bac9ba3b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:27.803872 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62214f8-d6c5-47e6-8f69-c7bac9ba3b21 admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:27.804848 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62214f8-d6c5-47e6-8f69-c7bac9ba3b21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:40:27.805284 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62214f8-d6c5-47e6-8f69-c7bac9ba3b21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:27.807829 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62214f8-d6c5-47e6-8f69-c7bac9ba3b21 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:27.839865 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973799f-3248-49ac-8df3-396af891a617 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:27.848909 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 891/1803] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:40:27.856503 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973799f-3248-49ac-8df3-396af891a617 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:27.864841 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603eb25-4636-4d82-9ba3-272fcaf68c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:27.865909 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603eb25-4636-4d82-9ba3-272fcaf68c1e admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:27.866367 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603eb25-4636-4d82-9ba3-272fcaf68c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:27.866886 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603eb25-4636-4d82-9ba3-272fcaf68c1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:27.868018 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603eb25-4636-4d82-9ba3-272fcaf68c1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:27.873199 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603eb25-4636-4d82-9ba3-272fcaf68c1e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:27.996766 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 913/1804] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:40:27 2022] POST /identity/v3/projects => generated 357 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:40:28.002631 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62214f8-d6c5-47e6-8f69-c7bac9ba3b21 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:28.034569 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62214f8-d6c5-47e6-8f69-c7bac9ba3b21 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:28.148288 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:28.199808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67877a9d-ccf2-4053-ae44-4b00799e4248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:28.201417 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67877a9d-ccf2-4053-ae44-4b00799e4248 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:28.202594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67877a9d-ccf2-4053-ae44-4b00799e4248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:28.203358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67877a9d-ccf2-4053-ae44-4b00799e4248 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:28.204416 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67877a9d-ccf2-4053-ae44-4b00799e4248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:28.206861 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67877a9d-ccf2-4053-ae44-4b00799e4248 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:28.256653 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 892/1805] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:28 2022] POST /identity/v3/users => generated 279 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:28.266055 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603eb25-4636-4d82-9ba3-272fcaf68c1e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:28.312811 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603eb25-4636-4d82-9ba3-272fcaf68c1e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:28.347860 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c542a9-4a80-4aef-af2d-9139e6f11ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:28.349824 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c542a9-4a80-4aef-af2d-9139e6f11ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:28.350541 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c542a9-4a80-4aef-af2d-9139e6f11ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:28.351031 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c542a9-4a80-4aef-af2d-9139e6f11ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:28.352871 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c542a9-4a80-4aef-af2d-9139e6f11ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:28.356134 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c542a9-4a80-4aef-af2d-9139e6f11ab5 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:28.383335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 914/1806] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:40:28.390620 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67877a9d-ccf2-4053-ae44-4b00799e4248 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:28.454207 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67877a9d-ccf2-4053-ae44-4b00799e4248 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:28.461859 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20582c3-554e-4ef5-bdc9-c53ea1dc821a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:28.462735 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20582c3-554e-4ef5-bdc9-c53ea1dc821a admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:28.463153 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20582c3-554e-4ef5-bdc9-c53ea1dc821a admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:28.465302 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20582c3-554e-4ef5-bdc9-c53ea1dc821a admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:28.466646 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20582c3-554e-4ef5-bdc9-c53ea1dc821a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:28.470559 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20582c3-554e-4ef5-bdc9-c53ea1dc821a admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:28.490552 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 893/1807] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:28.497196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c542a9-4a80-4aef-af2d-9139e6f11ab5 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:28.517402 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c542a9-4a80-4aef-af2d-9139e6f11ab5 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:28.532381 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af39b0-7f37-49ed-a6dd-a62886203458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:28.542849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af39b0-7f37-49ed-a6dd-a62886203458 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:28.551305 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af39b0-7f37-49ed-a6dd-a62886203458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:28.551830 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af39b0-7f37-49ed-a6dd-a62886203458 admin admin] PATH_INFO: `/v3/projects/01b5fed174f9456a886497012804f41e/users/79d9cc16df244190aeff797772c6d92c/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:28.585873 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af39b0-7f37-49ed-a6dd-a62886203458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b5fed174f9456a886497012804f41e, user_id=79d9cc16df244190aeff797772c6d92c, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:28.589399 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af39b0-7f37-49ed-a6dd-a62886203458 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:28.618180 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 915/1808] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:28 2022] PUT /identity/v3/projects/01b5fed174f9456a886497012804f41e/users/79d9cc16df244190aeff797772c6d92c/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:28.634555 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1350d9-5d73-41cf-beb8-ca18eb9d7840 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:28.635720 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1350d9-5d73-41cf-beb8-ca18eb9d7840 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:28.635720 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1350d9-5d73-41cf-beb8-ca18eb9d7840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:28.683542 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-3e1350d9-5d73-41cf-beb8-ca18eb9d7840 None None] MFA Rules not processed for user `79d9cc16df244190aeff797772c6d92c`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:28.685330 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-3e1350d9-5d73-41cf-beb8-ca18eb9d7840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:28.875332 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 894/1809] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:40:28.882942 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af39b0-7f37-49ed-a6dd-a62886203458 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:29.032222 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af39b0-7f37-49ed-a6dd-a62886203458 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:29.041804 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd525d7-9f57-46c9-96b8-7ecd8288833e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:29.042707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd525d7-9f57-46c9-96b8-7ecd8288833e admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:29.043186 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd525d7-9f57-46c9-96b8-7ecd8288833e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:29.043637 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd525d7-9f57-46c9-96b8-7ecd8288833e admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:29.044640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd525d7-9f57-46c9-96b8-7ecd8288833e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:29.047375 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd525d7-9f57-46c9-96b8-7ecd8288833e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:29.092001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 916/1810] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:40:28 2022] POST /identity/v3/projects => generated 357 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:29.099560 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1350d9-5d73-41cf-beb8-ca18eb9d7840 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:29.120711 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1350d9-5d73-41cf-beb8-ca18eb9d7840 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:29.270131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd525d7-9f57-46c9-96b8-7ecd8288833e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:29.273149 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ffd525d7-9f57-46c9-96b8-7ecd8288833e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:29.301243 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8add3-9872-4ba8-bbc4-855e3721ac58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:29.304824 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8add3-9872-4ba8-bbc4-855e3721ac58 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:29.305786 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8add3-9872-4ba8-bbc4-855e3721ac58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:29.306381 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8add3-9872-4ba8-bbc4-855e3721ac58 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:29.307868 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee8add3-9872-4ba8-bbc4-855e3721ac58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:29.313892 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee8add3-9872-4ba8-bbc4-855e3721ac58 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:29.401600 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 895/1811] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:29 2022] POST /identity/v3/users => generated 285 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:29.404444 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8add3-9872-4ba8-bbc4-855e3721ac58 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:29.409131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-bee8add3-9872-4ba8-bbc4-855e3721ac58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:29.439476 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8add3-9872-4ba8-bbc4-855e3721ac58 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:29.453782 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999163bd-5cff-4373-875e-1e7513e439af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:29.454980 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999163bd-5cff-4373-875e-1e7513e439af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:29.455417 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999163bd-5cff-4373-875e-1e7513e439af admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:29.455872 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999163bd-5cff-4373-875e-1e7513e439af admin admin] PATH_INFO: `/v3/users/9a6feb6779f748afb293a12b2195c09b` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:29.460156 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999163bd-5cff-4373-875e-1e7513e439af admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a6feb6779f748afb293a12b2195c09b)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:29.465607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999163bd-5cff-4373-875e-1e7513e439af admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:29.573885 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:29.643415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd525d7-9f57-46c9-96b8-7ecd8288833e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:29.684811 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc5dff-439c-48d9-8709-0ead7a62dbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:29.686145 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc5dff-439c-48d9-8709-0ead7a62dbf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:29.687569 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc5dff-439c-48d9-8709-0ead7a62dbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:29.688165 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc5dff-439c-48d9-8709-0ead7a62dbf1 admin admin] PATH_INFO: `/v3/projects/cce6233da9d4460b82be60c0382a51eb` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:29.694959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc5dff-439c-48d9-8709-0ead7a62dbf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cce6233da9d4460b82be60c0382a51eb)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:29.706583 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc5dff-439c-48d9-8709-0ead7a62dbf1 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:29.715073 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:29.764231 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-999163bd-5cff-4373-875e-1e7513e439af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a6feb6779f748afb293a12b2195c09b'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:29.791893 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-999163bd-5cff-4373-875e-1e7513e439af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a6feb6779f748afb293a12b2195c09b'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:29.829616 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-999163bd-5cff-4373-875e-1e7513e439af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a6feb6779f748afb293a12b2195c09b'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:29.830303 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-999163bd-5cff-4373-875e-1e7513e439af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a6feb6779f748afb293a12b2195c09b'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:29.831766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-999163bd-5cff-4373-875e-1e7513e439af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a6feb6779f748afb293a12b2195c09b'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:29.844632 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-edfc5dff-439c-48d9-8709-0ead7a62dbf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cce6233da9d4460b82be60c0382a51eb', 'request_id': 'req-edfc5dff-439c-48d9-8709-0ead7a62dbf1'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:29.871275 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-edfc5dff-439c-48d9-8709-0ead7a62dbf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cce6233da9d4460b82be60c0382a51eb', 'request_id': 'req-edfc5dff-439c-48d9-8709-0ead7a62dbf1'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:29.885961 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 896/1812] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:40:29 2022] DELETE /identity/v3/users/9a6feb6779f748afb293a12b2195c09b => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:29.889715 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999163bd-5cff-4373-875e-1e7513e439af admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:29.897867 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-999163bd-5cff-4373-875e-1e7513e439af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:29.910450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-edfc5dff-439c-48d9-8709-0ead7a62dbf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cce6233da9d4460b82be60c0382a51eb', 'request_id': 'req-edfc5dff-439c-48d9-8709-0ead7a62dbf1'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:29.948639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-edfc5dff-439c-48d9-8709-0ead7a62dbf1 admin admin] The token cache is being invalidate because project cce6233da9d4460b82be60c0382a51eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:40:29.949418 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-edfc5dff-439c-48d9-8709-0ead7a62dbf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:29.952351 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-edfc5dff-439c-48d9-8709-0ead7a62dbf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:29.966995 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 917/1813] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:29 2022] DELETE /identity/v3/projects/cce6233da9d4460b82be60c0382a51eb => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:40:29.966995 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc5dff-439c-48d9-8709-0ead7a62dbf1 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:29.969386 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-edfc5dff-439c-48d9-8709-0ead7a62dbf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:30.215134 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc5dff-439c-48d9-8709-0ead7a62dbf1 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:30.231085 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bb94e-3650-4a02-8a1a-1cc1e0262f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:30.231934 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bb94e-3650-4a02-8a1a-1cc1e0262f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:30.232464 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bb94e-3650-4a02-8a1a-1cc1e0262f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:30.232899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bb94e-3650-4a02-8a1a-1cc1e0262f06 admin admin] PATH_INFO: `/v3/projects/76b6a49c587743d1ada58abc255c059a` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:30.235240 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999163bd-5cff-4373-875e-1e7513e439af admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:30.236893 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1bb94e-3650-4a02-8a1a-1cc1e0262f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b6a49c587743d1ada58abc255c059a)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:30.239917 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1bb94e-3650-4a02-8a1a-1cc1e0262f06 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:30.258680 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a8835-0c8e-4ee5-b9b6-5be0a6b213fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:30.262953 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a8835-0c8e-4ee5-b9b6-5be0a6b213fe admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:30.265736 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a8835-0c8e-4ee5-b9b6-5be0a6b213fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:30.266314 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a8835-0c8e-4ee5-b9b6-5be0a6b213fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:30.268618 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a8835-0c8e-4ee5-b9b6-5be0a6b213fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:30.280441 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a8835-0c8e-4ee5-b9b6-5be0a6b213fe admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:30.339336 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 897/1814] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:30.343985 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccfdb1-bc1e-4f53-8c35-25b98fdd0290 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:30.344509 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccfdb1-bc1e-4f53-8c35-25b98fdd0290 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:30.346513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccfdb1-bc1e-4f53-8c35-25b98fdd0290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:30.383804 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4a1bb94e-3650-4a02-8a1a-1cc1e0262f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b6a49c587743d1ada58abc255c059a', 'request_id': 'req-4a1bb94e-3650-4a02-8a1a-1cc1e0262f06'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:30.412390 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4a1bb94e-3650-4a02-8a1a-1cc1e0262f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b6a49c587743d1ada58abc255c059a', 'request_id': 'req-4a1bb94e-3650-4a02-8a1a-1cc1e0262f06'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:30.422997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-4dccfdb1-bc1e-4f53-8c35-25b98fdd0290 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:30.425103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-4dccfdb1-bc1e-4f53-8c35-25b98fdd0290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:30.425352 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4a1bb94e-3650-4a02-8a1a-1cc1e0262f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b6a49c587743d1ada58abc255c059a', 'request_id': 'req-4a1bb94e-3650-4a02-8a1a-1cc1e0262f06'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:30.460974 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4a1bb94e-3650-4a02-8a1a-1cc1e0262f06 admin admin] The token cache is being invalidate because project 76b6a49c587743d1ada58abc255c059a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:40:30.461733 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4a1bb94e-3650-4a02-8a1a-1cc1e0262f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:30.462966 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-4a1bb94e-3650-4a02-8a1a-1cc1e0262f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:30.466856 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 918/1815] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:29 2022] DELETE /identity/v3/projects/76b6a49c587743d1ada58abc255c059a => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:30.467939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bb94e-3650-4a02-8a1a-1cc1e0262f06 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:30.476641 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4a1bb94e-3650-4a02-8a1a-1cc1e0262f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:30.494454 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:30.622170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 898/1816] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:30.626074 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccfdb1-bc1e-4f53-8c35-25b98fdd0290 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:30.627519 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-4dccfdb1-bc1e-4f53-8c35-25b98fdd0290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:30.650541 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccfdb1-bc1e-4f53-8c35-25b98fdd0290 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:30.662258 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7a0ab-ad08-42d7-baae-51779a128f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:30.662258 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7a0ab-ad08-42d7-baae-51779a128f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:30.662258 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7a0ab-ad08-42d7-baae-51779a128f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:30.662831 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7a0ab-ad08-42d7-baae-51779a128f7e admin admin] PATH_INFO: `/v3/projects/393c38bc752a4fc7933b614e39b1f419/users/85e1d1db9d4948758bf180994e6e1df3/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:30.678760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bb94e-3650-4a02-8a1a-1cc1e0262f06 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:30.689120 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7a0ab-ad08-42d7-baae-51779a128f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=393c38bc752a4fc7933b614e39b1f419, user_id=85e1d1db9d4948758bf180994e6e1df3, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:30.692898 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7a0ab-ad08-42d7-baae-51779a128f7e admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:30.696373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5318e6b-0e6e-485e-af57-709bdba39186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:30.697324 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5318e6b-0e6e-485e-af57-709bdba39186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:30.698187 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5318e6b-0e6e-485e-af57-709bdba39186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:30.698593 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5318e6b-0e6e-485e-af57-709bdba39186 admin admin] PATH_INFO: `/v3/users/1bfc3b9974ad4054b2b98b78e627811e` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:30.703601 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5318e6b-0e6e-485e-af57-709bdba39186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bfc3b9974ad4054b2b98b78e627811e)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:30.709981 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5318e6b-0e6e-485e-af57-709bdba39186 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:30.728201 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 899/1817] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:30 2022] PUT /identity/v3/projects/393c38bc752a4fc7933b614e39b1f419/users/85e1d1db9d4948758bf180994e6e1df3/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:30.729511 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7a0ab-ad08-42d7-baae-51779a128f7e admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:30.737956 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-80a7a0ab-ad08-42d7-baae-51779a128f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:30.835413 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d5318e6b-0e6e-485e-af57-709bdba39186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bfc3b9974ad4054b2b98b78e627811e'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:30.865263 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d5318e6b-0e6e-485e-af57-709bdba39186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bfc3b9974ad4054b2b98b78e627811e'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:30.890104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:30.897361 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d5318e6b-0e6e-485e-af57-709bdba39186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bfc3b9974ad4054b2b98b78e627811e'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:30.899352 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d5318e6b-0e6e-485e-af57-709bdba39186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bfc3b9974ad4054b2b98b78e627811e'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:30.900726 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d5318e6b-0e6e-485e-af57-709bdba39186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bfc3b9974ad4054b2b98b78e627811e'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:30.953454 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 919/1818] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:40:30 2022] DELETE /identity/v3/users/1bfc3b9974ad4054b2b98b78e627811e => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:30.956541 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5318e6b-0e6e-485e-af57-709bdba39186 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:30.961382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d5318e6b-0e6e-485e-af57-709bdba39186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:30.999785 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7a0ab-ad08-42d7-baae-51779a128f7e admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:31.159392 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5318e6b-0e6e-485e-af57-709bdba39186 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:31.166891 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20f890-a3e3-4018-8343-5a1647482e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:31.168325 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20f890-a3e3-4018-8343-5a1647482e5d service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:31.168815 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20f890-a3e3-4018-8343-5a1647482e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:31.169257 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20f890-a3e3-4018-8343-5a1647482e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:31.172675 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-bc20f890-a3e3-4018-8343-5a1647482e5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:31.227977 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b02aa-2833-455e-a8c7-e5c3f3442f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:31.229590 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b02aa-2833-455e-a8c7-e5c3f3442f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:31.238267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b02aa-2833-455e-a8c7-e5c3f3442f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:31.239383 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b02aa-2833-455e-a8c7-e5c3f3442f8c admin admin] PATH_INFO: `/v3/users/e44a075756b0406289c6fba9873e136a` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:31.243095 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b02aa-2833-455e-a8c7-e5c3f3442f8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e44a075756b0406289c6fba9873e136a)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:31.250143 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b02aa-2833-455e-a8c7-e5c3f3442f8c admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:31.282715 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:31.391460 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20f890-a3e3-4018-8343-5a1647482e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:31.394567 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20f890-a3e3-4018-8343-5a1647482e5d service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:31.451827 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 920/1819] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:31.453118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20f890-a3e3-4018-8343-5a1647482e5d service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:31.459237 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-ef8b02aa-2833-455e-a8c7-e5c3f3442f8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e44a075756b0406289c6fba9873e136a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:31.463658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-bc20f890-a3e3-4018-8343-5a1647482e5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:31.488044 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-ef8b02aa-2833-455e-a8c7-e5c3f3442f8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e44a075756b0406289c6fba9873e136a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:31.501105 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20f890-a3e3-4018-8343-5a1647482e5d service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:31.532643 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-ef8b02aa-2833-455e-a8c7-e5c3f3442f8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e44a075756b0406289c6fba9873e136a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:31.534853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-ef8b02aa-2833-455e-a8c7-e5c3f3442f8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e44a075756b0406289c6fba9873e136a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:31.537139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-ef8b02aa-2833-455e-a8c7-e5c3f3442f8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e44a075756b0406289c6fba9873e136a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:31.538355 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea287a95-2dcc-4e74-85f0-fc699e852569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:31.539380 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea287a95-2dcc-4e74-85f0-fc699e852569 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:31.539912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea287a95-2dcc-4e74-85f0-fc699e852569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:31.540538 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea287a95-2dcc-4e74-85f0-fc699e852569 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:31.541716 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea287a95-2dcc-4e74-85f0-fc699e852569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:31.545122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea287a95-2dcc-4e74-85f0-fc699e852569 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:31.569845 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 921/1820] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:31.569845 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a8471-bf42-4f67-87f4-4c8971f0669b None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:31.569845 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a8471-bf42-4f67-87f4-4c8971f0669b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:31.569845 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a8471-bf42-4f67-87f4-4c8971f0669b None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:31.573182 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 922/1821] 10.222.0.69 () {54 vars in 921 bytes} [Mon Aug 29 21:40:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:40:31.574461 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a8471-bf42-4f67-87f4-4c8971f0669b None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:31.577370 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cb7a8471-bf42-4f67-87f4-4c8971f0669b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:31.585883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 900/1822] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:40:30 2022] DELETE /identity/v3/users/e44a075756b0406289c6fba9873e136a => generated 0 bytes in 856 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:31.591573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2956d79-5c0d-48f8-b263-ae3c54ffa15d None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:31.592022 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2956d79-5c0d-48f8-b263-ae3c54ffa15d None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:31.592363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2956d79-5c0d-48f8-b263-ae3c54ffa15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:31.656991 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-e2956d79-5c0d-48f8-b263-ae3c54ffa15d None None] MFA Rules not processed for user `96c35c544cae4ad187f1a1be723e0d21`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:31.658465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-e2956d79-5c0d-48f8-b263-ae3c54ffa15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:31.847498 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a8471-bf42-4f67-87f4-4c8971f0669b None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:31.856474 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6542e67-7255-4d81-848a-39328c3a6b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:31.856474 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6542e67-7255-4d81-848a-39328c3a6b0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:31.857417 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6542e67-7255-4d81-848a-39328c3a6b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:31.857744 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6542e67-7255-4d81-848a-39328c3a6b0c admin admin] PATH_INFO: `/v3/projects/393c38bc752a4fc7933b614e39b1f419/users/85e1d1db9d4948758bf180994e6e1df3/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:31.860814 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6542e67-7255-4d81-848a-39328c3a6b0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=393c38bc752a4fc7933b614e39b1f419, user_id=85e1d1db9d4948758bf180994e6e1df3, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:31.866047 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6542e67-7255-4d81-848a-39328c3a6b0c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:31.875190 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:31.908071 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 923/1823] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:31 2022] PUT /identity/v3/projects/393c38bc752a4fc7933b614e39b1f419/users/85e1d1db9d4948758bf180994e6e1df3/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:31.912630 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887af3e0-0bb2-4579-9dec-c252b3904921 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:31.912630 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887af3e0-0bb2-4579-9dec-c252b3904921 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:31.913042 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887af3e0-0bb2-4579-9dec-c252b3904921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:31.990606 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 901/1824] 10.222.0.69 () {58 vars in 1018 bytes} [Mon Aug 29 21:40:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:40:32.008790 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2956d79-5c0d-48f8-b263-ae3c54ffa15d None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:32.009213 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-887af3e0-0bb2-4579-9dec-c252b3904921 None None] MFA Rules not processed for user `85e1d1db9d4948758bf180994e6e1df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:32.012046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-887af3e0-0bb2-4579-9dec-c252b3904921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:32.012388 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-e2956d79-5c0d-48f8-b263-ae3c54ffa15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:32.058753 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2956d79-5c0d-48f8-b263-ae3c54ffa15d None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:32.282794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430aca2d-4995-4caf-b5d0-d68cbe42fb3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:32.282794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430aca2d-4995-4caf-b5d0-d68cbe42fb3a service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:32.282794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430aca2d-4995-4caf-b5d0-d68cbe42fb3a service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:32.282794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430aca2d-4995-4caf-b5d0-d68cbe42fb3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:32.297942 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 924/1825] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:31 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:40:32.299680 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887af3e0-0bb2-4579-9dec-c252b3904921 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:32.302710 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-887af3e0-0bb2-4579-9dec-c252b3904921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:32.313044 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430aca2d-4995-4caf-b5d0-d68cbe42fb3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:32.315123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430aca2d-4995-4caf-b5d0-d68cbe42fb3a service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:32.349433 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 902/1826] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:40:32.369998 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430aca2d-4995-4caf-b5d0-d68cbe42fb3a service nova] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:32.373538 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-430aca2d-4995-4caf-b5d0-d68cbe42fb3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:32.497406 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:32.542412 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887af3e0-0bb2-4579-9dec-c252b3904921 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:32.547828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d943a8-8d2b-4a32-aca4-77c992c7b945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:32.548616 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d943a8-8d2b-4a32-aca4-77c992c7b945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:32.548894 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d943a8-8d2b-4a32-aca4-77c992c7b945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:32.549146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d943a8-8d2b-4a32-aca4-77c992c7b945 admin admin] PATH_INFO: `/v3/projects/cb2410a89e564b7d9ecf3c4501fd4026` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:32.551136 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d943a8-8d2b-4a32-aca4-77c992c7b945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb2410a89e564b7d9ecf3c4501fd4026)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:32.553226 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d943a8-8d2b-4a32-aca4-77c992c7b945 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:32.620323 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430aca2d-4995-4caf-b5d0-d68cbe42fb3a service nova] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:32.627389 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7eceb-1246-4da2-ab96-fbdd96d2d62e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:32.628480 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7eceb-1246-4da2-ab96-fbdd96d2d62e service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:32.629003 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7eceb-1246-4da2-ab96-fbdd96d2d62e service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:32.629495 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7eceb-1246-4da2-ab96-fbdd96d2d62e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:32.658316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-19d943a8-8d2b-4a32-aca4-77c992c7b945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb2410a89e564b7d9ecf3c4501fd4026', 'request_id': 'req-19d943a8-8d2b-4a32-aca4-77c992c7b945'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:32.692073 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-19d943a8-8d2b-4a32-aca4-77c992c7b945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb2410a89e564b7d9ecf3c4501fd4026', 'request_id': 'req-19d943a8-8d2b-4a32-aca4-77c992c7b945'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:32.703490 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-19d943a8-8d2b-4a32-aca4-77c992c7b945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb2410a89e564b7d9ecf3c4501fd4026', 'request_id': 'req-19d943a8-8d2b-4a32-aca4-77c992c7b945'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:32.710770 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7eceb-1246-4da2-ab96-fbdd96d2d62e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:32.717249 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7eceb-1246-4da2-ab96-fbdd96d2d62e service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:32.737225 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-19d943a8-8d2b-4a32-aca4-77c992c7b945 admin admin] The token cache is being invalidate because project cb2410a89e564b7d9ecf3c4501fd4026 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:40:32.740213 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-19d943a8-8d2b-4a32-aca4-77c992c7b945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:32.742124 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-19d943a8-8d2b-4a32-aca4-77c992c7b945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:32.763914 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 925/1827] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:32 2022] DELETE /identity/v3/projects/cb2410a89e564b7d9ecf3c4501fd4026 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:32.774009 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b124db-7e64-42db-a197-25983aa520a4 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:32.774530 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b124db-7e64-42db-a197-25983aa520a4 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:32.774942 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b124db-7e64-42db-a197-25983aa520a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:32.784573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 903/1828] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:32 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:32.819954 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-69b124db-7e64-42db-a197-25983aa520a4 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:32.821767 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-69b124db-7e64-42db-a197-25983aa520a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:32.936319 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7eceb-1246-4da2-ab96-fbdd96d2d62e service cinder] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:32.936319 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-71c7eceb-1246-4da2-ab96-fbdd96d2d62e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:32.993122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7eceb-1246-4da2-ab96-fbdd96d2d62e service cinder] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:33.136597 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 926/1829] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:33.137684 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b124db-7e64-42db-a197-25983aa520a4 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:33.157424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-69b124db-7e64-42db-a197-25983aa520a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:33.209871 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f39ad-6794-4a10-9a09-24b6b20e1070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:33.213271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f39ad-6794-4a10-9a09-24b6b20e1070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:33.214482 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f39ad-6794-4a10-9a09-24b6b20e1070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:33.216281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f39ad-6794-4a10-9a09-24b6b20e1070 admin admin] PATH_INFO: `/v3/projects/48621a6c00b1442cbb1c0f54a956b760` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:33.218835 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f39ad-6794-4a10-9a09-24b6b20e1070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48621a6c00b1442cbb1c0f54a956b760)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:33.224398 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f39ad-6794-4a10-9a09-24b6b20e1070 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:33.258509 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:33.356071 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b124db-7e64-42db-a197-25983aa520a4 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:33.368773 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b13f39ad-6794-4a10-9a09-24b6b20e1070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48621a6c00b1442cbb1c0f54a956b760', 'request_id': 'req-b13f39ad-6794-4a10-9a09-24b6b20e1070'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:33.386499 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b13f39ad-6794-4a10-9a09-24b6b20e1070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48621a6c00b1442cbb1c0f54a956b760', 'request_id': 'req-b13f39ad-6794-4a10-9a09-24b6b20e1070'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:33.395534 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:33.406811 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b13f39ad-6794-4a10-9a09-24b6b20e1070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48621a6c00b1442cbb1c0f54a956b760', 'request_id': 'req-b13f39ad-6794-4a10-9a09-24b6b20e1070'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:33.440361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b13f39ad-6794-4a10-9a09-24b6b20e1070 admin admin] The token cache is being invalidate because project 48621a6c00b1442cbb1c0f54a956b760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:40:33.440831 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b13f39ad-6794-4a10-9a09-24b6b20e1070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:33.442037 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b13f39ad-6794-4a10-9a09-24b6b20e1070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:33.449594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 904/1830] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:32 2022] DELETE /identity/v3/projects/48621a6c00b1442cbb1c0f54a956b760 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:33.449594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760e9c0-a8fc-46f0-8152-73122dc69de6 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:33.449594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760e9c0-a8fc-46f0-8152-73122dc69de6 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:33.449594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760e9c0-a8fc-46f0-8152-73122dc69de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:33.456136 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9711c7-3723-44cd-88c2-a784ee0353c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:33.457513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9711c7-3723-44cd-88c2-a784ee0353c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:33.458527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9711c7-3723-44cd-88c2-a784ee0353c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:33.459009 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9711c7-3723-44cd-88c2-a784ee0353c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:33.464079 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ff9711c7-3723-44cd-88c2-a784ee0353c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:33.478422 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-2760e9c0-a8fc-46f0-8152-73122dc69de6 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:33.480413 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-2760e9c0-a8fc-46f0-8152-73122dc69de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:33.599597 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 905/1831] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:33.601894 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0390655-c957-4931-991e-084738afae24 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:33.602540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0390655-c957-4931-991e-084738afae24 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:33.604306 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0390655-c957-4931-991e-084738afae24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:33.613888 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9711c7-3723-44cd-88c2-a784ee0353c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:33.615552 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9711c7-3723-44cd-88c2-a784ee0353c5 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:33.629681 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 927/1832] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:33 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:33.631257 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9711c7-3723-44cd-88c2-a784ee0353c5 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:33.675242 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-b0390655-c957-4931-991e-084738afae24 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:33.685113 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9711c7-3723-44cd-88c2-a784ee0353c5 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:33.689871 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-b0390655-c957-4931-991e-084738afae24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:33.733594 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34636306-be30-4df0-9c50-5488cf2ec6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:33.736566 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34636306-be30-4df0-9c50-5488cf2ec6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:33.738672 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34636306-be30-4df0-9c50-5488cf2ec6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:33.740422 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34636306-be30-4df0-9c50-5488cf2ec6c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:33.744239 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34636306-be30-4df0-9c50-5488cf2ec6c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:40:33.751726 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34636306-be30-4df0-9c50-5488cf2ec6c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:33.763833 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 906/1833] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:33.780429 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd070bd8-9da1-4238-9ef8-9c26d25ec983 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:33.780429 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd070bd8-9da1-4238-9ef8-9c26d25ec983 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:33.780429 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd070bd8-9da1-4238-9ef8-9c26d25ec983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:33.789092 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34636306-be30-4df0-9c50-5488cf2ec6c0 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:33.858795 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-fd070bd8-9da1-4238-9ef8-9c26d25ec983 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:33.886778 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-fd070bd8-9da1-4238-9ef8-9c26d25ec983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:33.887711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 928/1834] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:40:33.891917 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34636306-be30-4df0-9c50-5488cf2ec6c0 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:33.896788 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-34636306-be30-4df0-9c50-5488cf2ec6c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:33.928854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34636306-be30-4df0-9c50-5488cf2ec6c0 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:33.934334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 907/1835] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:33.943216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd070bd8-9da1-4238-9ef8-9c26d25ec983 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:33.943432 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d7509-6b07-4dcf-a1d3-56c7f90d066a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:33.944291 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d7509-6b07-4dcf-a1d3-56c7f90d066a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:33.944645 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d7509-6b07-4dcf-a1d3-56c7f90d066a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:33.944928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d7509-6b07-4dcf-a1d3-56c7f90d066a admin admin] PATH_INFO: `/v3/projects/510e7ba9e7f84d76a98ebb82899d8ed3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:33.949293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d7509-6b07-4dcf-a1d3-56c7f90d066a admin admin] RBAC: Authorizing `identity:delete_project(project_id=510e7ba9e7f84d76a98ebb82899d8ed3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:33.951770 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d7509-6b07-4dcf-a1d3-56c7f90d066a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:34.014176 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd070bd8-9da1-4238-9ef8-9c26d25ec983 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:34.026895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c8eeb-a6cd-49be-abad-40f9c1d5d895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:34.028302 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c8eeb-a6cd-49be-abad-40f9c1d5d895 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:34.028982 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c8eeb-a6cd-49be-abad-40f9c1d5d895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:34.029968 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c8eeb-a6cd-49be-abad-40f9c1d5d895 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:34.031760 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c8eeb-a6cd-49be-abad-40f9c1d5d895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:34.037327 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c8eeb-a6cd-49be-abad-40f9c1d5d895 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:34.097628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 908/1836] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:40:33 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:34.097628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c8eeb-a6cd-49be-abad-40f9c1d5d895 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:34.122042 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-b61d7509-6b07-4dcf-a1d3-56c7f90d066a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '510e7ba9e7f84d76a98ebb82899d8ed3', 'request_id': 'req-b61d7509-6b07-4dcf-a1d3-56c7f90d066a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:34.155964 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-b61d7509-6b07-4dcf-a1d3-56c7f90d066a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '510e7ba9e7f84d76a98ebb82899d8ed3', 'request_id': 'req-b61d7509-6b07-4dcf-a1d3-56c7f90d066a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:34.180220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-b61d7509-6b07-4dcf-a1d3-56c7f90d066a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '510e7ba9e7f84d76a98ebb82899d8ed3', 'request_id': 'req-b61d7509-6b07-4dcf-a1d3-56c7f90d066a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:34.255068 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-b61d7509-6b07-4dcf-a1d3-56c7f90d066a admin admin] The token cache is being invalidate because project 510e7ba9e7f84d76a98ebb82899d8ed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:40:34.257189 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-b61d7509-6b07-4dcf-a1d3-56c7f90d066a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:34.259014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-b61d7509-6b07-4dcf-a1d3-56c7f90d066a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:34.261835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 929/1837] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:33 2022] DELETE /identity/v3/projects/510e7ba9e7f84d76a98ebb82899d8ed3 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:34.269154 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d7509-6b07-4dcf-a1d3-56c7f90d066a admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:34.272553 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b61d7509-6b07-4dcf-a1d3-56c7f90d066a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:34.370854 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c8eeb-a6cd-49be-abad-40f9c1d5d895 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:34.381260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29563edc-0ce2-43dc-8348-acec4a0fdad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:34.382235 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29563edc-0ce2-43dc-8348-acec4a0fdad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:34.382679 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29563edc-0ce2-43dc-8348-acec4a0fdad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:34.383101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29563edc-0ce2-43dc-8348-acec4a0fdad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:34.383939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29563edc-0ce2-43dc-8348-acec4a0fdad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:40:34.384480 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29563edc-0ce2-43dc-8348-acec4a0fdad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:34.387521 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29563edc-0ce2-43dc-8348-acec4a0fdad5 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:34.398695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:34.409387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 909/1838] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:40:34.410860 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29563edc-0ce2-43dc-8348-acec4a0fdad5 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:34.415753 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-29563edc-0ce2-43dc-8348-acec4a0fdad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:34.455726 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:34.479589 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29563edc-0ce2-43dc-8348-acec4a0fdad5 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:34.497342 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dfc46a-8d9b-4469-90fe-990d2cedb7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:34.509492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfc46a-8d9b-4469-90fe-990d2cedb7bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:34.512557 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfc46a-8d9b-4469-90fe-990d2cedb7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:34.513177 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfc46a-8d9b-4469-90fe-990d2cedb7bf admin admin] PATH_INFO: `/v3/users/e692d8890f884ee0aebbf510a41da09e` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:34.519140 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dfc46a-8d9b-4469-90fe-990d2cedb7bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e692d8890f884ee0aebbf510a41da09e)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:34.532046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d7509-6b07-4dcf-a1d3-56c7f90d066a admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:34.533523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dfc46a-8d9b-4469-90fe-990d2cedb7bf admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:34.548651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce790f5-b646-43d1-8113-f294edab98fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:34.549929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce790f5-b646-43d1-8113-f294edab98fa admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:34.554209 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce790f5-b646-43d1-8113-f294edab98fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:34.554729 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce790f5-b646-43d1-8113-f294edab98fa admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:34.555701 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce790f5-b646-43d1-8113-f294edab98fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:34.558266 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce790f5-b646-43d1-8113-f294edab98fa admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:34.628254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 930/1839] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:34 2022] POST /identity/v3/users => generated 290 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:34.631380 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce790f5-b646-43d1-8113-f294edab98fa admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:34.634522 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-6ce790f5-b646-43d1-8113-f294edab98fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:34.662016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce790f5-b646-43d1-8113-f294edab98fa admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:34.678005 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b111853-9752-46de-8264-a432ecfefb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:34.680151 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b111853-9752-46de-8264-a432ecfefb19 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:34.682325 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b111853-9752-46de-8264-a432ecfefb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:34.682754 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b111853-9752-46de-8264-a432ecfefb19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:34.683774 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b111853-9752-46de-8264-a432ecfefb19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:34.687196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b111853-9752-46de-8264-a432ecfefb19 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:34.743133 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-13dfc46a-8d9b-4469-90fe-990d2cedb7bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e692d8890f884ee0aebbf510a41da09e'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:34.751472 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 931/1840] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:40:34 2022] POST /identity/v3/projects => generated 393 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:34.753240 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b111853-9752-46de-8264-a432ecfefb19 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:34.771038 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-13dfc46a-8d9b-4469-90fe-990d2cedb7bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e692d8890f884ee0aebbf510a41da09e'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:34.822215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-13dfc46a-8d9b-4469-90fe-990d2cedb7bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e692d8890f884ee0aebbf510a41da09e'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:34.823442 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-13dfc46a-8d9b-4469-90fe-990d2cedb7bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e692d8890f884ee0aebbf510a41da09e'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:34.824722 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-13dfc46a-8d9b-4469-90fe-990d2cedb7bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e692d8890f884ee0aebbf510a41da09e'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:34.870208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 910/1841] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:40:34 2022] DELETE /identity/v3/users/e692d8890f884ee0aebbf510a41da09e => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:34.872115 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dfc46a-8d9b-4469-90fe-990d2cedb7bf admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:34.877981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-13dfc46a-8d9b-4469-90fe-990d2cedb7bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:34.944926 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b111853-9752-46de-8264-a432ecfefb19 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:35.029677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dfc46a-8d9b-4469-90fe-990d2cedb7bf admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:35.038005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e750b-69bc-46d2-93b5-04062efce6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:35.039062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e750b-69bc-46d2-93b5-04062efce6f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:35.039062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e750b-69bc-46d2-93b5-04062efce6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:35.039475 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e750b-69bc-46d2-93b5-04062efce6f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:35.040069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e750b-69bc-46d2-93b5-04062efce6f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:35.044260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e750b-69bc-46d2-93b5-04062efce6f2 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:35.074425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 911/1842] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:34 2022] POST /identity/v3/users => generated 297 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:35.080531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e750b-69bc-46d2-93b5-04062efce6f2 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:35.102736 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e750b-69bc-46d2-93b5-04062efce6f2 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:35.110606 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e2cd0-df1c-43b1-a360-13895bde700a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:35.112055 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e2cd0-df1c-43b1-a360-13895bde700a admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:35.112055 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e2cd0-df1c-43b1-a360-13895bde700a admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:35.112055 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e2cd0-df1c-43b1-a360-13895bde700a admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:35.112566 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e2cd0-df1c-43b1-a360-13895bde700a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:35.115667 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e2cd0-df1c-43b1-a360-13895bde700a admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:35.132463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 912/1843] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:35.136904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e2cd0-df1c-43b1-a360-13895bde700a admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:35.138239 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f803bb-1922-4228-b560-ad87bee07a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:35.139448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f803bb-1922-4228-b560-ad87bee07a11 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:35.140614 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f803bb-1922-4228-b560-ad87bee07a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:35.141588 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f803bb-1922-4228-b560-ad87bee07a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:35.142953 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f803bb-1922-4228-b560-ad87bee07a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:35.146273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f803bb-1922-4228-b560-ad87bee07a11 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:35.163964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e2cd0-df1c-43b1-a360-13895bde700a admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:35.168665 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 932/1844] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:35.172556 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefca01-ceab-4a52-8622-03a77a862867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:35.173221 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefca01-ceab-4a52-8622-03a77a862867 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:35.175485 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefca01-ceab-4a52-8622-03a77a862867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:35.175485 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefca01-ceab-4a52-8622-03a77a862867 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:35.175736 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f803bb-1922-4228-b560-ad87bee07a11 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:35.175824 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefca01-ceab-4a52-8622-03a77a862867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:35.178366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-07f803bb-1922-4228-b560-ad87bee07a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:35.178592 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefca01-ceab-4a52-8622-03a77a862867 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:35.193021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f803bb-1922-4228-b560-ad87bee07a11 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:35.196247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 913/1845] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:35.199062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b4e03-8a71-4bf6-b9ae-fcafffdd22e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:35.199785 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b4e03-8a71-4bf6-b9ae-fcafffdd22e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:35.200161 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefca01-ceab-4a52-8622-03a77a862867 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:35.200311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b4e03-8a71-4bf6-b9ae-fcafffdd22e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:35.200580 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b4e03-8a71-4bf6-b9ae-fcafffdd22e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:35.201884 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b4e03-8a71-4bf6-b9ae-fcafffdd22e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:35.203590 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b4e03-8a71-4bf6-b9ae-fcafffdd22e0 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:35.212803 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefca01-ceab-4a52-8622-03a77a862867 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:35.217845 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072c36e-2c43-491d-b660-07d84a8d6f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:35.218544 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072c36e-2c43-491d-b660-07d84a8d6f9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:35.218824 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072c36e-2c43-491d-b660-07d84a8d6f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:35.219102 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072c36e-2c43-491d-b660-07d84a8d6f9d admin admin] PATH_INFO: `/v3/projects/6da9842f8f7644dfb84a87efae788a55/users/a664967479c847d9b19eef7913c4dbac/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:35.225119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 933/1846] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:40:35.226886 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b4e03-8a71-4bf6-b9ae-fcafffdd22e0 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:35.238904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b4e03-8a71-4bf6-b9ae-fcafffdd22e0 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:35.244568 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c072c36e-2c43-491d-b660-07d84a8d6f9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da9842f8f7644dfb84a87efae788a55, user_id=a664967479c847d9b19eef7913c4dbac, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:35.245679 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a45093-6b98-4990-855e-5c807c6fcf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:35.246615 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a45093-6b98-4990-855e-5c807c6fcf77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:35.246929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a45093-6b98-4990-855e-5c807c6fcf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:35.247321 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a45093-6b98-4990-855e-5c807c6fcf77 admin admin] PATH_INFO: `/v3/projects/10e4993aad4a4f6a99b99b4eca05ec75/users/1207c52a0f4f4720b9673995e4e3e575/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:35.247833 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c072c36e-2c43-491d-b660-07d84a8d6f9d admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:35.269262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a45093-6b98-4990-855e-5c807c6fcf77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10e4993aad4a4f6a99b99b4eca05ec75, user_id=1207c52a0f4f4720b9673995e4e3e575, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:35.272767 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a45093-6b98-4990-855e-5c807c6fcf77 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:35.284571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 914/1847] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:35 2022] PUT /identity/v3/projects/6da9842f8f7644dfb84a87efae788a55/users/a664967479c847d9b19eef7913c4dbac/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:40:35.288220 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca75002-bc19-4127-b7a0-658a873da920 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:35.288927 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca75002-bc19-4127-b7a0-658a873da920 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:35.289458 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca75002-bc19-4127-b7a0-658a873da920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:35.295201 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 934/1848] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:35 2022] PUT /identity/v3/projects/10e4993aad4a4f6a99b99b4eca05ec75/users/1207c52a0f4f4720b9673995e4e3e575/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:35.307457 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486bf7c-58fa-490a-bbf1-e86a7823758e None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:35.308022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486bf7c-58fa-490a-bbf1-e86a7823758e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:35.308517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486bf7c-58fa-490a-bbf1-e86a7823758e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:35.341557 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:35.345279 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-bca75002-bc19-4127-b7a0-658a873da920 None None] MFA Rules not processed for user `a664967479c847d9b19eef7913c4dbac`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:35.347214 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-bca75002-bc19-4127-b7a0-658a873da920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:35.385162 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-a486bf7c-58fa-490a-bbf1-e86a7823758e None None] MFA Rules not processed for user `1207c52a0f4f4720b9673995e4e3e575`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:35.390415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a486bf7c-58fa-490a-bbf1-e86a7823758e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:35.468009 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 915/1849] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:35.469012 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca75002-bc19-4127-b7a0-658a873da920 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:35.470902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-bca75002-bc19-4127-b7a0-658a873da920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:35.525887 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:35.613576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca75002-bc19-4127-b7a0-658a873da920 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:35.627052 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf505c6c-9f0a-4cea-b701-d799cf93cdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:35.629707 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf505c6c-9f0a-4cea-b701-d799cf93cdc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:35.630087 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf505c6c-9f0a-4cea-b701-d799cf93cdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:35.630372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf505c6c-9f0a-4cea-b701-d799cf93cdc8 admin admin] PATH_INFO: `/v3/projects/0a68c4bf2a2a4eae88d90728ebb46df5` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:35.632562 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf505c6c-9f0a-4cea-b701-d799cf93cdc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a68c4bf2a2a4eae88d90728ebb46df5)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:35.637369 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf505c6c-9f0a-4cea-b701-d799cf93cdc8 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:35.766933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 935/1850] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:40:35.766933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486bf7c-58fa-490a-bbf1-e86a7823758e None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:35.801157 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486bf7c-58fa-490a-bbf1-e86a7823758e None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:35.818349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-bf505c6c-9f0a-4cea-b701-d799cf93cdc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a68c4bf2a2a4eae88d90728ebb46df5', 'request_id': 'req-bf505c6c-9f0a-4cea-b701-d799cf93cdc8'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:35.857899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-bf505c6c-9f0a-4cea-b701-d799cf93cdc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a68c4bf2a2a4eae88d90728ebb46df5', 'request_id': 'req-bf505c6c-9f0a-4cea-b701-d799cf93cdc8'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:35.872928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-bf505c6c-9f0a-4cea-b701-d799cf93cdc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a68c4bf2a2a4eae88d90728ebb46df5', 'request_id': 'req-bf505c6c-9f0a-4cea-b701-d799cf93cdc8'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:35.902792 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-bf505c6c-9f0a-4cea-b701-d799cf93cdc8 admin admin] The token cache is being invalidate because project 0a68c4bf2a2a4eae88d90728ebb46df5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:40:35.903126 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-bf505c6c-9f0a-4cea-b701-d799cf93cdc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:35.903799 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-bf505c6c-9f0a-4cea-b701-d799cf93cdc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:35.906130 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 916/1851] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:35 2022] DELETE /identity/v3/projects/0a68c4bf2a2a4eae88d90728ebb46df5 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:35.907203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf505c6c-9f0a-4cea-b701-d799cf93cdc8 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:35.909399 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-bf505c6c-9f0a-4cea-b701-d799cf93cdc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:35.949170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9fad5-e8cc-4945-9476-bed1bb147e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:35.950285 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9fad5-e8cc-4945-9476-bed1bb147e22 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:35.951845 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9fad5-e8cc-4945-9476-bed1bb147e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:35.952416 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9fad5-e8cc-4945-9476-bed1bb147e22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:35.954034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9fad5-e8cc-4945-9476-bed1bb147e22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:35.958263 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9fad5-e8cc-4945-9476-bed1bb147e22 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:35.996564 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:36.044875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 936/1852] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:40:35 2022] POST /identity/v3/projects => generated 393 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:36.047957 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33116c-b821-40c3-936e-a8f61c74a323 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:36.049836 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33116c-b821-40c3-936e-a8f61c74a323 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:36.050356 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33116c-b821-40c3-936e-a8f61c74a323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:36.078307 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf505c6c-9f0a-4cea-b701-d799cf93cdc8 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:36.151107 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ff33116c-b821-40c3-936e-a8f61c74a323 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:36.153669 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ff33116c-b821-40c3-936e-a8f61c74a323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:36.234975 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300f3cb-2f03-4769-8aba-4e2a2d5d1e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:36.236250 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300f3cb-2f03-4769-8aba-4e2a2d5d1e1d admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:36.237003 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300f3cb-2f03-4769-8aba-4e2a2d5d1e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:36.237391 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300f3cb-2f03-4769-8aba-4e2a2d5d1e1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:36.240497 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300f3cb-2f03-4769-8aba-4e2a2d5d1e1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:36.243721 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300f3cb-2f03-4769-8aba-4e2a2d5d1e1d admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:36.283100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 917/1853] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:40:35 2022] POST /identity/v3/projects => generated 377 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:36.284347 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300f3cb-2f03-4769-8aba-4e2a2d5d1e1d admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:36.290191 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-3300f3cb-2f03-4769-8aba-4e2a2d5d1e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:36.310651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 937/1854] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:36.312169 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33116c-b821-40c3-936e-a8f61c74a323 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:36.334408 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33116c-b821-40c3-936e-a8f61c74a323 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:36.397672 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:36.431922 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300f3cb-2f03-4769-8aba-4e2a2d5d1e1d admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:36.437642 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654488d4-65b3-46a6-9451-902e30abaaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:36.437944 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600038cb-6b0f-4d3f-8ae3-bad07576e298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:36.438295 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600038cb-6b0f-4d3f-8ae3-bad07576e298 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:36.438625 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600038cb-6b0f-4d3f-8ae3-bad07576e298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:36.438894 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600038cb-6b0f-4d3f-8ae3-bad07576e298 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:36.439544 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600038cb-6b0f-4d3f-8ae3-bad07576e298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:36.440841 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654488d4-65b3-46a6-9451-902e30abaaa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:36.441134 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654488d4-65b3-46a6-9451-902e30abaaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:36.441438 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654488d4-65b3-46a6-9451-902e30abaaa2 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:36.441643 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600038cb-6b0f-4d3f-8ae3-bad07576e298 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:36.442110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654488d4-65b3-46a6-9451-902e30abaaa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:36.444134 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654488d4-65b3-46a6-9451-902e30abaaa2 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:36.472900 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 918/1855] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:36 2022] POST /identity/v3/users => generated 303 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:36.475943 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3036c9-ee5d-4525-a277-a0307d8f5dbf None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:36.476587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3036c9-ee5d-4525-a277-a0307d8f5dbf None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:36.477078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3036c9-ee5d-4525-a277-a0307d8f5dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:36.478940 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 938/1856] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:36 2022] POST /identity/v3/users => generated 295 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:36.480010 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654488d4-65b3-46a6-9451-902e30abaaa2 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:36.493431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654488d4-65b3-46a6-9451-902e30abaaa2 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:36.501364 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8113116-f7af-48b0-a8ba-fc000a576715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:36.502007 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8113116-f7af-48b0-a8ba-fc000a576715 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:36.502359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8113116-f7af-48b0-a8ba-fc000a576715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:36.504558 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-3d3036c9-ee5d-4525-a277-a0307d8f5dbf None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:36.506210 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8113116-f7af-48b0-a8ba-fc000a576715 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:36.506902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-3d3036c9-ee5d-4525-a277-a0307d8f5dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:36.507025 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8113116-f7af-48b0-a8ba-fc000a576715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:36.508842 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8113116-f7af-48b0-a8ba-fc000a576715 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:36.524033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 919/1857] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:36.524033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3036c9-ee5d-4525-a277-a0307d8f5dbf None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:36.527877 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 939/1858] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:36.530170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8113116-f7af-48b0-a8ba-fc000a576715 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:36.544251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3036c9-ee5d-4525-a277-a0307d8f5dbf None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:36.546856 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8113116-f7af-48b0-a8ba-fc000a576715 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:36.555736 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36011c2-54e4-47eb-a2a3-e88484c06e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:36.556825 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36011c2-54e4-47eb-a2a3-e88484c06e89 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:36.557247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36011c2-54e4-47eb-a2a3-e88484c06e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:36.557691 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36011c2-54e4-47eb-a2a3-e88484c06e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:36.558880 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36011c2-54e4-47eb-a2a3-e88484c06e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:36.562401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36011c2-54e4-47eb-a2a3-e88484c06e89 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:36.566876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6462a-65ed-49f7-8623-0c5fd5232b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:36.567788 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6462a-65ed-49f7-8623-0c5fd5232b38 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:36.568217 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6462a-65ed-49f7-8623-0c5fd5232b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:36.568694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6462a-65ed-49f7-8623-0c5fd5232b38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:36.569814 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6462a-65ed-49f7-8623-0c5fd5232b38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:40:36.570284 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6462a-65ed-49f7-8623-0c5fd5232b38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:36.573478 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6462a-65ed-49f7-8623-0c5fd5232b38 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:36.597654 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 920/1859] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:36.597654 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36011c2-54e4-47eb-a2a3-e88484c06e89 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:36.597928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 940/1860] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:40:36.598406 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6462a-65ed-49f7-8623-0c5fd5232b38 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:36.610234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36011c2-54e4-47eb-a2a3-e88484c06e89 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:36.617783 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6462a-65ed-49f7-8623-0c5fd5232b38 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:36.623080 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6e98c-5317-4c10-b473-d78199beb650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:36.623329 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7fe6d-04e6-43b5-841d-3d75262bf6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:36.623954 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6e98c-5317-4c10-b473-d78199beb650 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:36.624284 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6e98c-5317-4c10-b473-d78199beb650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:36.624564 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6e98c-5317-4c10-b473-d78199beb650 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:36.625239 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6e98c-5317-4c10-b473-d78199beb650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:36.625606 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7fe6d-04e6-43b5-841d-3d75262bf6cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:36.626190 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7fe6d-04e6-43b5-841d-3d75262bf6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:36.626780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7fe6d-04e6-43b5-841d-3d75262bf6cb admin admin] PATH_INFO: `/v3/projects/d8d95e01ee7244e4bcebf67ae2b05830/users/b1664f5ad226408d8923be66475e66bf/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:36.627187 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6e98c-5317-4c10-b473-d78199beb650 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:36.660144 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7fe6d-04e6-43b5-841d-3d75262bf6cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8d95e01ee7244e4bcebf67ae2b05830, user_id=b1664f5ad226408d8923be66475e66bf, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:36.664937 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 941/1861] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:40:36 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:36.664937 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6e98c-5317-4c10-b473-d78199beb650 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:36.666911 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7fe6d-04e6-43b5-841d-3d75262bf6cb admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:36.694302 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 921/1862] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:36 2022] PUT /identity/v3/projects/d8d95e01ee7244e4bcebf67ae2b05830/users/b1664f5ad226408d8923be66475e66bf/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:36.695521 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7fe6d-04e6-43b5-841d-3d75262bf6cb admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:36.726032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:36.770679 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6e98c-5317-4c10-b473-d78199beb650 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:36.830464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7fe6d-04e6-43b5-841d-3d75262bf6cb admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:36.839812 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefb309-192a-4e27-9525-c5d5aa6984c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:36.840739 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefb309-192a-4e27-9525-c5d5aa6984c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:36.841188 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefb309-192a-4e27-9525-c5d5aa6984c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:36.841624 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefb309-192a-4e27-9525-c5d5aa6984c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:36.842787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefb309-192a-4e27-9525-c5d5aa6984c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:36.846909 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefb309-192a-4e27-9525-c5d5aa6984c2 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:36.889718 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 922/1863] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:36 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:36.891193 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefb309-192a-4e27-9525-c5d5aa6984c2 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:36.905462 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f4839-9947-421d-ade8-ae92b42d5469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:36.906612 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f4839-9947-421d-ade8-ae92b42d5469 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:36.907338 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f4839-9947-421d-ade8-ae92b42d5469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:36.907809 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f4839-9947-421d-ade8-ae92b42d5469 admin admin] PATH_INFO: `/v3/projects/b5419177056d48b0b3692fc17786caf9/users/9f7d538735f942549d14516fa2a1be7e/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:36.907924 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefb309-192a-4e27-9525-c5d5aa6984c2 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:36.915632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e1318-8279-46ed-9d66-b8e7ed95f941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:36.916681 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e1318-8279-46ed-9d66-b8e7ed95f941 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:36.917122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e1318-8279-46ed-9d66-b8e7ed95f941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:36.917570 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e1318-8279-46ed-9d66-b8e7ed95f941 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:36.918712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e1318-8279-46ed-9d66-b8e7ed95f941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:36.921777 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e1318-8279-46ed-9d66-b8e7ed95f941 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:36.937312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f4839-9947-421d-ade8-ae92b42d5469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5419177056d48b0b3692fc17786caf9, user_id=9f7d538735f942549d14516fa2a1be7e, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:36.941633 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 923/1864] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:36.942665 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f4839-9947-421d-ade8-ae92b42d5469 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:36.943671 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e1318-8279-46ed-9d66-b8e7ed95f941 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:36.963186 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e1318-8279-46ed-9d66-b8e7ed95f941 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:36.968744 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 942/1865] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:36 2022] PUT /identity/v3/projects/b5419177056d48b0b3692fc17786caf9/users/9f7d538735f942549d14516fa2a1be7e/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:36.969539 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f4839-9947-421d-ade8-ae92b42d5469 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:37.016671 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:37.113591 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bbd18-5f83-4f04-a93e-77e6b24048ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:37.115379 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bbd18-5f83-4f04-a93e-77e6b24048ea admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:37.116163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bbd18-5f83-4f04-a93e-77e6b24048ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:37.116887 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bbd18-5f83-4f04-a93e-77e6b24048ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:37.118606 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673bbd18-5f83-4f04-a93e-77e6b24048ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:37.122274 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673bbd18-5f83-4f04-a93e-77e6b24048ea admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:37.126260 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f4839-9947-421d-ade8-ae92b42d5469 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:37.136588 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323eb37-66b8-4e56-b29d-6b1224a227dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:37.137792 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323eb37-66b8-4e56-b29d-6b1224a227dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:37.138262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323eb37-66b8-4e56-b29d-6b1224a227dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:37.138764 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323eb37-66b8-4e56-b29d-6b1224a227dd admin admin] PATH_INFO: `/v3/projects/d8d95e01ee7244e4bcebf67ae2b05830/users/b1664f5ad226408d8923be66475e66bf/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:37.146005 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323eb37-66b8-4e56-b29d-6b1224a227dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8d95e01ee7244e4bcebf67ae2b05830, user_id=b1664f5ad226408d8923be66475e66bf, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:37.158673 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323eb37-66b8-4e56-b29d-6b1224a227dd admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:37.165960 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 924/1866] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:37.178292 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bbd18-5f83-4f04-a93e-77e6b24048ea admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:37.205997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bbd18-5f83-4f04-a93e-77e6b24048ea admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:37.218775 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 943/1867] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:36 2022] PUT /identity/v3/projects/d8d95e01ee7244e4bcebf67ae2b05830/users/b1664f5ad226408d8923be66475e66bf/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:37.224919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323eb37-66b8-4e56-b29d-6b1224a227dd admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:37.368570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323eb37-66b8-4e56-b29d-6b1224a227dd admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:37.377578 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bf246-0ce1-4e3b-8ba4-0b6ad790248d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:37.378493 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bf246-0ce1-4e3b-8ba4-0b6ad790248d admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:37.379037 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bf246-0ce1-4e3b-8ba4-0b6ad790248d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:37.379261 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bf246-0ce1-4e3b-8ba4-0b6ad790248d admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:37.380102 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93bf246-0ce1-4e3b-8ba4-0b6ad790248d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:37.382326 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93bf246-0ce1-4e3b-8ba4-0b6ad790248d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:37.397811 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 944/1868] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:37.399304 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb7887-e290-492f-b1ab-cfeffbd1a569 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:37.399597 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb7887-e290-492f-b1ab-cfeffbd1a569 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:37.399986 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb7887-e290-492f-b1ab-cfeffbd1a569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:37.421957 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f0296-3236-4573-84bb-9d9211b8914b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:37.422923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f0296-3236-4573-84bb-9d9211b8914b admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:37.423396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f0296-3236-4573-84bb-9d9211b8914b admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:37.423859 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f0296-3236-4573-84bb-9d9211b8914b admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:37.425018 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f0296-3236-4573-84bb-9d9211b8914b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:37.428670 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f0296-3236-4573-84bb-9d9211b8914b admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:37.437959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-5ddb7887-e290-492f-b1ab-cfeffbd1a569 None None] MFA Rules not processed for user `b1664f5ad226408d8923be66475e66bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:37.439467 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5ddb7887-e290-492f-b1ab-cfeffbd1a569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:37.449768 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 925/1869] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:37.449768 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f0296-3236-4573-84bb-9d9211b8914b admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:37.467373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f0296-3236-4573-84bb-9d9211b8914b admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:37.477369 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8adb97-25ad-45d1-8bb4-f03aeec35cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:37.478514 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8adb97-25ad-45d1-8bb4-f03aeec35cda admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:37.479022 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8adb97-25ad-45d1-8bb4-f03aeec35cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:37.479463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8adb97-25ad-45d1-8bb4-f03aeec35cda admin admin] PATH_INFO: `/v3/projects/6682955328a9424c806c9cec335c6d21/users/8997c4fde654411ca4e4eaad803a2a8c/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:37.517590 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8adb97-25ad-45d1-8bb4-f03aeec35cda admin admin] RBAC: Authorizing `identity:create_grant(project_id=6682955328a9424c806c9cec335c6d21, user_id=8997c4fde654411ca4e4eaad803a2a8c, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:37.524423 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8adb97-25ad-45d1-8bb4-f03aeec35cda admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:37.580100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:37.599285 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 945/1870] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:37 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:37.600330 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb7887-e290-492f-b1ab-cfeffbd1a569 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:37.602865 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 926/1871] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:37 2022] PUT /identity/v3/projects/6682955328a9424c806c9cec335c6d21/users/8997c4fde654411ca4e4eaad803a2a8c/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:37.624903 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8adb97-25ad-45d1-8bb4-f03aeec35cda admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:37.628864 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-1a8adb97-25ad-45d1-8bb4-f03aeec35cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:37.635018 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb7887-e290-492f-b1ab-cfeffbd1a569 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:37.690003 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:37.750048 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29af4b-a036-4549-aa73-e700f32c444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:37.751548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29af4b-a036-4549-aa73-e700f32c444d admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:37.753474 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29af4b-a036-4549-aa73-e700f32c444d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:37.753474 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29af4b-a036-4549-aa73-e700f32c444d admin admin] PATH_INFO: `/v3/projects/b5419177056d48b0b3692fc17786caf9/users/9f7d538735f942549d14516fa2a1be7e/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:37.777332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29af4b-a036-4549-aa73-e700f32c444d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5419177056d48b0b3692fc17786caf9, user_id=9f7d538735f942549d14516fa2a1be7e, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:37.786026 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29af4b-a036-4549-aa73-e700f32c444d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:37.810521 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 946/1872] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:37 2022] PUT /identity/v3/projects/b5419177056d48b0b3692fc17786caf9/users/9f7d538735f942549d14516fa2a1be7e/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:37.812809 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ddfa7-34b7-4b9d-add4-b35c938d82f1 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:37.813283 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ddfa7-34b7-4b9d-add4-b35c938d82f1 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:37.813756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ddfa7-34b7-4b9d-add4-b35c938d82f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:37.834817 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8adb97-25ad-45d1-8bb4-f03aeec35cda admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:37.879218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-249ddfa7-34b7-4b9d-add4-b35c938d82f1 None None] MFA Rules not processed for user `8997c4fde654411ca4e4eaad803a2a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:37.881897 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-249ddfa7-34b7-4b9d-add4-b35c938d82f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:37.934998 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede27f0a-a956-4a50-8bf1-9b969de17501 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:37.937502 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede27f0a-a956-4a50-8bf1-9b969de17501 service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:37.938326 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede27f0a-a956-4a50-8bf1-9b969de17501 service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:37.939020 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede27f0a-a956-4a50-8bf1-9b969de17501 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:38.041119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 947/1873] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:38.043561 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31827da-64df-4fe6-8759-a1cb4cbac5c2 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:38.044048 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31827da-64df-4fe6-8759-a1cb4cbac5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:38.044558 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31827da-64df-4fe6-8759-a1cb4cbac5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:38.087900 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede27f0a-a956-4a50-8bf1-9b969de17501 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:38.089779 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede27f0a-a956-4a50-8bf1-9b969de17501 service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:38.107630 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 927/1874] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:37 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:38.108819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede27f0a-a956-4a50-8bf1-9b969de17501 service cinder] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:38.111681 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-ede27f0a-a956-4a50-8bf1-9b969de17501 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:38.115651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-a31827da-64df-4fe6-8759-a1cb4cbac5c2 None None] MFA Rules not processed for user `9f7d538735f942549d14516fa2a1be7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:38.117567 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a31827da-64df-4fe6-8759-a1cb4cbac5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:38.133089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede27f0a-a956-4a50-8bf1-9b969de17501 service cinder] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:38.144628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5636a2d-13b8-4707-ae0c-fc6eb84cb83c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:38.145116 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5636a2d-13b8-4707-ae0c-fc6eb84cb83c service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:38.145662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5636a2d-13b8-4707-ae0c-fc6eb84cb83c service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:38.146173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5636a2d-13b8-4707-ae0c-fc6eb84cb83c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:38.166122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5636a2d-13b8-4707-ae0c-fc6eb84cb83c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:38.169401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5636a2d-13b8-4707-ae0c-fc6eb84cb83c service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:38.194191 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 928/1875] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:38.216956 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5636a2d-13b8-4707-ae0c-fc6eb84cb83c service cinder] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:38.235887 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5636a2d-13b8-4707-ae0c-fc6eb84cb83c service cinder] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:38.259854 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a3371-0924-47c7-bb8c-bae3b973a6db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:38.261298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a3371-0924-47c7-bb8c-bae3b973a6db service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:38.261799 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a3371-0924-47c7-bb8c-bae3b973a6db service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:38.262342 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a3371-0924-47c7-bb8c-bae3b973a6db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:38.265565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-401a3371-0924-47c7-bb8c-bae3b973a6db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:38.278373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 948/1876] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:38.369303 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:38.388092 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a3371-0924-47c7-bb8c-bae3b973a6db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:38.391033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a3371-0924-47c7-bb8c-bae3b973a6db service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:38.410245 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 929/1877] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:38 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:38.696030 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31827da-64df-4fe6-8759-a1cb4cbac5c2 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:38.715219 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31827da-64df-4fe6-8759-a1cb4cbac5c2 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:38.720790 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e77616-bf9b-4cc4-83b7-56936b84335a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:38.721685 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e77616-bf9b-4cc4-83b7-56936b84335a service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:38.722327 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e77616-bf9b-4cc4-83b7-56936b84335a service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:38.722868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e77616-bf9b-4cc4-83b7-56936b84335a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:38.728154 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b6e77616-bf9b-4cc4-83b7-56936b84335a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:38.845959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:38.900874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e77616-bf9b-4cc4-83b7-56936b84335a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:38.900874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e77616-bf9b-4cc4-83b7-56936b84335a service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:38.927009 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 949/1878] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:40.905223 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a3371-0924-47c7-bb8c-bae3b973a6db service cinder] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:40.947549 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a3371-0924-47c7-bb8c-bae3b973a6db service cinder] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:40.957394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87581add-3d15-4864-a93a-9b2c22525c73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:40.959326 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87581add-3d15-4864-a93a-9b2c22525c73 service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:40.959797 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87581add-3d15-4864-a93a-9b2c22525c73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:40.960354 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87581add-3d15-4864-a93a-9b2c22525c73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:40.978491 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87581add-3d15-4864-a93a-9b2c22525c73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:40.981225 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87581add-3d15-4864-a93a-9b2c22525c73 service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:41.014581 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 930/1879] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:40:41.408803 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e77616-bf9b-4cc4-83b7-56936b84335a service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:41.566413 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e77616-bf9b-4cc4-83b7-56936b84335a service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:41.577455 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606eb8e-22af-45e1-9be6-af69cb0917eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:41.578699 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606eb8e-22af-45e1-9be6-af69cb0917eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:41.579211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606eb8e-22af-45e1-9be6-af69cb0917eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:41.580144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606eb8e-22af-45e1-9be6-af69cb0917eb admin admin] PATH_INFO: `/v3/users/8997c4fde654411ca4e4eaad803a2a8c` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:41.582199 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606eb8e-22af-45e1-9be6-af69cb0917eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8997c4fde654411ca4e4eaad803a2a8c)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:41.586769 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606eb8e-22af-45e1-9be6-af69cb0917eb admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:41.720217 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2606eb8e-22af-45e1-9be6-af69cb0917eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8997c4fde654411ca4e4eaad803a2a8c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:41.733625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2606eb8e-22af-45e1-9be6-af69cb0917eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8997c4fde654411ca4e4eaad803a2a8c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:41.773363 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2606eb8e-22af-45e1-9be6-af69cb0917eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8997c4fde654411ca4e4eaad803a2a8c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:41.775240 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2606eb8e-22af-45e1-9be6-af69cb0917eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8997c4fde654411ca4e4eaad803a2a8c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:41.778956 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2606eb8e-22af-45e1-9be6-af69cb0917eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8997c4fde654411ca4e4eaad803a2a8c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:41.847040 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 950/1880] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:40:41 2022] DELETE /identity/v3/users/8997c4fde654411ca4e4eaad803a2a8c => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:41.854522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3d107-97b0-4c08-bd7c-bdf6fc790eec None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:41.855004 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3d107-97b0-4c08-bd7c-bdf6fc790eec None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:41.855496 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3d107-97b0-4c08-bd7c-bdf6fc790eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:41.905524 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-f5d3d107-97b0-4c08-bd7c-bdf6fc790eec None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:41.910161 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f5d3d107-97b0-4c08-bd7c-bdf6fc790eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:42.038570 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 931/1881] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:40:42.062046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606eb8e-22af-45e1-9be6-af69cb0917eb admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:42.064443 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2606eb8e-22af-45e1-9be6-af69cb0917eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:42.176856 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606eb8e-22af-45e1-9be6-af69cb0917eb admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:42.185642 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c529c31-6d7a-4231-9304-2a645ad39efc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:42.186432 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c529c31-6d7a-4231-9304-2a645ad39efc service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:42.186746 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c529c31-6d7a-4231-9304-2a645ad39efc service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:42.187078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c529c31-6d7a-4231-9304-2a645ad39efc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:42.200488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c529c31-6d7a-4231-9304-2a645ad39efc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:42.202644 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c529c31-6d7a-4231-9304-2a645ad39efc service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:42.218828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 951/1882] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:43.046280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3d107-97b0-4c08-bd7c-bdf6fc790eec None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:43.049380 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f5d3d107-97b0-4c08-bd7c-bdf6fc790eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:43.075040 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3d107-97b0-4c08-bd7c-bdf6fc790eec None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:43.092040 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0277a-7bce-4990-9c58-777748bb6bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:43.096267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0277a-7bce-4990-9c58-777748bb6bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:43.097231 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0277a-7bce-4990-9c58-777748bb6bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:43.097968 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0277a-7bce-4990-9c58-777748bb6bdb admin admin] PATH_INFO: `/v3/projects/6682955328a9424c806c9cec335c6d21` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:43.102692 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0277a-7bce-4990-9c58-777748bb6bdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6682955328a9424c806c9cec335c6d21)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:43.105150 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0277a-7bce-4990-9c58-777748bb6bdb admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:43.229853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-29e0277a-7bce-4990-9c58-777748bb6bdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6682955328a9424c806c9cec335c6d21', 'request_id': 'req-29e0277a-7bce-4990-9c58-777748bb6bdb'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:43.237962 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-29e0277a-7bce-4990-9c58-777748bb6bdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6682955328a9424c806c9cec335c6d21', 'request_id': 'req-29e0277a-7bce-4990-9c58-777748bb6bdb'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:43.247948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-29e0277a-7bce-4990-9c58-777748bb6bdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6682955328a9424c806c9cec335c6d21', 'request_id': 'req-29e0277a-7bce-4990-9c58-777748bb6bdb'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:43.267234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-29e0277a-7bce-4990-9c58-777748bb6bdb admin admin] The token cache is being invalidate because project 6682955328a9424c806c9cec335c6d21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:40:43.267573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-29e0277a-7bce-4990-9c58-777748bb6bdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:43.268523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-29e0277a-7bce-4990-9c58-777748bb6bdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:43.270907 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 932/1883] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:43 2022] DELETE /identity/v3/projects/6682955328a9424c806c9cec335c6d21 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:43.279041 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c059b-153a-4058-b365-6c6e7e72c785 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:43.279941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c059b-153a-4058-b365-6c6e7e72c785 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:43.280113 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c059b-153a-4058-b365-6c6e7e72c785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:43.298534 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:43.337604 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-c82c059b-153a-4058-b365-6c6e7e72c785 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:43.339999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c82c059b-153a-4058-b365-6c6e7e72c785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:43.500516 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 952/1884] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:43.506761 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9157e-5376-4ae9-b64d-6d8ede2bc7df None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:43.507015 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9157e-5376-4ae9-b64d-6d8ede2bc7df None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:43.507174 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9157e-5376-4ae9-b64d-6d8ede2bc7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:43.539784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-52b9157e-5376-4ae9-b64d-6d8ede2bc7df None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:43.541148 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-52b9157e-5376-4ae9-b64d-6d8ede2bc7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:43.558665 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 933/1885] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:40:43.564303 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c059b-153a-4058-b365-6c6e7e72c785 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:43.586796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c059b-153a-4058-b365-6c6e7e72c785 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:43.595747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed97b8-f003-4eab-be0e-14bbcddb485d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:43.596876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed97b8-f003-4eab-be0e-14bbcddb485d admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:43.597399 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed97b8-f003-4eab-be0e-14bbcddb485d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:43.597904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed97b8-f003-4eab-be0e-14bbcddb485d admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:43.599947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed97b8-f003-4eab-be0e-14bbcddb485d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:40:43.600557 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed97b8-f003-4eab-be0e-14bbcddb485d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:43.617327 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed97b8-f003-4eab-be0e-14bbcddb485d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:43.653598 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 953/1886] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:40:43.658333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9157e-5376-4ae9-b64d-6d8ede2bc7df None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:43.679686 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9157e-5376-4ae9-b64d-6d8ede2bc7df None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:43.694336 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe118427-fb07-4d2a-8ca3-18803919ef14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:43.695187 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe118427-fb07-4d2a-8ca3-18803919ef14 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:43.695471 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe118427-fb07-4d2a-8ca3-18803919ef14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:43.695773 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe118427-fb07-4d2a-8ca3-18803919ef14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:43.696436 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe118427-fb07-4d2a-8ca3-18803919ef14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:43.698413 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe118427-fb07-4d2a-8ca3-18803919ef14 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:43.744206 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 934/1887] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:40:43 2022] POST /identity/v3/projects => generated 381 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:43.749985 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed97b8-f003-4eab-be0e-14bbcddb485d admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:43.762386 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed97b8-f003-4eab-be0e-14bbcddb485d admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:43.916970 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0394a-c34b-4aba-9627-cbdc681b68f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:43.917749 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0394a-c34b-4aba-9627-cbdc681b68f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:43.918037 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0394a-c34b-4aba-9627-cbdc681b68f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:43.918309 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0394a-c34b-4aba-9627-cbdc681b68f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:43.919101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0394a-c34b-4aba-9627-cbdc681b68f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:43.921420 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0394a-c34b-4aba-9627-cbdc681b68f0 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:43.951603 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 954/1888] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:43 2022] POST /identity/v3/users => generated 291 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:43.956564 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe118427-fb07-4d2a-8ca3-18803919ef14 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:43.968083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe118427-fb07-4d2a-8ca3-18803919ef14 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:43.973074 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553e147-48c7-4da4-bb13-0ecb371ed785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:43.973696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553e147-48c7-4da4-bb13-0ecb371ed785 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:43.974642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553e147-48c7-4da4-bb13-0ecb371ed785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:43.975419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553e147-48c7-4da4-bb13-0ecb371ed785 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:43.976067 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553e147-48c7-4da4-bb13-0ecb371ed785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:43.978180 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553e147-48c7-4da4-bb13-0ecb371ed785 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:43.993941 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 935/1889] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:43.995440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0394a-c34b-4aba-9627-cbdc681b68f0 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:44.008729 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0394a-c34b-4aba-9627-cbdc681b68f0 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:44.014630 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dc50e-8705-4390-a529-5a5c41b29b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:44.015242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dc50e-8705-4390-a529-5a5c41b29b1c admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:44.015576 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dc50e-8705-4390-a529-5a5c41b29b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:44.015884 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dc50e-8705-4390-a529-5a5c41b29b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:44.016707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dc50e-8705-4390-a529-5a5c41b29b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:44.018412 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dc50e-8705-4390-a529-5a5c41b29b1c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:44.030047 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 955/1890] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:44.034857 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553e147-48c7-4da4-bb13-0ecb371ed785 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:44.047607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553e147-48c7-4da4-bb13-0ecb371ed785 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:44.056105 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb9423-1a2c-4f7c-b9a4-b4042f4ab87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:44.057571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb9423-1a2c-4f7c-b9a4-b4042f4ab87d admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:44.057711 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb9423-1a2c-4f7c-b9a4-b4042f4ab87d admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:44.058173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb9423-1a2c-4f7c-b9a4-b4042f4ab87d admin admin] PATH_INFO: `/v3/projects/65895dd0d29948609b35f4d6640360c3/users/80ddaebaf27649ceaa6fb13e0c6b1e20/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:44.080981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb9423-1a2c-4f7c-b9a4-b4042f4ab87d admin admin] RBAC: Authorizing `identity:create_grant(project_id=65895dd0d29948609b35f4d6640360c3, user_id=80ddaebaf27649ceaa6fb13e0c6b1e20, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:44.086814 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb9423-1a2c-4f7c-b9a4-b4042f4ab87d admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:44.098035 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:44.116304 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 936/1891] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:44 2022] PUT /identity/v3/projects/65895dd0d29948609b35f4d6640360c3/users/80ddaebaf27649ceaa6fb13e0c6b1e20/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:44.120318 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db572777-35ae-4d37-8f65-d797def01a0a None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:44.120690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db572777-35ae-4d37-8f65-d797def01a0a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:44.124487 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db572777-35ae-4d37-8f65-d797def01a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:44.145746 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-db572777-35ae-4d37-8f65-d797def01a0a None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:44.147167 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-db572777-35ae-4d37-8f65-d797def01a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:44.266161 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 956/1892] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:40:44.282904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb9423-1a2c-4f7c-b9a4-b4042f4ab87d admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:44.285546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-17eb9423-1a2c-4f7c-b9a4-b4042f4ab87d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:44.372823 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb9423-1a2c-4f7c-b9a4-b4042f4ab87d admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:44.378946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759f90c-a61e-42f2-8859-2a1a93784b78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:44.379708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759f90c-a61e-42f2-8859-2a1a93784b78 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:44.380212 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759f90c-a61e-42f2-8859-2a1a93784b78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:44.380591 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759f90c-a61e-42f2-8859-2a1a93784b78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:44.397621 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759f90c-a61e-42f2-8859-2a1a93784b78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:44.400049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759f90c-a61e-42f2-8859-2a1a93784b78 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:44.427402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 937/1893] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:45.283245 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db572777-35ae-4d37-8f65-d797def01a0a None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:45.286628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-db572777-35ae-4d37-8f65-d797def01a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:45.308533 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db572777-35ae-4d37-8f65-d797def01a0a None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:45.316071 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7befa-8ed2-4836-bea6-899751602563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:45.317837 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7befa-8ed2-4836-bea6-899751602563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:45.318172 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7befa-8ed2-4836-bea6-899751602563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:45.319010 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7befa-8ed2-4836-bea6-899751602563 admin admin] PATH_INFO: `/v3/users/a664967479c847d9b19eef7913c4dbac` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:45.321026 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7befa-8ed2-4836-bea6-899751602563 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a664967479c847d9b19eef7913c4dbac)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:45.323587 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7befa-8ed2-4836-bea6-899751602563 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:45.327652 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:45.419128 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7fd7befa-8ed2-4836-bea6-899751602563 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a664967479c847d9b19eef7913c4dbac'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:45.431112 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7fd7befa-8ed2-4836-bea6-899751602563 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a664967479c847d9b19eef7913c4dbac'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:45.451067 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7fd7befa-8ed2-4836-bea6-899751602563 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a664967479c847d9b19eef7913c4dbac'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:45.452444 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7fd7befa-8ed2-4836-bea6-899751602563 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a664967479c847d9b19eef7913c4dbac'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:45.454367 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7fd7befa-8ed2-4836-bea6-899751602563 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a664967479c847d9b19eef7913c4dbac'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:45.504658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 957/1894] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:40:45 2022] DELETE /identity/v3/users/a664967479c847d9b19eef7913c4dbac => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:40:45.510965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972351e8-c1a0-4690-ac8b-b5d864d38a2c None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:45.511804 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972351e8-c1a0-4690-ac8b-b5d864d38a2c None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:45.512383 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972351e8-c1a0-4690-ac8b-b5d864d38a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:45.551172 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-972351e8-c1a0-4690-ac8b-b5d864d38a2c None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:45.553897 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-972351e8-c1a0-4690-ac8b-b5d864d38a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:45.751775 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 938/1895] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:40:45.793687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7befa-8ed2-4836-bea6-899751602563 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:45.795962 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-7fd7befa-8ed2-4836-bea6-899751602563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:45.936556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7befa-8ed2-4836-bea6-899751602563 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:45.946883 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36907598-d6a4-4267-a857-1ec288a5eb73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:45.948353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36907598-d6a4-4267-a857-1ec288a5eb73 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:45.948817 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36907598-d6a4-4267-a857-1ec288a5eb73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:45.949458 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36907598-d6a4-4267-a857-1ec288a5eb73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:45.970916 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36907598-d6a4-4267-a857-1ec288a5eb73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:45.974840 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36907598-d6a4-4267-a857-1ec288a5eb73 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:46.019063 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 958/1896] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:46.875721 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cfc0f-4ea6-486b-bd93-b8598c6f9b16 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:46.876784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cfc0f-4ea6-486b-bd93-b8598c6f9b16 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:46.877011 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cfc0f-4ea6-486b-bd93-b8598c6f9b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:46.934497 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-f48cfc0f-4ea6-486b-bd93-b8598c6f9b16 None None] MFA Rules not processed for user `80ddaebaf27649ceaa6fb13e0c6b1e20`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:46.937722 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f48cfc0f-4ea6-486b-bd93-b8598c6f9b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:47.089206 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36907598-d6a4-4267-a857-1ec288a5eb73 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:47.093856 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-36907598-d6a4-4267-a857-1ec288a5eb73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:47.124119 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 939/1897] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:47.148353 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cfc0f-4ea6-486b-bd93-b8598c6f9b16 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:47.150101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f48cfc0f-4ea6-486b-bd93-b8598c6f9b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:47.156580 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36907598-d6a4-4267-a857-1ec288a5eb73 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:47.182400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb6c42-d175-4344-820c-d17f5965d5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:47.183785 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb6c42-d175-4344-820c-d17f5965d5e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:47.184634 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb6c42-d175-4344-820c-d17f5965d5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:47.185386 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb6c42-d175-4344-820c-d17f5965d5e0 admin admin] PATH_INFO: `/v3/projects/6da9842f8f7644dfb84a87efae788a55` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:47.192423 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb6c42-d175-4344-820c-d17f5965d5e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6da9842f8f7644dfb84a87efae788a55)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:47.197137 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb6c42-d175-4344-820c-d17f5965d5e0 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:47.285299 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:47.333392 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cfc0f-4ea6-486b-bd93-b8598c6f9b16 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:47.340149 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce493ca3-2abf-4286-86ce-b03286696cc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:47.341175 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce493ca3-2abf-4286-86ce-b03286696cc2 service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:47.341668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce493ca3-2abf-4286-86ce-b03286696cc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:47.342045 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce493ca3-2abf-4286-86ce-b03286696cc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:47.353807 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce493ca3-2abf-4286-86ce-b03286696cc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:47.355865 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce493ca3-2abf-4286-86ce-b03286696cc2 service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:47.369253 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 940/1898] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:47.414335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-52eb6c42-d175-4344-820c-d17f5965d5e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6da9842f8f7644dfb84a87efae788a55', 'request_id': 'req-52eb6c42-d175-4344-820c-d17f5965d5e0'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:47.442522 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-52eb6c42-d175-4344-820c-d17f5965d5e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6da9842f8f7644dfb84a87efae788a55', 'request_id': 'req-52eb6c42-d175-4344-820c-d17f5965d5e0'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:47.470920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-52eb6c42-d175-4344-820c-d17f5965d5e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6da9842f8f7644dfb84a87efae788a55', 'request_id': 'req-52eb6c42-d175-4344-820c-d17f5965d5e0'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:47.536323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-52eb6c42-d175-4344-820c-d17f5965d5e0 admin admin] The token cache is being invalidate because project 6da9842f8f7644dfb84a87efae788a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:40:47.538899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-52eb6c42-d175-4344-820c-d17f5965d5e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:47.540785 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-52eb6c42-d175-4344-820c-d17f5965d5e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:47.545278 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 959/1899] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:47 2022] DELETE /identity/v3/projects/6da9842f8f7644dfb84a87efae788a55 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:40:47.554041 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce493ca3-2abf-4286-86ce-b03286696cc2 service cinder] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:47.575552 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce493ca3-2abf-4286-86ce-b03286696cc2 service cinder] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:47.597062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb6c42-d175-4344-820c-d17f5965d5e0 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:47.599014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-52eb6c42-d175-4344-820c-d17f5965d5e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:47.611862 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:47.729095 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fcce77-6c7a-41db-82f8-903c3ed57e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:47.729774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcce77-6c7a-41db-82f8-903c3ed57e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:47.730089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcce77-6c7a-41db-82f8-903c3ed57e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:47.730378 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcce77-6c7a-41db-82f8-903c3ed57e91 admin admin] PATH_INFO: `/v3/users/b1664f5ad226408d8923be66475e66bf` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:47.732116 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fcce77-6c7a-41db-82f8-903c3ed57e91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1664f5ad226408d8923be66475e66bf)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:47.734882 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fcce77-6c7a-41db-82f8-903c3ed57e91 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:47.747420 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb6c42-d175-4344-820c-d17f5965d5e0 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:47.757855 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b18e9c-d01b-423a-b68e-1dbce33066d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:47.758639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b18e9c-d01b-423a-b68e-1dbce33066d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:47.758997 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b18e9c-d01b-423a-b68e-1dbce33066d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:47.759451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b18e9c-d01b-423a-b68e-1dbce33066d1 admin admin] PATH_INFO: `/v3/users/1207c52a0f4f4720b9673995e4e3e575` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:47.763701 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b18e9c-d01b-423a-b68e-1dbce33066d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1207c52a0f4f4720b9673995e4e3e575)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:47.770216 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b18e9c-d01b-423a-b68e-1dbce33066d1 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:47.855829 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-c0fcce77-6c7a-41db-82f8-903c3ed57e91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1664f5ad226408d8923be66475e66bf'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:47.867029 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-14b18e9c-d01b-423a-b68e-1dbce33066d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1207c52a0f4f4720b9673995e4e3e575'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:47.875042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-c0fcce77-6c7a-41db-82f8-903c3ed57e91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1664f5ad226408d8923be66475e66bf'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:47.884453 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-14b18e9c-d01b-423a-b68e-1dbce33066d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1207c52a0f4f4720b9673995e4e3e575'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:47.902251 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-14b18e9c-d01b-423a-b68e-1dbce33066d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1207c52a0f4f4720b9673995e4e3e575'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:47.904145 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-14b18e9c-d01b-423a-b68e-1dbce33066d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1207c52a0f4f4720b9673995e4e3e575'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:47.905110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-14b18e9c-d01b-423a-b68e-1dbce33066d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1207c52a0f4f4720b9673995e4e3e575'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:47.915562 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-c0fcce77-6c7a-41db-82f8-903c3ed57e91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1664f5ad226408d8923be66475e66bf'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:47.917404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-c0fcce77-6c7a-41db-82f8-903c3ed57e91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1664f5ad226408d8923be66475e66bf'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:47.918778 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-c0fcce77-6c7a-41db-82f8-903c3ed57e91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1664f5ad226408d8923be66475e66bf'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:47.940309 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 960/1900] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:40:47 2022] DELETE /identity/v3/users/1207c52a0f4f4720b9673995e4e3e575 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:47.951694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb91ae-80e1-497e-9b67-b6bc6af04ecc None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:47.951944 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb91ae-80e1-497e-9b67-b6bc6af04ecc None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:47.952140 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb91ae-80e1-497e-9b67-b6bc6af04ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:47.957540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 941/1901] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:40:47 2022] DELETE /identity/v3/users/b1664f5ad226408d8923be66475e66bf => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:48.014016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d8fb91ae-80e1-497e-9b67-b6bc6af04ecc None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:48.017308 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d8fb91ae-80e1-497e-9b67-b6bc6af04ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:48.161707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 961/1902] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:48.179336 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fcce77-6c7a-41db-82f8-903c3ed57e91 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:48.181312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-c0fcce77-6c7a-41db-82f8-903c3ed57e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:48.383768 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fcce77-6c7a-41db-82f8-903c3ed57e91 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:48.411994 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa561c8-df72-4509-bede-865e42d44d5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:48.412932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa561c8-df72-4509-bede-865e42d44d5a service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:48.413359 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa561c8-df72-4509-bede-865e42d44d5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:48.414642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa561c8-df72-4509-bede-865e42d44d5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:48.442405 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:48.450993 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa561c8-df72-4509-bede-865e42d44d5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:48.457671 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa561c8-df72-4509-bede-865e42d44d5a service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:48.495042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 942/1903] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:40:48.908203 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb91ae-80e1-497e-9b67-b6bc6af04ecc None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:48.910408 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d8fb91ae-80e1-497e-9b67-b6bc6af04ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:48.927570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb91ae-80e1-497e-9b67-b6bc6af04ecc None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:48.932873 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118decd-99ca-4c4d-8633-bac9346d1e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:48.933539 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118decd-99ca-4c4d-8633-bac9346d1e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:48.933964 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118decd-99ca-4c4d-8633-bac9346d1e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:48.934250 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118decd-99ca-4c4d-8633-bac9346d1e9b admin admin] PATH_INFO: `/v3/projects/d8d95e01ee7244e4bcebf67ae2b05830` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:48.935617 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118decd-99ca-4c4d-8633-bac9346d1e9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8d95e01ee7244e4bcebf67ae2b05830)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:48.939661 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118decd-99ca-4c4d-8633-bac9346d1e9b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:48.967517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:49.051026 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3118decd-99ca-4c4d-8633-bac9346d1e9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8d95e01ee7244e4bcebf67ae2b05830', 'request_id': 'req-3118decd-99ca-4c4d-8633-bac9346d1e9b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:49.074760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3118decd-99ca-4c4d-8633-bac9346d1e9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8d95e01ee7244e4bcebf67ae2b05830', 'request_id': 'req-3118decd-99ca-4c4d-8633-bac9346d1e9b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:49.113122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3118decd-99ca-4c4d-8633-bac9346d1e9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8d95e01ee7244e4bcebf67ae2b05830', 'request_id': 'req-3118decd-99ca-4c4d-8633-bac9346d1e9b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:49.173849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3118decd-99ca-4c4d-8633-bac9346d1e9b admin admin] The token cache is being invalidate because project d8d95e01ee7244e4bcebf67ae2b05830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:40:49.174906 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3118decd-99ca-4c4d-8633-bac9346d1e9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:49.176377 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3118decd-99ca-4c4d-8633-bac9346d1e9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:49.184538 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 962/1904] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:48 2022] DELETE /identity/v3/projects/d8d95e01ee7244e4bcebf67ae2b05830 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:49.192076 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60159e49-b1dc-4013-809c-99929780465b None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:49.193674 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60159e49-b1dc-4013-809c-99929780465b None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:49.193674 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60159e49-b1dc-4013-809c-99929780465b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:49.248375 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-60159e49-b1dc-4013-809c-99929780465b None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:49.253461 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-60159e49-b1dc-4013-809c-99929780465b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:49.428080 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 943/1905] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:40:49.458997 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f445daa-f18f-496f-bab1-535e9cdbad3c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:49.459474 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f445daa-f18f-496f-bab1-535e9cdbad3c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:49.460214 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f445daa-f18f-496f-bab1-535e9cdbad3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:49.528757 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-8f445daa-f18f-496f-bab1-535e9cdbad3c None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:49.563156 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-8f445daa-f18f-496f-bab1-535e9cdbad3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:49.589750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60159e49-b1dc-4013-809c-99929780465b None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:49.591972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-60159e49-b1dc-4013-809c-99929780465b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:49.599056 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 963/1906] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:49.621085 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f445daa-f18f-496f-bab1-535e9cdbad3c None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:49.644138 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f445daa-f18f-496f-bab1-535e9cdbad3c None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:49.648250 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60159e49-b1dc-4013-809c-99929780465b None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:49.652473 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d01dc-1061-46f0-ab3a-8968b3db872e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:49.654360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d01dc-1061-46f0-ab3a-8968b3db872e admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:49.655204 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d01dc-1061-46f0-ab3a-8968b3db872e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:49.655736 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d01dc-1061-46f0-ab3a-8968b3db872e admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:49.656660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d01dc-1061-46f0-ab3a-8968b3db872e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:40:49.657373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d01dc-1061-46f0-ab3a-8968b3db872e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:49.659747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d01dc-1061-46f0-ab3a-8968b3db872e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:49.679190 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 964/1907] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:40:49.685990 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d01dc-1061-46f0-ab3a-8968b3db872e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:49.688492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6d245-7a4a-427a-87c9-4d995a0d31ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:49.693706 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6d245-7a4a-427a-87c9-4d995a0d31ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:49.697982 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6d245-7a4a-427a-87c9-4d995a0d31ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:49.698573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6d245-7a4a-427a-87c9-4d995a0d31ce admin admin] PATH_INFO: `/v3/projects/10e4993aad4a4f6a99b99b4eca05ec75` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:49.703298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6d245-7a4a-427a-87c9-4d995a0d31ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=10e4993aad4a4f6a99b99b4eca05ec75)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:49.711518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d01dc-1061-46f0-ab3a-8968b3db872e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:49.712581 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6d245-7a4a-427a-87c9-4d995a0d31ce admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:49.724061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a7c97-57a7-4686-a03b-a0faf3de2f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:49.725658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a7c97-57a7-4686-a03b-a0faf3de2f67 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:49.726418 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a7c97-57a7-4686-a03b-a0faf3de2f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:49.729206 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a7c97-57a7-4686-a03b-a0faf3de2f67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:49.729972 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a7c97-57a7-4686-a03b-a0faf3de2f67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:49.739061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a7c97-57a7-4686-a03b-a0faf3de2f67 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:49.838972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b7a6d245-7a4a-427a-87c9-4d995a0d31ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10e4993aad4a4f6a99b99b4eca05ec75', 'request_id': 'req-b7a6d245-7a4a-427a-87c9-4d995a0d31ce'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:49.839601 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 965/1908] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:40:49 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:40:49.846181 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a7c97-57a7-4686-a03b-a0faf3de2f67 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:49.855541 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b7a6d245-7a4a-427a-87c9-4d995a0d31ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10e4993aad4a4f6a99b99b4eca05ec75', 'request_id': 'req-b7a6d245-7a4a-427a-87c9-4d995a0d31ce'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:49.870398 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b7a6d245-7a4a-427a-87c9-4d995a0d31ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10e4993aad4a4f6a99b99b4eca05ec75', 'request_id': 'req-b7a6d245-7a4a-427a-87c9-4d995a0d31ce'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:49.897532 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b7a6d245-7a4a-427a-87c9-4d995a0d31ce admin admin] The token cache is being invalidate because project 10e4993aad4a4f6a99b99b4eca05ec75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:40:49.898029 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b7a6d245-7a4a-427a-87c9-4d995a0d31ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:49.899228 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b7a6d245-7a4a-427a-87c9-4d995a0d31ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:49.901953 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 944/1909] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:49 2022] DELETE /identity/v3/projects/10e4993aad4a4f6a99b99b4eca05ec75 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:40:49.908299 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6d245-7a4a-427a-87c9-4d995a0d31ce admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:49.909970 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-b7a6d245-7a4a-427a-87c9-4d995a0d31ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:49.955334 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a7c97-57a7-4686-a03b-a0faf3de2f67 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:49.961228 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2dd9b-0032-4c81-a1ab-fd172b7fe990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:49.962008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2dd9b-0032-4c81-a1ab-fd172b7fe990 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:49.962396 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2dd9b-0032-4c81-a1ab-fd172b7fe990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:49.962806 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2dd9b-0032-4c81-a1ab-fd172b7fe990 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:49.963540 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2dd9b-0032-4c81-a1ab-fd172b7fe990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:49.965665 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2dd9b-0032-4c81-a1ab-fd172b7fe990 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:49.994456 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 966/1910] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:49 2022] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:49.999319 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2dd9b-0032-4c81-a1ab-fd172b7fe990 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:50.000201 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6d245-7a4a-427a-87c9-4d995a0d31ce admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:50.001790 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-92f2dd9b-0032-4c81-a1ab-fd172b7fe990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:50.007825 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99dd21-7c8c-43b1-ad6b-8b5a0b8e794b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:50.008956 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99dd21-7c8c-43b1-ad6b-8b5a0b8e794b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:50.009449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99dd21-7c8c-43b1-ad6b-8b5a0b8e794b admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:50.009924 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99dd21-7c8c-43b1-ad6b-8b5a0b8e794b admin admin] PATH_INFO: `/v3/users/9f7d538735f942549d14516fa2a1be7e` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:50.012071 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99dd21-7c8c-43b1-ad6b-8b5a0b8e794b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f7d538735f942549d14516fa2a1be7e)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:50.015397 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99dd21-7c8c-43b1-ad6b-8b5a0b8e794b admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:50.018691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2dd9b-0032-4c81-a1ab-fd172b7fe990 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:50.026472 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96150c95-243c-4506-bc4a-16f1caf412fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:50.027139 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96150c95-243c-4506-bc4a-16f1caf412fc admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:50.027447 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96150c95-243c-4506-bc4a-16f1caf412fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:50.027725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96150c95-243c-4506-bc4a-16f1caf412fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:50.028588 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96150c95-243c-4506-bc4a-16f1caf412fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:50.030394 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96150c95-243c-4506-bc4a-16f1caf412fc admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:50.049440 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:50.055670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 967/1911] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:50.057573 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96150c95-243c-4506-bc4a-16f1caf412fc admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:50.072894 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96150c95-243c-4506-bc4a-16f1caf412fc admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:50.081080 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9eb839-e096-4cc9-ac83-fe2ffc0ad9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:50.082793 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9eb839-e096-4cc9-ac83-fe2ffc0ad9cd admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:50.084547 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9eb839-e096-4cc9-ac83-fe2ffc0ad9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:50.085157 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9eb839-e096-4cc9-ac83-fe2ffc0ad9cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:50.086088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9eb839-e096-4cc9-ac83-fe2ffc0ad9cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:50.089827 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9eb839-e096-4cc9-ac83-fe2ffc0ad9cd admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:50.099919 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-0d99dd21-7c8c-43b1-ad6b-8b5a0b8e794b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f7d538735f942549d14516fa2a1be7e'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:50.110867 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 968/1912] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:50.117171 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9eb839-e096-4cc9-ac83-fe2ffc0ad9cd admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:50.125785 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-0d99dd21-7c8c-43b1-ad6b-8b5a0b8e794b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f7d538735f942549d14516fa2a1be7e'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:50.134718 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9eb839-e096-4cc9-ac83-fe2ffc0ad9cd admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:50.144223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceda5ab-6443-48d2-9957-c8091c11e58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:50.144973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceda5ab-6443-48d2-9957-c8091c11e58e admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:50.145259 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceda5ab-6443-48d2-9957-c8091c11e58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:50.145540 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceda5ab-6443-48d2-9957-c8091c11e58e admin admin] PATH_INFO: `/v3/projects/a4512b6cd94b42bc89ae71413bbf3d70/users/7130657635b94a92a23a989fc77a07f2/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:50.159005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-0d99dd21-7c8c-43b1-ad6b-8b5a0b8e794b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f7d538735f942549d14516fa2a1be7e'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:50.160317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-0d99dd21-7c8c-43b1-ad6b-8b5a0b8e794b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f7d538735f942549d14516fa2a1be7e'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:50.161616 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-0d99dd21-7c8c-43b1-ad6b-8b5a0b8e794b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f7d538735f942549d14516fa2a1be7e'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:50.174567 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceda5ab-6443-48d2-9957-c8091c11e58e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4512b6cd94b42bc89ae71413bbf3d70, user_id=7130657635b94a92a23a989fc77a07f2, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:50.178177 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceda5ab-6443-48d2-9957-c8091c11e58e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:50.196171 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 969/1913] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:50 2022] PUT /identity/v3/projects/a4512b6cd94b42bc89ae71413bbf3d70/users/7130657635b94a92a23a989fc77a07f2/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:40:50.213086 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 945/1914] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:40:49 2022] DELETE /identity/v3/users/9f7d538735f942549d14516fa2a1be7e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:50.220580 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1919ab-a50d-4541-a0e1-df1124c54b42 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:50.221728 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1919ab-a50d-4541-a0e1-df1124c54b42 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:50.222459 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1919ab-a50d-4541-a0e1-df1124c54b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:50.262998 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:DELETE=7,keystone:SELECT=87,keystone:INSERT=6 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:50.282385 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ca1919ab-a50d-4541-a0e1-df1124c54b42 None None] MFA Rules not processed for user `7130657635b94a92a23a989fc77a07f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:50.286130 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ca1919ab-a50d-4541-a0e1-df1124c54b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:50.396958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 970/1915] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:50.400491 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99dd21-7c8c-43b1-ad6b-8b5a0b8e794b admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:50.403304 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-0d99dd21-7c8c-43b1-ad6b-8b5a0b8e794b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:50.531161 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99dd21-7c8c-43b1-ad6b-8b5a0b8e794b admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:50.536888 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90f55f-9621-47f2-8c60-dec5fd431407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:50.537532 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90f55f-9621-47f2-8c60-dec5fd431407 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:50.537817 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90f55f-9621-47f2-8c60-dec5fd431407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:50.538092 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90f55f-9621-47f2-8c60-dec5fd431407 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:50.538754 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90f55f-9621-47f2-8c60-dec5fd431407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:50.540755 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90f55f-9621-47f2-8c60-dec5fd431407 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:50.575024 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 946/1916] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:40:50 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:50.578863 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1919ab-a50d-4541-a0e1-df1124c54b42 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:50.591289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1919ab-a50d-4541-a0e1-df1124c54b42 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:50.661568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528c678-8e14-4b15-a191-13c35efa3123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:50.662606 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528c678-8e14-4b15-a191-13c35efa3123 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:50.662895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528c678-8e14-4b15-a191-13c35efa3123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:50.663172 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528c678-8e14-4b15-a191-13c35efa3123 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:50.663878 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528c678-8e14-4b15-a191-13c35efa3123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:50.666483 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528c678-8e14-4b15-a191-13c35efa3123 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:50.686505 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90f55f-9621-47f2-8c60-dec5fd431407 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:50.688792 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-1d90f55f-9621-47f2-8c60-dec5fd431407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:50.702157 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 971/1917] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:50 2022] POST /identity/v3/users => generated 296 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:50.707209 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528c678-8e14-4b15-a191-13c35efa3123 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:50.719989 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90f55f-9621-47f2-8c60-dec5fd431407 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:50.726805 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371bca9-8d7a-44ef-b54b-0342f90de3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:50.727984 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371bca9-8d7a-44ef-b54b-0342f90de3ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:50.728520 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371bca9-8d7a-44ef-b54b-0342f90de3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:50.729015 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371bca9-8d7a-44ef-b54b-0342f90de3ac admin admin] PATH_INFO: `/v3/projects/b5419177056d48b0b3692fc17786caf9` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:50.730062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528c678-8e14-4b15-a191-13c35efa3123 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:50.730929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371bca9-8d7a-44ef-b54b-0342f90de3ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5419177056d48b0b3692fc17786caf9)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:50.733582 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371bca9-8d7a-44ef-b54b-0342f90de3ac admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:50.746136 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800e578-1065-4f24-8850-50f314853b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:50.748732 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800e578-1065-4f24-8850-50f314853b77 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:50.749128 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800e578-1065-4f24-8850-50f314853b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:50.749527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800e578-1065-4f24-8850-50f314853b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:50.750412 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4800e578-1065-4f24-8850-50f314853b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:50.752804 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4800e578-1065-4f24-8850-50f314853b77 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:50.770964 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 972/1918] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:50.777543 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800e578-1065-4f24-8850-50f314853b77 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:50.797147 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800e578-1065-4f24-8850-50f314853b77 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:50.821719 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d371bca9-8d7a-44ef-b54b-0342f90de3ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5419177056d48b0b3692fc17786caf9', 'request_id': 'req-d371bca9-8d7a-44ef-b54b-0342f90de3ac'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:50.837672 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d371bca9-8d7a-44ef-b54b-0342f90de3ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5419177056d48b0b3692fc17786caf9', 'request_id': 'req-d371bca9-8d7a-44ef-b54b-0342f90de3ac'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:50.849914 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d371bca9-8d7a-44ef-b54b-0342f90de3ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5419177056d48b0b3692fc17786caf9', 'request_id': 'req-d371bca9-8d7a-44ef-b54b-0342f90de3ac'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:50.881710 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d371bca9-8d7a-44ef-b54b-0342f90de3ac admin admin] The token cache is being invalidate because project b5419177056d48b0b3692fc17786caf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:40:50.883029 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d371bca9-8d7a-44ef-b54b-0342f90de3ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:50.885111 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d371bca9-8d7a-44ef-b54b-0342f90de3ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:50.888968 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 947/1919] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:50 2022] DELETE /identity/v3/projects/b5419177056d48b0b3692fc17786caf9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:40:50.898966 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540613b2-07c6-4c2a-9c87-ded2dd7d8003 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:50.900069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540613b2-07c6-4c2a-9c87-ded2dd7d8003 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:50.901383 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540613b2-07c6-4c2a-9c87-ded2dd7d8003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:50.908515 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c34a4-bdd3-48ee-91e8-97c39fa46fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:50.909209 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c34a4-bdd3-48ee-91e8-97c39fa46fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:50.910177 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c34a4-bdd3-48ee-91e8-97c39fa46fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:50.910659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c34a4-bdd3-48ee-91e8-97c39fa46fcb admin admin] PATH_INFO: `/v3/projects/5ec52c1cfb964b3ba6f8c4af31127459/users/19059e6fbce24c64bd3bd3888949fb13/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:50.932261 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:50.936720 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c34a4-bdd3-48ee-91e8-97c39fa46fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ec52c1cfb964b3ba6f8c4af31127459, user_id=19059e6fbce24c64bd3bd3888949fb13, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:50.941266 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c34a4-bdd3-48ee-91e8-97c39fa46fcb admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:50.943452 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-540613b2-07c6-4c2a-9c87-ded2dd7d8003 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:50.947074 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-540613b2-07c6-4c2a-9c87-ded2dd7d8003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:50.965035 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 973/1920] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:50 2022] PUT /identity/v3/projects/5ec52c1cfb964b3ba6f8c4af31127459/users/19059e6fbce24c64bd3bd3888949fb13/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:40:50.966528 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c214d-a91c-4300-8b72-008e48358513 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:50.966977 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c214d-a91c-4300-8b72-008e48358513 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:50.967509 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c214d-a91c-4300-8b72-008e48358513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:50.973550 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 948/1921] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:50.975383 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540613b2-07c6-4c2a-9c87-ded2dd7d8003 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:50.976901 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-540613b2-07c6-4c2a-9c87-ded2dd7d8003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:50.992759 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:51.012249 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540613b2-07c6-4c2a-9c87-ded2dd7d8003 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:51.023794 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-643c214d-a91c-4300-8b72-008e48358513 None None] MFA Rules not processed for user `80ddaebaf27649ceaa6fb13e0c6b1e20`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:51.025286 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-643c214d-a91c-4300-8b72-008e48358513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:51.156706 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 974/1922] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:51.158956 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c18c5-0077-441e-9853-6cf61af3b850 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:51.160051 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c18c5-0077-441e-9853-6cf61af3b850 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:51.160412 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c18c5-0077-441e-9853-6cf61af3b850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:51.191126 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc4272-327d-47d8-8528-29bc2856728b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:51.191885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc4272-327d-47d8-8528-29bc2856728b admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:51.192283 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc4272-327d-47d8-8528-29bc2856728b admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:51.192645 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc4272-327d-47d8-8528-29bc2856728b admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:51.193480 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc4272-327d-47d8-8528-29bc2856728b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:51.195314 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc4272-327d-47d8-8528-29bc2856728b admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:51.198064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-870c18c5-0077-441e-9853-6cf61af3b850 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:51.205344 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-870c18c5-0077-441e-9853-6cf61af3b850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:51.233921 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 949/1923] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:51.234879 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 975/1924] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:51.237432 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc4272-327d-47d8-8528-29bc2856728b admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:51.241038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c18c5-0077-441e-9853-6cf61af3b850 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:51.263644 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c18c5-0077-441e-9853-6cf61af3b850 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:51.266142 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc4272-327d-47d8-8528-29bc2856728b admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:51.270408 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b0c06-bd90-463e-9a19-9bfac627e221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:51.271584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b0c06-bd90-463e-9a19-9bfac627e221 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:51.271874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b0c06-bd90-463e-9a19-9bfac627e221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:51.272278 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b0c06-bd90-463e-9a19-9bfac627e221 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:51.272875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b0c06-bd90-463e-9a19-9bfac627e221 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:40:51.273223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b0c06-bd90-463e-9a19-9bfac627e221 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:51.274882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b0c06-bd90-463e-9a19-9bfac627e221 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:51.285571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff9667-578b-4d94-89bd-006dca4130f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:51.287520 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff9667-578b-4d94-89bd-006dca4130f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:51.288631 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff9667-578b-4d94-89bd-006dca4130f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:51.289861 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff9667-578b-4d94-89bd-006dca4130f5 admin admin] PATH_INFO: `/v3/projects/5ec52c1cfb964b3ba6f8c4af31127459/users/19059e6fbce24c64bd3bd3888949fb13/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:51.291613 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 976/1925] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:40:51.296849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b0c06-bd90-463e-9a19-9bfac627e221 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:51.312105 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff9667-578b-4d94-89bd-006dca4130f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ec52c1cfb964b3ba6f8c4af31127459, user_id=19059e6fbce24c64bd3bd3888949fb13, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:51.313185 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b0c06-bd90-463e-9a19-9bfac627e221 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:51.322480 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff73fe-2df6-485e-b79b-0145aa121426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:51.323568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff73fe-2df6-485e-b79b-0145aa121426 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:51.323998 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff73fe-2df6-485e-b79b-0145aa121426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:51.324698 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff73fe-2df6-485e-b79b-0145aa121426 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:51.324862 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff9667-578b-4d94-89bd-006dca4130f5 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:51.325806 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff73fe-2df6-485e-b79b-0145aa121426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:51.330544 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff73fe-2df6-485e-b79b-0145aa121426 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:51.356460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 950/1926] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:51 2022] PUT /identity/v3/projects/5ec52c1cfb964b3ba6f8c4af31127459/users/19059e6fbce24c64bd3bd3888949fb13/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:40:51.375706 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa23339-190e-43f8-beef-2e4c23c6c283 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:51.376727 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa23339-190e-43f8-beef-2e4c23c6c283 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:51.377465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa23339-190e-43f8-beef-2e4c23c6c283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:51.414694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 977/1927] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:40:51 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:40:51.422464 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff73fe-2df6-485e-b79b-0145aa121426 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:51.440474 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-6fa23339-190e-43f8-beef-2e4c23c6c283 None None] MFA Rules not processed for user `19059e6fbce24c64bd3bd3888949fb13`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:51.443358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-6fa23339-190e-43f8-beef-2e4c23c6c283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:51.594279 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 951/1928] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:51 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:40:51.629615 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff73fe-2df6-485e-b79b-0145aa121426 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:51.649873 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d9f14-1583-4470-82a1-82c46633717b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:51.650706 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d9f14-1583-4470-82a1-82c46633717b admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:51.651001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d9f14-1583-4470-82a1-82c46633717b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:51.651339 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d9f14-1583-4470-82a1-82c46633717b admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:51.652250 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d9f14-1583-4470-82a1-82c46633717b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:51.654934 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d9f14-1583-4470-82a1-82c46633717b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:51.708268 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 978/1929] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:51 2022] POST /identity/v3/users => generated 292 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:51.709264 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa23339-190e-43f8-beef-2e4c23c6c283 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:51.711001 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-6fa23339-190e-43f8-beef-2e4c23c6c283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:51.713252 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d9f14-1583-4470-82a1-82c46633717b admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:51.726143 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d9f14-1583-4470-82a1-82c46633717b admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:51.737070 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6522d-bc33-479b-be85-e3829d5a5d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:51.737728 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6522d-bc33-479b-be85-e3829d5a5d81 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:51.738007 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6522d-bc33-479b-be85-e3829d5a5d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:51.738285 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6522d-bc33-479b-be85-e3829d5a5d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:51.739000 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6522d-bc33-479b-be85-e3829d5a5d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:51.741441 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6522d-bc33-479b-be85-e3829d5a5d81 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:51.774647 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 979/1930] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:51.779293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6522d-bc33-479b-be85-e3829d5a5d81 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:51.802068 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6522d-bc33-479b-be85-e3829d5a5d81 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:51.814117 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d011f1-5fa7-4512-a380-bac333fc7ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:51.815421 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d011f1-5fa7-4512-a380-bac333fc7ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:51.816039 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d011f1-5fa7-4512-a380-bac333fc7ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:51.816674 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d011f1-5fa7-4512-a380-bac333fc7ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:51.817543 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d011f1-5fa7-4512-a380-bac333fc7ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:51.821003 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d011f1-5fa7-4512-a380-bac333fc7ef0 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:51.840749 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa23339-190e-43f8-beef-2e4c23c6c283 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:51.845684 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 980/1931] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:40:51.852785 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09493159-bad0-4d51-b665-7cac538da618 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:51.853647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09493159-bad0-4d51-b665-7cac538da618 service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:51.856348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09493159-bad0-4d51-b665-7cac538da618 service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:51.856348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09493159-bad0-4d51-b665-7cac538da618 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:51.860744 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d011f1-5fa7-4512-a380-bac333fc7ef0 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:51.878377 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09493159-bad0-4d51-b665-7cac538da618 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:51.879889 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09493159-bad0-4d51-b665-7cac538da618 service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:51.888671 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d011f1-5fa7-4512-a380-bac333fc7ef0 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:51.894203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 952/1932] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:51 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:40:51.899211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa156a1-9144-44f7-bea9-a6936d0de7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:51.900553 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa156a1-9144-44f7-bea9-a6936d0de7a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:51.902031 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa156a1-9144-44f7-bea9-a6936d0de7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:51.904163 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa156a1-9144-44f7-bea9-a6936d0de7a5 admin admin] PATH_INFO: `/v3/projects/d8c8b067c90447d19c3d408bee028957/users/432791532efa470cac2288b6635ec7e0/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:51.940285 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa156a1-9144-44f7-bea9-a6936d0de7a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8c8b067c90447d19c3d408bee028957, user_id=432791532efa470cac2288b6635ec7e0, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:51.943358 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa156a1-9144-44f7-bea9-a6936d0de7a5 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:51.981285 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 981/1933] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:51 2022] PUT /identity/v3/projects/d8c8b067c90447d19c3d408bee028957/users/432791532efa470cac2288b6635ec7e0/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:51.994102 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001d8e7-6a1c-4f5a-bef5-fb1b7d33f3ca None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:51.994709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001d8e7-6a1c-4f5a-bef5-fb1b7d33f3ca None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:51.995217 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001d8e7-6a1c-4f5a-bef5-fb1b7d33f3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:52.035251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:52.046082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-1001d8e7-6a1c-4f5a-bef5-fb1b7d33f3ca None None] MFA Rules not processed for user `432791532efa470cac2288b6635ec7e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:52.047953 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-1001d8e7-6a1c-4f5a-bef5-fb1b7d33f3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:52.186612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 953/1934] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:52.191642 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa156a1-9144-44f7-bea9-a6936d0de7a5 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:52.217780 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:52.313394 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa156a1-9144-44f7-bea9-a6936d0de7a5 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:52.319309 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629df866-fd31-498f-870c-1a3a22e5c021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:52.319819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629df866-fd31-498f-870c-1a3a22e5c021 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:52.320104 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629df866-fd31-498f-870c-1a3a22e5c021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:52.320468 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629df866-fd31-498f-870c-1a3a22e5c021 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:52.321077 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629df866-fd31-498f-870c-1a3a22e5c021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:52.323017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629df866-fd31-498f-870c-1a3a22e5c021 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:52.359651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 982/1935] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:40:52 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:40:52.363789 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001d8e7-6a1c-4f5a-bef5-fb1b7d33f3ca None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:52.398351 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001d8e7-6a1c-4f5a-bef5-fb1b7d33f3ca None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:52.507787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145acd1-ba63-4591-ab57-dffc82390e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:52.508921 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145acd1-ba63-4591-ab57-dffc82390e1c admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:52.509459 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145acd1-ba63-4591-ab57-dffc82390e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:52.509892 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145acd1-ba63-4591-ab57-dffc82390e1c admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:52.511169 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145acd1-ba63-4591-ab57-dffc82390e1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:52.514793 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145acd1-ba63-4591-ab57-dffc82390e1c admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:52.565213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 954/1936] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:52 2022] POST /identity/v3/users => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:40:52.566396 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629df866-fd31-498f-870c-1a3a22e5c021 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:52.588000 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629df866-fd31-498f-870c-1a3a22e5c021 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:52.625393 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77e2d3-871d-44a0-b2da-d4c2937daaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:52.626372 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77e2d3-871d-44a0-b2da-d4c2937daaa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:52.626894 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77e2d3-871d-44a0-b2da-d4c2937daaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:52.627546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77e2d3-871d-44a0-b2da-d4c2937daaa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:52.628555 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77e2d3-871d-44a0-b2da-d4c2937daaa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:52.632062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77e2d3-871d-44a0-b2da-d4c2937daaa5 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:52.656255 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 983/1937] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:52.659639 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145acd1-ba63-4591-ab57-dffc82390e1c admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:52.688771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145acd1-ba63-4591-ab57-dffc82390e1c admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:52.697319 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c2348-f2e3-41b0-9735-ac766ff233d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:52.698184 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c2348-f2e3-41b0-9735-ac766ff233d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:52.698698 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c2348-f2e3-41b0-9735-ac766ff233d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:52.699164 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c2348-f2e3-41b0-9735-ac766ff233d6 admin admin] PATH_INFO: `/v3/projects/578b5d92222746c182d770ee5c5a29fb/users/9df0092e3ea2432cb43db5b2bd6d592f/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:52.732981 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77e2d3-871d-44a0-b2da-d4c2937daaa5 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:52.738455 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c2348-f2e3-41b0-9735-ac766ff233d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=578b5d92222746c182d770ee5c5a29fb, user_id=9df0092e3ea2432cb43db5b2bd6d592f, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:52.746474 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c2348-f2e3-41b0-9735-ac766ff233d6 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:52.751272 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77e2d3-871d-44a0-b2da-d4c2937daaa5 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:52.763097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479b3c3-0e5f-4108-95cd-bba23f9dd9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:52.764434 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479b3c3-0e5f-4108-95cd-bba23f9dd9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:52.764941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479b3c3-0e5f-4108-95cd-bba23f9dd9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:52.765431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479b3c3-0e5f-4108-95cd-bba23f9dd9d0 admin admin] PATH_INFO: `/v3/users/7130657635b94a92a23a989fc77a07f2` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:52.767629 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479b3c3-0e5f-4108-95cd-bba23f9dd9d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7130657635b94a92a23a989fc77a07f2)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:52.767980 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 955/1938] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:52 2022] PUT /identity/v3/projects/578b5d92222746c182d770ee5c5a29fb/users/9df0092e3ea2432cb43db5b2bd6d592f/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:52.772568 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c2348-f2e3-41b0-9735-ac766ff233d6 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:52.772688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479b3c3-0e5f-4108-95cd-bba23f9dd9d0 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:52.879275 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d479b3c3-0e5f-4108-95cd-bba23f9dd9d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7130657635b94a92a23a989fc77a07f2'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:52.887560 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c2348-f2e3-41b0-9735-ac766ff233d6 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:52.902175 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ca0fe-f8de-47c5-93cc-dc472dc46646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:52.903992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ca0fe-f8de-47c5-93cc-dc472dc46646 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:52.904350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ca0fe-f8de-47c5-93cc-dc472dc46646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:52.904577 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ca0fe-f8de-47c5-93cc-dc472dc46646 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:52.905266 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ca0fe-f8de-47c5-93cc-dc472dc46646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:52.907475 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ca0fe-f8de-47c5-93cc-dc472dc46646 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:52.910361 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d479b3c3-0e5f-4108-95cd-bba23f9dd9d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7130657635b94a92a23a989fc77a07f2'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:52.924056 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d479b3c3-0e5f-4108-95cd-bba23f9dd9d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7130657635b94a92a23a989fc77a07f2'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:52.924736 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d479b3c3-0e5f-4108-95cd-bba23f9dd9d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7130657635b94a92a23a989fc77a07f2'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:52.925441 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d479b3c3-0e5f-4108-95cd-bba23f9dd9d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7130657635b94a92a23a989fc77a07f2'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:52.945464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 956/1939] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:52.953191 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ca0fe-f8de-47c5-93cc-dc472dc46646 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:52.956027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-3c0ca0fe-f8de-47c5-93cc-dc472dc46646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:52.966154 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:52.970188 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 984/1940] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:40:52 2022] DELETE /identity/v3/users/7130657635b94a92a23a989fc77a07f2 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:40:52.973403 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ca0fe-f8de-47c5-93cc-dc472dc46646 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:52.976759 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd3234-dc1c-409f-a212-10bf480002b6 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:52.977999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd3234-dc1c-409f-a212-10bf480002b6 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:52.978687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd3234-dc1c-409f-a212-10bf480002b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:53.044309 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-57fd3234-dc1c-409f-a212-10bf480002b6 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:53.046652 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-57fd3234-dc1c-409f-a212-10bf480002b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:53.086643 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f3760-f6a5-4ca6-8fe4-cb3bfe168bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:53.089202 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f3760-f6a5-4ca6-8fe4-cb3bfe168bce admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:53.090206 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f3760-f6a5-4ca6-8fe4-cb3bfe168bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:53.090889 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f3760-f6a5-4ca6-8fe4-cb3bfe168bce admin admin] PATH_INFO: `/v3/projects/578b5d92222746c182d770ee5c5a29fb/users/9df0092e3ea2432cb43db5b2bd6d592f/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:53.095393 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f3760-f6a5-4ca6-8fe4-cb3bfe168bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=578b5d92222746c182d770ee5c5a29fb, user_id=9df0092e3ea2432cb43db5b2bd6d592f, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:53.107221 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f3760-f6a5-4ca6-8fe4-cb3bfe168bce admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:53.132852 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 957/1941] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:52 2022] PUT /identity/v3/projects/578b5d92222746c182d770ee5c5a29fb/users/9df0092e3ea2432cb43db5b2bd6d592f/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:53.147242 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca676b9-2487-4c81-8061-6f05da23f62e None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:53.148737 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca676b9-2487-4c81-8061-6f05da23f62e None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:53.149461 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca676b9-2487-4c81-8061-6f05da23f62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:53.196033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:53.213487 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 985/1942] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:53.227638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd3234-dc1c-409f-a212-10bf480002b6 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:53.229777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-57fd3234-dc1c-409f-a212-10bf480002b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:53.233941 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-bca676b9-2487-4c81-8061-6f05da23f62e None None] MFA Rules not processed for user `9df0092e3ea2432cb43db5b2bd6d592f`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:53.236139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-bca676b9-2487-4c81-8061-6f05da23f62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:53.312599 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd3234-dc1c-409f-a212-10bf480002b6 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:53.400905 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae73a5d-004c-4fba-9050-e06257d34c8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:53.402765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae73a5d-004c-4fba-9050-e06257d34c8e service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:53.403578 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae73a5d-004c-4fba-9050-e06257d34c8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:53.404604 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae73a5d-004c-4fba-9050-e06257d34c8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:53.448762 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 958/1943] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:53.498476 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca676b9-2487-4c81-8061-6f05da23f62e None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:53.500661 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-bca676b9-2487-4c81-8061-6f05da23f62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:53.569303 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae73a5d-004c-4fba-9050-e06257d34c8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:53.571754 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae73a5d-004c-4fba-9050-e06257d34c8e service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:53.596075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 986/1944] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:53.639057 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca676b9-2487-4c81-8061-6f05da23f62e None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:53.649425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf810fb-5193-4a5e-bf96-0a5d274c191c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:53.651335 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf810fb-5193-4a5e-bf96-0a5d274c191c service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:53.651872 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf810fb-5193-4a5e-bf96-0a5d274c191c service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:53.652435 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf810fb-5193-4a5e-bf96-0a5d274c191c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:53.684576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf810fb-5193-4a5e-bf96-0a5d274c191c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:53.687154 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf810fb-5193-4a5e-bf96-0a5d274c191c service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:53.716233 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 959/1945] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:53.901011 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae73a5d-004c-4fba-9050-e06257d34c8e service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:53.941197 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae73a5d-004c-4fba-9050-e06257d34c8e service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:53.949749 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbaebf4-3ac1-4164-8393-82109105f3ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:53.951155 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbaebf4-3ac1-4164-8393-82109105f3ce service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:53.951759 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbaebf4-3ac1-4164-8393-82109105f3ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:53.952405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbaebf4-3ac1-4164-8393-82109105f3ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:53.956918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0cbaebf4-3ac1-4164-8393-82109105f3ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:54.065168 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbaebf4-3ac1-4164-8393-82109105f3ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:54.066698 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbaebf4-3ac1-4164-8393-82109105f3ce service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:54.075631 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:54.086727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 987/1946] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:54.157233 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf810fb-5193-4a5e-bf96-0a5d274c191c service cinder] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:54.159783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-ecf810fb-5193-4a5e-bf96-0a5d274c191c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:54.219524 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf810fb-5193-4a5e-bf96-0a5d274c191c service cinder] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:54.240638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068104e8-672a-471d-81ab-ecb464883907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:54.241478 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068104e8-672a-471d-81ab-ecb464883907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:54.241827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068104e8-672a-471d-81ab-ecb464883907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:54.242166 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068104e8-672a-471d-81ab-ecb464883907 admin admin] PATH_INFO: `/v3/projects/a4512b6cd94b42bc89ae71413bbf3d70` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:54.243600 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068104e8-672a-471d-81ab-ecb464883907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4512b6cd94b42bc89ae71413bbf3d70)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:54.245739 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068104e8-672a-471d-81ab-ecb464883907 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:54.284138 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:54.352687 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-068104e8-672a-471d-81ab-ecb464883907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4512b6cd94b42bc89ae71413bbf3d70', 'request_id': 'req-068104e8-672a-471d-81ab-ecb464883907'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:54.366500 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-068104e8-672a-471d-81ab-ecb464883907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4512b6cd94b42bc89ae71413bbf3d70', 'request_id': 'req-068104e8-672a-471d-81ab-ecb464883907'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:54.381883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-068104e8-672a-471d-81ab-ecb464883907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4512b6cd94b42bc89ae71413bbf3d70', 'request_id': 'req-068104e8-672a-471d-81ab-ecb464883907'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:54.412347 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-068104e8-672a-471d-81ab-ecb464883907 admin admin] The token cache is being invalidate because project a4512b6cd94b42bc89ae71413bbf3d70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:40:54.413344 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-068104e8-672a-471d-81ab-ecb464883907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:54.414572 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-068104e8-672a-471d-81ab-ecb464883907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:54.420478 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 960/1947] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:54 2022] DELETE /identity/v3/projects/a4512b6cd94b42bc89ae71413bbf3d70 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:54.422093 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbaebf4-3ac1-4164-8393-82109105f3ce service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:54.436375 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbaebf4-3ac1-4164-8393-82109105f3ce service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:54.639422 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288bf97-3c99-4867-8f4f-feb9f5e39205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:54.639422 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288bf97-3c99-4867-8f4f-feb9f5e39205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:54.639422 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288bf97-3c99-4867-8f4f-feb9f5e39205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:54.639422 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288bf97-3c99-4867-8f4f-feb9f5e39205 admin admin] PATH_INFO: `/v3/users/19059e6fbce24c64bd3bd3888949fb13` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:54.640379 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288bf97-3c99-4867-8f4f-feb9f5e39205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19059e6fbce24c64bd3bd3888949fb13)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:54.640379 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288bf97-3c99-4867-8f4f-feb9f5e39205 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:54.910778 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5288bf97-3c99-4867-8f4f-feb9f5e39205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19059e6fbce24c64bd3bd3888949fb13'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:54.919469 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5288bf97-3c99-4867-8f4f-feb9f5e39205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19059e6fbce24c64bd3bd3888949fb13'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:54.956826 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5288bf97-3c99-4867-8f4f-feb9f5e39205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19059e6fbce24c64bd3bd3888949fb13'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:54.959521 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5288bf97-3c99-4867-8f4f-feb9f5e39205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19059e6fbce24c64bd3bd3888949fb13'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:54.961776 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5288bf97-3c99-4867-8f4f-feb9f5e39205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19059e6fbce24c64bd3bd3888949fb13'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:55.026223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 988/1948] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:40:54 2022] DELETE /identity/v3/users/19059e6fbce24c64bd3bd3888949fb13 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:55.690787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068104e8-672a-471d-81ab-ecb464883907 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:55.693041 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-068104e8-672a-471d-81ab-ecb464883907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:55.756943 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068104e8-672a-471d-81ab-ecb464883907 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:56.009328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3056e2d-3b06-4ba5-9ae7-178d276f1f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:56.010659 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3056e2d-3b06-4ba5-9ae7-178d276f1f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:56.011461 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3056e2d-3b06-4ba5-9ae7-178d276f1f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:56.012236 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3056e2d-3b06-4ba5-9ae7-178d276f1f95 admin admin] PATH_INFO: `/v3/projects/5ec52c1cfb964b3ba6f8c4af31127459` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:56.015587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3056e2d-3b06-4ba5-9ae7-178d276f1f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ec52c1cfb964b3ba6f8c4af31127459)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:56.019882 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3056e2d-3b06-4ba5-9ae7-178d276f1f95 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:56.134630 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a3056e2d-3b06-4ba5-9ae7-178d276f1f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ec52c1cfb964b3ba6f8c4af31127459', 'request_id': 'req-a3056e2d-3b06-4ba5-9ae7-178d276f1f95'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:56.156145 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a3056e2d-3b06-4ba5-9ae7-178d276f1f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ec52c1cfb964b3ba6f8c4af31127459', 'request_id': 'req-a3056e2d-3b06-4ba5-9ae7-178d276f1f95'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:56.168277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a3056e2d-3b06-4ba5-9ae7-178d276f1f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ec52c1cfb964b3ba6f8c4af31127459', 'request_id': 'req-a3056e2d-3b06-4ba5-9ae7-178d276f1f95'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:56.217995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a3056e2d-3b06-4ba5-9ae7-178d276f1f95 admin admin] The token cache is being invalidate because project 5ec52c1cfb964b3ba6f8c4af31127459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:40:56.218435 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a3056e2d-3b06-4ba5-9ae7-178d276f1f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:56.219449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a3056e2d-3b06-4ba5-9ae7-178d276f1f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:56.226755 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 961/1949] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:55 2022] DELETE /identity/v3/projects/5ec52c1cfb964b3ba6f8c4af31127459 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:56.229893 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d43e9-7cdf-459c-b576-32c034b5bfe3 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:56.230866 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d43e9-7cdf-459c-b576-32c034b5bfe3 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:56.231211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d43e9-7cdf-459c-b576-32c034b5bfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:56.260899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-074d43e9-7cdf-459c-b576-32c034b5bfe3 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:56.263535 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-074d43e9-7cdf-459c-b576-32c034b5bfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:56.396874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 989/1950] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:56.416360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc279901-6247-4fd3-910b-5b75fdc86475 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:56.416850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc279901-6247-4fd3-910b-5b75fdc86475 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:56.417344 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc279901-6247-4fd3-910b-5b75fdc86475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:56.497322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-fc279901-6247-4fd3-910b-5b75fdc86475 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:56.498583 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-fc279901-6247-4fd3-910b-5b75fdc86475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:56.508637 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 962/1951] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:56.515123 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d43e9-7cdf-459c-b576-32c034b5bfe3 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:56.534696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d43e9-7cdf-459c-b576-32c034b5bfe3 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:56.551036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0cd13-e59e-4ebe-8eb5-1fe690da01e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:56.552385 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0cd13-e59e-4ebe-8eb5-1fe690da01e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:56.553016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0cd13-e59e-4ebe-8eb5-1fe690da01e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:56.553561 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0cd13-e59e-4ebe-8eb5-1fe690da01e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:56.554792 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0cd13-e59e-4ebe-8eb5-1fe690da01e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:40:56.555392 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0cd13-e59e-4ebe-8eb5-1fe690da01e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:56.558902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0cd13-e59e-4ebe-8eb5-1fe690da01e2 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:56.582048 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 990/1952] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:40:56.589075 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc279901-6247-4fd3-910b-5b75fdc86475 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:56.601256 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc279901-6247-4fd3-910b-5b75fdc86475 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:56.606092 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448694f-af53-45a8-9dd3-66ece8ebeb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:56.606839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448694f-af53-45a8-9dd3-66ece8ebeb14 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:56.607215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448694f-af53-45a8-9dd3-66ece8ebeb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:56.607561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448694f-af53-45a8-9dd3-66ece8ebeb14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:56.608382 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448694f-af53-45a8-9dd3-66ece8ebeb14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:56.610520 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448694f-af53-45a8-9dd3-66ece8ebeb14 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:56.663950 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 963/1953] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:40:56 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:40:56.668859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0cd13-e59e-4ebe-8eb5-1fe690da01e2 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:56.683382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0cd13-e59e-4ebe-8eb5-1fe690da01e2 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:56.689166 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:56.794239 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b74e6f-0e2a-40d8-8d54-cd100ad12f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:56.795312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b74e6f-0e2a-40d8-8d54-cd100ad12f6f admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:56.795947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b74e6f-0e2a-40d8-8d54-cd100ad12f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:56.796516 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b74e6f-0e2a-40d8-8d54-cd100ad12f6f admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:56.798687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b74e6f-0e2a-40d8-8d54-cd100ad12f6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:56.801792 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b74e6f-0e2a-40d8-8d54-cd100ad12f6f admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:56.836633 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 991/1954] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:40:56 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:40:56.843416 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448694f-af53-45a8-9dd3-66ece8ebeb14 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:56.861453 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448694f-af53-45a8-9dd3-66ece8ebeb14 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:56.868040 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c551c9-d0de-4812-b87f-e9dab0927307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:56.868697 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c551c9-d0de-4812-b87f-e9dab0927307 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:56.868982 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c551c9-d0de-4812-b87f-e9dab0927307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:56.870106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c551c9-d0de-4812-b87f-e9dab0927307 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:56.870786 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c551c9-d0de-4812-b87f-e9dab0927307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:56.872492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c551c9-d0de-4812-b87f-e9dab0927307 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:56.876240 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:56.889728 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 964/1955] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:56.896359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b74e6f-0e2a-40d8-8d54-cd100ad12f6f admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:56.913624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b74e6f-0e2a-40d8-8d54-cd100ad12f6f admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:56.919143 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3db71-e04c-457f-ba9f-e25ed2014de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:56.919792 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3db71-e04c-457f-ba9f-e25ed2014de7 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:56.920064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3db71-e04c-457f-ba9f-e25ed2014de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:56.920382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3db71-e04c-457f-ba9f-e25ed2014de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:56.921051 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3db71-e04c-457f-ba9f-e25ed2014de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:56.922775 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3db71-e04c-457f-ba9f-e25ed2014de7 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:56.944784 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 992/1956] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:40:56.952119 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c551c9-d0de-4812-b87f-e9dab0927307 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:56.970832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c551c9-d0de-4812-b87f-e9dab0927307 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:56.979362 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaba4d7-12eb-4896-a6b7-51fc1fbdbee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:56.980493 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaba4d7-12eb-4896-a6b7-51fc1fbdbee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:56.981050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaba4d7-12eb-4896-a6b7-51fc1fbdbee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:56.981451 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaba4d7-12eb-4896-a6b7-51fc1fbdbee6 admin admin] PATH_INFO: `/v3/projects/e99301b6be364abca9ba02c84552a96d/users/14d9b7c7679e4bae9c512548aad0a4eb/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:57.010104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaba4d7-12eb-4896-a6b7-51fc1fbdbee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e99301b6be364abca9ba02c84552a96d, user_id=14d9b7c7679e4bae9c512548aad0a4eb, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:57.015570 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaba4d7-12eb-4896-a6b7-51fc1fbdbee6 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:57.045521 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 965/1957] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:40:56 2022] PUT /identity/v3/projects/e99301b6be364abca9ba02c84552a96d/users/14d9b7c7679e4bae9c512548aad0a4eb/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:57.060910 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1fa50-e77e-47cb-9ed1-14e04b818397 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:57.061479 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1fa50-e77e-47cb-9ed1-14e04b818397 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:57.061880 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1fa50-e77e-47cb-9ed1-14e04b818397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:57.110310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-24f1fa50-e77e-47cb-9ed1-14e04b818397 None None] MFA Rules not processed for user `14d9b7c7679e4bae9c512548aad0a4eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:57.112220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-24f1fa50-e77e-47cb-9ed1-14e04b818397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:57.210045 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 993/1958] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:57.223207 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaba4d7-12eb-4896-a6b7-51fc1fbdbee6 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:57.225793 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-5aaba4d7-12eb-4896-a6b7-51fc1fbdbee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:57.306861 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaba4d7-12eb-4896-a6b7-51fc1fbdbee6 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:57.311690 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344e983-52eb-47ba-9874-a5945b99cd75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:57.312861 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344e983-52eb-47ba-9874-a5945b99cd75 service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:57.313347 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344e983-52eb-47ba-9874-a5945b99cd75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:57.313842 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344e983-52eb-47ba-9874-a5945b99cd75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:57.324000 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344e983-52eb-47ba-9874-a5945b99cd75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:57.325902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344e983-52eb-47ba-9874-a5945b99cd75 service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:57.349143 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 966/1959] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:40:57.380016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1fa50-e77e-47cb-9ed1-14e04b818397 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:57.494687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1fa50-e77e-47cb-9ed1-14e04b818397 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:57.501571 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ec47d-3b5b-41e9-9187-2d23c547b10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:57.502239 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ec47d-3b5b-41e9-9187-2d23c547b10b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:57.502518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ec47d-3b5b-41e9-9187-2d23c547b10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:57.504159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ec47d-3b5b-41e9-9187-2d23c547b10b admin admin] PATH_INFO: `/v3/users/14d9b7c7679e4bae9c512548aad0a4eb` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:57.506378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ec47d-3b5b-41e9-9187-2d23c547b10b admin admin] RBAC: Authorizing `identity:delete_user(user_id=14d9b7c7679e4bae9c512548aad0a4eb)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:57.508792 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ec47d-3b5b-41e9-9187-2d23c547b10b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:57.528166 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344e983-52eb-47ba-9874-a5945b99cd75 service cinder] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:57.530626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-3344e983-52eb-47ba-9874-a5945b99cd75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:57.537808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:57.557811 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344e983-52eb-47ba-9874-a5945b99cd75 service cinder] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:57.573638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967bc83a-ac98-41a2-96dd-64a949580c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:57.574331 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bc83a-ac98-41a2-96dd-64a949580c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:57.574620 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bc83a-ac98-41a2-96dd-64a949580c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:57.574898 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bc83a-ac98-41a2-96dd-64a949580c9e admin admin] PATH_INFO: `/v3/users/432791532efa470cac2288b6635ec7e0` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:57.579851 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967bc83a-ac98-41a2-96dd-64a949580c9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=432791532efa470cac2288b6635ec7e0)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:57.583277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967bc83a-ac98-41a2-96dd-64a949580c9e admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:57.617234 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-aa7ec47d-3b5b-41e9-9187-2d23c547b10b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14d9b7c7679e4bae9c512548aad0a4eb'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:57.629813 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-aa7ec47d-3b5b-41e9-9187-2d23c547b10b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14d9b7c7679e4bae9c512548aad0a4eb'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:57.643316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-aa7ec47d-3b5b-41e9-9187-2d23c547b10b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14d9b7c7679e4bae9c512548aad0a4eb'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:57.644658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-aa7ec47d-3b5b-41e9-9187-2d23c547b10b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14d9b7c7679e4bae9c512548aad0a4eb'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:57.645372 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-aa7ec47d-3b5b-41e9-9187-2d23c547b10b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14d9b7c7679e4bae9c512548aad0a4eb'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:57.680505 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-967bc83a-ac98-41a2-96dd-64a949580c9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '432791532efa470cac2288b6635ec7e0'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:57.680715 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 994/1960] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:40:57 2022] DELETE /identity/v3/users/14d9b7c7679e4bae9c512548aad0a4eb => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:57.687168 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0824db5-ded4-4a83-8aa3-b643bf48cfd3 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:57.688066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0824db5-ded4-4a83-8aa3-b643bf48cfd3 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:57.688800 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0824db5-ded4-4a83-8aa3-b643bf48cfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:57.699101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-967bc83a-ac98-41a2-96dd-64a949580c9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '432791532efa470cac2288b6635ec7e0'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:57.733654 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-967bc83a-ac98-41a2-96dd-64a949580c9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '432791532efa470cac2288b6635ec7e0'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:57.733982 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-e0824db5-ded4-4a83-8aa3-b643bf48cfd3 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:57.735987 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-967bc83a-ac98-41a2-96dd-64a949580c9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '432791532efa470cac2288b6635ec7e0'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:57.736235 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e0824db5-ded4-4a83-8aa3-b643bf48cfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:57.738004 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-967bc83a-ac98-41a2-96dd-64a949580c9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '432791532efa470cac2288b6635ec7e0'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:57.775414 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 967/1961] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:40:57 2022] DELETE /identity/v3/users/432791532efa470cac2288b6635ec7e0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:57.779569 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568983c6-1133-489d-bb20-062cbe9b7582 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:57.780223 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568983c6-1133-489d-bb20-062cbe9b7582 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:57.780841 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568983c6-1133-489d-bb20-062cbe9b7582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:57.816743 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-568983c6-1133-489d-bb20-062cbe9b7582 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:57.819643 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-568983c6-1133-489d-bb20-062cbe9b7582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:57.884346 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 995/1962] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:57.896825 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0824db5-ded4-4a83-8aa3-b643bf48cfd3 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:57.899993 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e0824db5-ded4-4a83-8aa3-b643bf48cfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:57.925350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:57.964970 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 968/1963] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:57.985322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568983c6-1133-489d-bb20-062cbe9b7582 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:57.987466 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-568983c6-1133-489d-bb20-062cbe9b7582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:58.052248 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0824db5-ded4-4a83-8aa3-b643bf48cfd3 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:58.112264 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568983c6-1133-489d-bb20-062cbe9b7582 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:58.124888 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce9179-826a-46ff-89f2-53f23dc5c23c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:58.126465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce9179-826a-46ff-89f2-53f23dc5c23c service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:58.126960 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce9179-826a-46ff-89f2-53f23dc5c23c service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:58.127454 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce9179-826a-46ff-89f2-53f23dc5c23c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:58.172039 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce9179-826a-46ff-89f2-53f23dc5c23c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:58.183942 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce9179-826a-46ff-89f2-53f23dc5c23c service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:58.230739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586628ae-7a54-4ba5-ad31-4daaf30bf641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:58.231988 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586628ae-7a54-4ba5-ad31-4daaf30bf641 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:58.232747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586628ae-7a54-4ba5-ad31-4daaf30bf641 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:58.233137 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586628ae-7a54-4ba5-ad31-4daaf30bf641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:58.234493 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 969/1964] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:58.248789 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:58.263327 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586628ae-7a54-4ba5-ad31-4daaf30bf641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:58.270632 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586628ae-7a54-4ba5-ad31-4daaf30bf641 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:58.310335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 996/1965] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:40:58.669241 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce9179-826a-46ff-89f2-53f23dc5c23c service neutron] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:58.672005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-92ce9179-826a-46ff-89f2-53f23dc5c23c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:58.687073 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586628ae-7a54-4ba5-ad31-4daaf30bf641 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:58.689463 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-586628ae-7a54-4ba5-ad31-4daaf30bf641 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:58.708498 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce9179-826a-46ff-89f2-53f23dc5c23c service neutron] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:58.722753 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172b46b-286f-4014-9ffe-ef3882745d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:58.723954 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172b46b-286f-4014-9ffe-ef3882745d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:58.725045 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172b46b-286f-4014-9ffe-ef3882745d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:58.725554 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172b46b-286f-4014-9ffe-ef3882745d9e admin admin] PATH_INFO: `/v3/users/79d9cc16df244190aeff797772c6d92c` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:58.726482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586628ae-7a54-4ba5-ad31-4daaf30bf641 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:58.728205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172b46b-286f-4014-9ffe-ef3882745d9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=79d9cc16df244190aeff797772c6d92c)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:58.733313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc70c7b-54ec-4858-89bb-3f243e273f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:58.734069 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc70c7b-54ec-4858-89bb-3f243e273f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:58.734184 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172b46b-286f-4014-9ffe-ef3882745d9e admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:58.734532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc70c7b-54ec-4858-89bb-3f243e273f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:58.734877 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc70c7b-54ec-4858-89bb-3f243e273f61 admin admin] PATH_INFO: `/v3/users/e740a601ac33439499856f11d76085f3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:58.736284 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc70c7b-54ec-4858-89bb-3f243e273f61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e740a601ac33439499856f11d76085f3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:58.739228 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc70c7b-54ec-4858-89bb-3f243e273f61 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:58.840134 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1fc70c7b-54ec-4858-89bb-3f243e273f61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e740a601ac33439499856f11d76085f3'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:58.860444 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1fc70c7b-54ec-4858-89bb-3f243e273f61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e740a601ac33439499856f11d76085f3'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:58.874935 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1fc70c7b-54ec-4858-89bb-3f243e273f61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e740a601ac33439499856f11d76085f3'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:58.876575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1fc70c7b-54ec-4858-89bb-3f243e273f61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e740a601ac33439499856f11d76085f3'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:58.878202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1fc70c7b-54ec-4858-89bb-3f243e273f61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e740a601ac33439499856f11d76085f3'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:58.899265 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d172b46b-286f-4014-9ffe-ef3882745d9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79d9cc16df244190aeff797772c6d92c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:58.909815 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 997/1966] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:40:58 2022] DELETE /identity/v3/users/e740a601ac33439499856f11d76085f3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:58.915169 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64526303-dba9-4579-9d3f-845b11f7e087 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:58.915847 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64526303-dba9-4579-9d3f-845b11f7e087 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:58.916588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d172b46b-286f-4014-9ffe-ef3882745d9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79d9cc16df244190aeff797772c6d92c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:58.918406 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64526303-dba9-4579-9d3f-845b11f7e087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:58.948104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d172b46b-286f-4014-9ffe-ef3882745d9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79d9cc16df244190aeff797772c6d92c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:58.948781 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-64526303-dba9-4579-9d3f-845b11f7e087 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:58.949694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-64526303-dba9-4579-9d3f-845b11f7e087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:58.950414 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d172b46b-286f-4014-9ffe-ef3882745d9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79d9cc16df244190aeff797772c6d92c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:58.951307 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d172b46b-286f-4014-9ffe-ef3882745d9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79d9cc16df244190aeff797772c6d92c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:58.971651 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 970/1967] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:40:58 2022] DELETE /identity/v3/users/79d9cc16df244190aeff797772c6d92c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:58.981324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6393f7f-ddfc-4648-a701-4c249636000f None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:58.981979 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6393f7f-ddfc-4648-a701-4c249636000f None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:58.982467 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6393f7f-ddfc-4648-a701-4c249636000f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:59.032483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-f6393f7f-ddfc-4648-a701-4c249636000f None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:40:59.035043 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f6393f7f-ddfc-4648-a701-4c249636000f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:59.110105 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 998/1968] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:59.134198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64526303-dba9-4579-9d3f-845b11f7e087 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:59.137433 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-64526303-dba9-4579-9d3f-845b11f7e087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:59.243921 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 971/1969] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:40:59.245823 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6393f7f-ddfc-4648-a701-4c249636000f None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:59.248674 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f6393f7f-ddfc-4648-a701-4c249636000f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:59.267418 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:59.279165 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6393f7f-ddfc-4648-a701-4c249636000f None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:59.307023 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f597ee-9770-4326-849c-2ee51b76b134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:59.308773 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f597ee-9770-4326-849c-2ee51b76b134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:59.324485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64526303-dba9-4579-9d3f-845b11f7e087 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:59.327373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f597ee-9770-4326-849c-2ee51b76b134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:59.328420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f597ee-9770-4326-849c-2ee51b76b134 admin admin] PATH_INFO: `/v3/projects/d8c8b067c90447d19c3d408bee028957` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:59.337091 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f597ee-9770-4326-849c-2ee51b76b134 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8c8b067c90447d19c3d408bee028957)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:59.346329 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f597ee-9770-4326-849c-2ee51b76b134 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:59.383440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:59.458164 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55473a3-8bbc-48c9-96da-f7d6c5ba5c26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:59.459531 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55473a3-8bbc-48c9-96da-f7d6c5ba5c26 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:59.460230 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55473a3-8bbc-48c9-96da-f7d6c5ba5c26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:59.460230 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55473a3-8bbc-48c9-96da-f7d6c5ba5c26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:59.480904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55473a3-8bbc-48c9-96da-f7d6c5ba5c26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:59.483089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-81f597ee-9770-4326-849c-2ee51b76b134 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8c8b067c90447d19c3d408bee028957', 'request_id': 'req-81f597ee-9770-4326-849c-2ee51b76b134'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:59.483665 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55473a3-8bbc-48c9-96da-f7d6c5ba5c26 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:59.506180 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-81f597ee-9770-4326-849c-2ee51b76b134 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8c8b067c90447d19c3d408bee028957', 'request_id': 'req-81f597ee-9770-4326-849c-2ee51b76b134'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:59.514271 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 999/1970] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:40:59.516358 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55473a3-8bbc-48c9-96da-f7d6c5ba5c26 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:59.529986 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-81f597ee-9770-4326-849c-2ee51b76b134 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8c8b067c90447d19c3d408bee028957', 'request_id': 'req-81f597ee-9770-4326-849c-2ee51b76b134'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:59.537766 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55473a3-8bbc-48c9-96da-f7d6c5ba5c26 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:59.555168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-81f597ee-9770-4326-849c-2ee51b76b134 admin admin] The token cache is being invalidate because project d8c8b067c90447d19c3d408bee028957 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:40:59.556500 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-81f597ee-9770-4326-849c-2ee51b76b134 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:59.557587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-81f597ee-9770-4326-849c-2ee51b76b134 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:59.562066 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 972/1971] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:59 2022] DELETE /identity/v3/projects/d8c8b067c90447d19c3d408bee028957 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:59.567091 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f597ee-9770-4326-849c-2ee51b76b134 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:59.571386 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-81f597ee-9770-4326-849c-2ee51b76b134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:59.658346 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce392fc2-8a58-4022-b97f-a8d3590ce20d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:59.660420 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce392fc2-8a58-4022-b97f-a8d3590ce20d service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:59.660420 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce392fc2-8a58-4022-b97f-a8d3590ce20d service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:59.660751 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce392fc2-8a58-4022-b97f-a8d3590ce20d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:59.664873 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ce392fc2-8a58-4022-b97f-a8d3590ce20d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:59.701809 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f597ee-9770-4326-849c-2ee51b76b134 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:40:59.709873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1126b7-ef6b-4b99-8b07-7608fd68f74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:40:59.710546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1126b7-ef6b-4b99-8b07-7608fd68f74b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:40:59.710826 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1126b7-ef6b-4b99-8b07-7608fd68f74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:40:59.711099 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1126b7-ef6b-4b99-8b07-7608fd68f74b admin admin] PATH_INFO: `/v3/users/9df0092e3ea2432cb43db5b2bd6d592f` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:40:59.712692 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1126b7-ef6b-4b99-8b07-7608fd68f74b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9df0092e3ea2432cb43db5b2bd6d592f)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:59.715343 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1126b7-ef6b-4b99-8b07-7608fd68f74b admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:59.800892 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-3a1126b7-ef6b-4b99-8b07-7608fd68f74b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9df0092e3ea2432cb43db5b2bd6d592f'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:59.816659 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-3a1126b7-ef6b-4b99-8b07-7608fd68f74b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9df0092e3ea2432cb43db5b2bd6d592f'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:59.837274 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-3a1126b7-ef6b-4b99-8b07-7608fd68f74b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9df0092e3ea2432cb43db5b2bd6d592f'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:59.838087 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-3a1126b7-ef6b-4b99-8b07-7608fd68f74b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9df0092e3ea2432cb43db5b2bd6d592f'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:59.838789 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-3a1126b7-ef6b-4b99-8b07-7608fd68f74b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9df0092e3ea2432cb43db5b2bd6d592f'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:40:59.846798 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce392fc2-8a58-4022-b97f-a8d3590ce20d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:40:59.852299 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce392fc2-8a58-4022-b97f-a8d3590ce20d service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:40:59.863307 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 973/1972] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:40:59 2022] DELETE /identity/v3/users/9df0092e3ea2432cb43db5b2bd6d592f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:40:59.873793 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1000/1973] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:40:59.893868 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1126b7-ef6b-4b99-8b07-7608fd68f74b admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:40:59.895782 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-3a1126b7-ef6b-4b99-8b07-7608fd68f74b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:40:59.918263 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:00.035760 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1126b7-ef6b-4b99-8b07-7608fd68f74b admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:00.043322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f494f08-c1ee-404d-b2b3-77566b9dab74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:00.044210 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f494f08-c1ee-404d-b2b3-77566b9dab74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:00.045906 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f494f08-c1ee-404d-b2b3-77566b9dab74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:00.045906 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f494f08-c1ee-404d-b2b3-77566b9dab74 admin admin] PATH_INFO: `/v3/projects/e99301b6be364abca9ba02c84552a96d` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:00.047571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f494f08-c1ee-404d-b2b3-77566b9dab74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e99301b6be364abca9ba02c84552a96d)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:00.049868 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f494f08-c1ee-404d-b2b3-77566b9dab74 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:00.130025 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-2f494f08-c1ee-404d-b2b3-77566b9dab74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e99301b6be364abca9ba02c84552a96d', 'request_id': 'req-2f494f08-c1ee-404d-b2b3-77566b9dab74'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:00.139420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-2f494f08-c1ee-404d-b2b3-77566b9dab74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e99301b6be364abca9ba02c84552a96d', 'request_id': 'req-2f494f08-c1ee-404d-b2b3-77566b9dab74'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:00.152157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-2f494f08-c1ee-404d-b2b3-77566b9dab74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e99301b6be364abca9ba02c84552a96d', 'request_id': 'req-2f494f08-c1ee-404d-b2b3-77566b9dab74'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:00.190360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-2f494f08-c1ee-404d-b2b3-77566b9dab74 admin admin] The token cache is being invalidate because project e99301b6be364abca9ba02c84552a96d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:00.190956 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-2f494f08-c1ee-404d-b2b3-77566b9dab74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:00.199101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-2f494f08-c1ee-404d-b2b3-77566b9dab74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:00.207435 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 974/1974] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:40:59 2022] DELETE /identity/v3/projects/e99301b6be364abca9ba02c84552a96d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:41:00.211233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93a673-e5f3-4486-ad70-749fb1c92df2 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:00.212116 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93a673-e5f3-4486-ad70-749fb1c92df2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:00.212830 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93a673-e5f3-4486-ad70-749fb1c92df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:00.254803 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ec93a673-e5f3-4486-ad70-749fb1c92df2 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:00.256161 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ec93a673-e5f3-4486-ad70-749fb1c92df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:00.355387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f494f08-c1ee-404d-b2b3-77566b9dab74 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:00.358750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-2f494f08-c1ee-404d-b2b3-77566b9dab74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:00.478171 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1001/1975] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:00.489620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf9a4f-2cf4-4d14-838f-4cea34c26f1b None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:00.491797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf9a4f-2cf4-4d14-838f-4cea34c26f1b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:00.493575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf9a4f-2cf4-4d14-838f-4cea34c26f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:00.565535 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-94cf9a4f-2cf4-4d14-838f-4cea34c26f1b None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:00.566966 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-94cf9a4f-2cf4-4d14-838f-4cea34c26f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:00.594774 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1002/1976] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:00.601734 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf9a4f-2cf4-4d14-838f-4cea34c26f1b None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:00.610954 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f494f08-c1ee-404d-b2b3-77566b9dab74 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:00.622524 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf9a4f-2cf4-4d14-838f-4cea34c26f1b None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:00.625706 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0e39e-85fe-4e1d-b2d1-aae982c29183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:00.628100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0e39e-85fe-4e1d-b2d1-aae982c29183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:00.629304 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0e39e-85fe-4e1d-b2d1-aae982c29183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:00.632464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0e39e-85fe-4e1d-b2d1-aae982c29183 admin admin] PATH_INFO: `/v3/projects/e1071034fd3d4d64a55bd17877a94df3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:00.635502 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0e39e-85fe-4e1d-b2d1-aae982c29183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1071034fd3d4d64a55bd17877a94df3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:00.644404 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a03937-3d02-46cf-abdf-e01769fa837d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:00.645670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a03937-3d02-46cf-abdf-e01769fa837d admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:00.646208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0e39e-85fe-4e1d-b2d1-aae982c29183 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:00.648679 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a03937-3d02-46cf-abdf-e01769fa837d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:00.651175 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a03937-3d02-46cf-abdf-e01769fa837d admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:00.655284 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a03937-3d02-46cf-abdf-e01769fa837d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:41:00.655528 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a03937-3d02-46cf-abdf-e01769fa837d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:00.672816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a03937-3d02-46cf-abdf-e01769fa837d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:00.681167 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:00.739507 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1003/1977] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:41:00.744705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a03937-3d02-46cf-abdf-e01769fa837d admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:00.791811 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a03937-3d02-46cf-abdf-e01769fa837d admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:00.801444 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76183763-3849-4849-9492-541af30298d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:00.802350 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76183763-3849-4849-9492-541af30298d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:00.802878 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76183763-3849-4849-9492-541af30298d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:00.803416 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76183763-3849-4849-9492-541af30298d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:00.807527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76183763-3849-4849-9492-541af30298d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:00.813515 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76183763-3849-4849-9492-541af30298d5 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:00.842979 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:00.869838 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-1cb0e39e-85fe-4e1d-b2d1-aae982c29183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1071034fd3d4d64a55bd17877a94df3', 'request_id': 'req-1cb0e39e-85fe-4e1d-b2d1-aae982c29183'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:00.890245 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-1cb0e39e-85fe-4e1d-b2d1-aae982c29183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1071034fd3d4d64a55bd17877a94df3', 'request_id': 'req-1cb0e39e-85fe-4e1d-b2d1-aae982c29183'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:00.910859 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-1cb0e39e-85fe-4e1d-b2d1-aae982c29183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1071034fd3d4d64a55bd17877a94df3', 'request_id': 'req-1cb0e39e-85fe-4e1d-b2d1-aae982c29183'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:00.940243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1004/1978] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:00 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:00.945895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76183763-3849-4849-9492-541af30298d5 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:00.954095 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-1cb0e39e-85fe-4e1d-b2d1-aae982c29183 admin admin] The token cache is being invalidate because project e1071034fd3d4d64a55bd17877a94df3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:00.955460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-1cb0e39e-85fe-4e1d-b2d1-aae982c29183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:00.956793 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-1cb0e39e-85fe-4e1d-b2d1-aae982c29183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:00.960531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 975/1979] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:00 2022] DELETE /identity/v3/projects/e1071034fd3d4d64a55bd17877a94df3 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:00.967436 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0e39e-85fe-4e1d-b2d1-aae982c29183 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:00.977020 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-1cb0e39e-85fe-4e1d-b2d1-aae982c29183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:01.125986 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76183763-3849-4849-9492-541af30298d5 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:01.135635 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90abed7-0b07-4435-b2e8-39e20849470e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:01.137120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90abed7-0b07-4435-b2e8-39e20849470e admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:01.137626 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90abed7-0b07-4435-b2e8-39e20849470e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:01.138911 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90abed7-0b07-4435-b2e8-39e20849470e admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:01.140730 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90abed7-0b07-4435-b2e8-39e20849470e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:01.145775 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90abed7-0b07-4435-b2e8-39e20849470e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:01.161582 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0e39e-85fe-4e1d-b2d1-aae982c29183 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:01.175075 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7010126-5f70-4593-b311-53c2e0553319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:01.177017 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7010126-5f70-4593-b311-53c2e0553319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:01.178012 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7010126-5f70-4593-b311-53c2e0553319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:01.178712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7010126-5f70-4593-b311-53c2e0553319 admin admin] PATH_INFO: `/v3/users/f7ac32ba9f5948518856d1e93df7f3a9` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:01.182012 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7010126-5f70-4593-b311-53c2e0553319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7ac32ba9f5948518856d1e93df7f3a9)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:01.186433 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7010126-5f70-4593-b311-53c2e0553319 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:01.196269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1005/1980] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:00 2022] POST /identity/v3/users => generated 292 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:01.197338 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90abed7-0b07-4435-b2e8-39e20849470e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:01.200569 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a90abed7-0b07-4435-b2e8-39e20849470e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:01.230312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90abed7-0b07-4435-b2e8-39e20849470e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:01.237247 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec86dd2-32bd-43c6-9d25-2a6e388f37b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:01.237247 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec86dd2-32bd-43c6-9d25-2a6e388f37b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:01.237771 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec86dd2-32bd-43c6-9d25-2a6e388f37b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:01.237928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec86dd2-32bd-43c6-9d25-2a6e388f37b8 admin admin] PATH_INFO: `/v3/projects/578b5d92222746c182d770ee5c5a29fb` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:01.240026 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec86dd2-32bd-43c6-9d25-2a6e388f37b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=578b5d92222746c182d770ee5c5a29fb)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:01.242645 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec86dd2-32bd-43c6-9d25-2a6e388f37b8 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:01.265575 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f7010126-5f70-4593-b311-53c2e0553319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7ac32ba9f5948518856d1e93df7f3a9'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:01.278015 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f7010126-5f70-4593-b311-53c2e0553319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7ac32ba9f5948518856d1e93df7f3a9'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:01.295999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f7010126-5f70-4593-b311-53c2e0553319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7ac32ba9f5948518856d1e93df7f3a9'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:01.296966 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f7010126-5f70-4593-b311-53c2e0553319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7ac32ba9f5948518856d1e93df7f3a9'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:01.297696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f7010126-5f70-4593-b311-53c2e0553319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7ac32ba9f5948518856d1e93df7f3a9'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:01.321401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 976/1981] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:00 2022] DELETE /identity/v3/users/f7ac32ba9f5948518856d1e93df7f3a9 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:01.321401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7010126-5f70-4593-b311-53c2e0553319 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:01.321401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f7010126-5f70-4593-b311-53c2e0553319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:01.339652 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bec86dd2-32bd-43c6-9d25-2a6e388f37b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '578b5d92222746c182d770ee5c5a29fb', 'request_id': 'req-bec86dd2-32bd-43c6-9d25-2a6e388f37b8'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:01.369195 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bec86dd2-32bd-43c6-9d25-2a6e388f37b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '578b5d92222746c182d770ee5c5a29fb', 'request_id': 'req-bec86dd2-32bd-43c6-9d25-2a6e388f37b8'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:01.391228 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bec86dd2-32bd-43c6-9d25-2a6e388f37b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '578b5d92222746c182d770ee5c5a29fb', 'request_id': 'req-bec86dd2-32bd-43c6-9d25-2a6e388f37b8'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:01.393233 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:01.424106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7010126-5f70-4593-b311-53c2e0553319 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:01.426864 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bec86dd2-32bd-43c6-9d25-2a6e388f37b8 admin admin] The token cache is being invalidate because project 578b5d92222746c182d770ee5c5a29fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:01.427360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bec86dd2-32bd-43c6-9d25-2a6e388f37b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:01.429056 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bec86dd2-32bd-43c6-9d25-2a6e388f37b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:01.431188 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1006/1982] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:01 2022] DELETE /identity/v3/projects/578b5d92222746c182d770ee5c5a29fb => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:01.438367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942e096-268d-426f-996b-879e8ca4009a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:01.439389 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942e096-268d-426f-996b-879e8ca4009a admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:01.439874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942e096-268d-426f-996b-879e8ca4009a admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:01.440035 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d7ec1-7e6a-4e33-8f13-de841afd2b35 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:01.440472 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d7ec1-7e6a-4e33-8f13-de841afd2b35 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:01.440695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942e096-268d-426f-996b-879e8ca4009a admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:01.441430 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d7ec1-7e6a-4e33-8f13-de841afd2b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:01.442622 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942e096-268d-426f-996b-879e8ca4009a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:01.446553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942e096-268d-426f-996b-879e8ca4009a admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:01.465615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 977/1983] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:01.467521 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942e096-268d-426f-996b-879e8ca4009a admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:01.471278 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-8942e096-268d-426f-996b-879e8ca4009a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:01.473191 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-a93d7ec1-7e6a-4e33-8f13-de841afd2b35 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:01.477146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a93d7ec1-7e6a-4e33-8f13-de841afd2b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:01.501625 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942e096-268d-426f-996b-879e8ca4009a admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:01.504911 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1007/1984] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:01.510912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd98fb8-12be-430f-86fb-6d346d47a7db None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:01.511368 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd98fb8-12be-430f-86fb-6d346d47a7db None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:01.511621 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb74f6f-3cf9-4025-8262-cd307ceb977b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:01.512854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd98fb8-12be-430f-86fb-6d346d47a7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:01.514605 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb74f6f-3cf9-4025-8262-cd307ceb977b admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:01.514605 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb74f6f-3cf9-4025-8262-cd307ceb977b admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:01.514976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb74f6f-3cf9-4025-8262-cd307ceb977b admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:01.515865 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb74f6f-3cf9-4025-8262-cd307ceb977b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:01.519235 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb74f6f-3cf9-4025-8262-cd307ceb977b admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:01.549686 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 978/1985] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:01.555289 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb74f6f-3cf9-4025-8262-cd307ceb977b admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:01.567578 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-2dd98fb8-12be-430f-86fb-6d346d47a7db None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:01.569746 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2dd98fb8-12be-430f-86fb-6d346d47a7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:01.581784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb74f6f-3cf9-4025-8262-cd307ceb977b admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:01.585988 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1008/1986] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:01.591242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd98fb8-12be-430f-86fb-6d346d47a7db None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:01.592305 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f246b5-532c-4243-a072-92b4799a185c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:01.593846 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f246b5-532c-4243-a072-92b4799a185c admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:01.594446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f246b5-532c-4243-a072-92b4799a185c admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:01.594988 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f246b5-532c-4243-a072-92b4799a185c admin admin] PATH_INFO: `/v3/projects/855a0259cd86453ca24702268b6c5250/users/415263c287524e97ba3bf95169bc1c3f/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:01.611799 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd98fb8-12be-430f-86fb-6d346d47a7db None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:01.622015 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2161a-27b1-4508-8a2e-9a38c9593fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:01.623233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2161a-27b1-4508-8a2e-9a38c9593fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:01.623815 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2161a-27b1-4508-8a2e-9a38c9593fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:01.624437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2161a-27b1-4508-8a2e-9a38c9593fb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:01.625894 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2161a-27b1-4508-8a2e-9a38c9593fb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:41:01.626542 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2161a-27b1-4508-8a2e-9a38c9593fb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:01.630015 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2161a-27b1-4508-8a2e-9a38c9593fb7 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:01.632442 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f246b5-532c-4243-a072-92b4799a185c admin admin] RBAC: Authorizing `identity:create_grant(project_id=855a0259cd86453ca24702268b6c5250, user_id=415263c287524e97ba3bf95169bc1c3f, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:01.639347 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f246b5-532c-4243-a072-92b4799a185c admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:01.671627 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1009/1987] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:41:01.679763 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2161a-27b1-4508-8a2e-9a38c9593fb7 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:01.693002 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 979/1988] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:01 2022] PUT /identity/v3/projects/855a0259cd86453ca24702268b6c5250/users/415263c287524e97ba3bf95169bc1c3f/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:01.701997 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2161a-27b1-4508-8a2e-9a38c9593fb7 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:01.706108 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdc023-efee-4348-89d0-0f0c9bcca49c None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:01.706590 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdc023-efee-4348-89d0-0f0c9bcca49c None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:01.707257 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdc023-efee-4348-89d0-0f0c9bcca49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:01.775652 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:01.795464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-2ecdc023-efee-4348-89d0-0f0c9bcca49c None None] MFA Rules not processed for user `415263c287524e97ba3bf95169bc1c3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:01.806527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-2ecdc023-efee-4348-89d0-0f0c9bcca49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:01.923062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32203a92-5344-4534-af49-0f529f669eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:01.923954 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32203a92-5344-4534-af49-0f529f669eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:01.924473 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32203a92-5344-4534-af49-0f529f669eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:01.925616 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32203a92-5344-4534-af49-0f529f669eb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:01.926469 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32203a92-5344-4534-af49-0f529f669eb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:01.932799 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32203a92-5344-4534-af49-0f529f669eb3 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:01.970895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 980/1989] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:41:01.972781 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecdc023-efee-4348-89d0-0f0c9bcca49c None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:01.977141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-2ecdc023-efee-4348-89d0-0f0c9bcca49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:02.004108 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecdc023-efee-4348-89d0-0f0c9bcca49c None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:02.025115 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6cb92-3f61-4ffd-99af-2c8e46771e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:02.026496 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6cb92-3f61-4ffd-99af-2c8e46771e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:02.026923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6cb92-3f61-4ffd-99af-2c8e46771e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:02.027493 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6cb92-3f61-4ffd-99af-2c8e46771e0a admin admin] PATH_INFO: `/v3/projects/b2c76b97605c4197b2dbeae75d8660f0` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:02.032965 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1010/1990] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:01 2022] POST /identity/v3/projects => generated 409 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:02.032965 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32203a92-5344-4534-af49-0f529f669eb3 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:02.034168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6cb92-3f61-4ffd-99af-2c8e46771e0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2c76b97605c4197b2dbeae75d8660f0)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:02.034168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6cb92-3f61-4ffd-99af-2c8e46771e0a admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:02.116466 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32203a92-5344-4534-af49-0f529f669eb3 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:02.122815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9af6cb92-3f61-4ffd-99af-2c8e46771e0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2c76b97605c4197b2dbeae75d8660f0', 'request_id': 'req-9af6cb92-3f61-4ffd-99af-2c8e46771e0a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:02.132935 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9af6cb92-3f61-4ffd-99af-2c8e46771e0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2c76b97605c4197b2dbeae75d8660f0', 'request_id': 'req-9af6cb92-3f61-4ffd-99af-2c8e46771e0a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:02.144530 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9af6cb92-3f61-4ffd-99af-2c8e46771e0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2c76b97605c4197b2dbeae75d8660f0', 'request_id': 'req-9af6cb92-3f61-4ffd-99af-2c8e46771e0a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:02.169820 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9af6cb92-3f61-4ffd-99af-2c8e46771e0a admin admin] The token cache is being invalidate because project b2c76b97605c4197b2dbeae75d8660f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:02.171026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9af6cb92-3f61-4ffd-99af-2c8e46771e0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:02.171026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9af6cb92-3f61-4ffd-99af-2c8e46771e0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:02.177538 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 981/1991] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:01 2022] DELETE /identity/v3/projects/b2c76b97605c4197b2dbeae75d8660f0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:02.182933 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6cb92-3f61-4ffd-99af-2c8e46771e0a admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:02.184541 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-9af6cb92-3f61-4ffd-99af-2c8e46771e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:02.230229 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:02.240918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff96f32-10a0-4bb1-8fca-319fd9c1d74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:02.242298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff96f32-10a0-4bb1-8fca-319fd9c1d74a admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:02.242768 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff96f32-10a0-4bb1-8fca-319fd9c1d74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:02.243044 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff96f32-10a0-4bb1-8fca-319fd9c1d74a admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:02.252024 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff96f32-10a0-4bb1-8fca-319fd9c1d74a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:02.261041 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff96f32-10a0-4bb1-8fca-319fd9c1d74a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:02.349975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1011/1992] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:02 2022] POST /identity/v3/projects => generated 383 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:02.350278 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff96f32-10a0-4bb1-8fca-319fd9c1d74a admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:02.361469 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6cb92-3f61-4ffd-99af-2c8e46771e0a admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:02.362009 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cff96f32-10a0-4bb1-8fca-319fd9c1d74a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:02.435049 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:02.481971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff96f32-10a0-4bb1-8fca-319fd9c1d74a admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:02.489248 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e131e-117b-492d-82db-d985166a5167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:02.490645 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e131e-117b-492d-82db-d985166a5167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:02.491100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e131e-117b-492d-82db-d985166a5167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:02.491658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e131e-117b-492d-82db-d985166a5167 admin admin] PATH_INFO: `/v3/projects/01b5fed174f9456a886497012804f41e` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:02.493063 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e131e-117b-492d-82db-d985166a5167 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01b5fed174f9456a886497012804f41e)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:02.494420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815045c-7ce6-429d-9e47-249996c353e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:02.495236 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e131e-117b-492d-82db-d985166a5167 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:02.495426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815045c-7ce6-429d-9e47-249996c353e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:02.495897 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815045c-7ce6-429d-9e47-249996c353e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:02.499609 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815045c-7ce6-429d-9e47-249996c353e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:02.499609 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815045c-7ce6-429d-9e47-249996c353e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:02.501503 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815045c-7ce6-429d-9e47-249996c353e0 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:02.540867 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 982/1993] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:02 2022] POST /identity/v3/users => generated 305 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:02.542018 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dbd07-3ddd-449b-b8fc-5f91bcd07ed4 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:02.543075 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dbd07-3ddd-449b-b8fc-5f91bcd07ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:02.543371 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dbd07-3ddd-449b-b8fc-5f91bcd07ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:02.577280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-278e131e-117b-492d-82db-d985166a5167 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01b5fed174f9456a886497012804f41e', 'request_id': 'req-278e131e-117b-492d-82db-d985166a5167'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:02.583960 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-819dbd07-3ddd-449b-b8fc-5f91bcd07ed4 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:02.585260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-819dbd07-3ddd-449b-b8fc-5f91bcd07ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:02.591649 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-278e131e-117b-492d-82db-d985166a5167 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01b5fed174f9456a886497012804f41e', 'request_id': 'req-278e131e-117b-492d-82db-d985166a5167'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:02.603111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-278e131e-117b-492d-82db-d985166a5167 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01b5fed174f9456a886497012804f41e', 'request_id': 'req-278e131e-117b-492d-82db-d985166a5167'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:02.621217 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-278e131e-117b-492d-82db-d985166a5167 admin admin] The token cache is being invalidate because project 01b5fed174f9456a886497012804f41e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:02.621698 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-278e131e-117b-492d-82db-d985166a5167 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:02.622578 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-278e131e-117b-492d-82db-d985166a5167 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:02.624819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1012/1994] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:02 2022] DELETE /identity/v3/projects/01b5fed174f9456a886497012804f41e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:02.629007 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e131e-117b-492d-82db-d985166a5167 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:02.632305 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-278e131e-117b-492d-82db-d985166a5167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:02.699869 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 983/1995] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:02.699869 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819dbd07-3ddd-449b-b8fc-5f91bcd07ed4 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:02.699869 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-819dbd07-3ddd-449b-b8fc-5f91bcd07ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:02.707967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819dbd07-3ddd-449b-b8fc-5f91bcd07ed4 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:02.713516 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbf4e7-7e9f-4d69-b1e5-4177a6bf39a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:02.714213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbf4e7-7e9f-4d69-b1e5-4177a6bf39a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:02.714501 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbf4e7-7e9f-4d69-b1e5-4177a6bf39a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:02.714782 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbf4e7-7e9f-4d69-b1e5-4177a6bf39a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:02.715457 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bbf4e7-7e9f-4d69-b1e5-4177a6bf39a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:02.717189 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bbf4e7-7e9f-4d69-b1e5-4177a6bf39a9 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:02.730256 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 984/1996] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:02.735855 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbf4e7-7e9f-4d69-b1e5-4177a6bf39a9 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:02.738878 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e131e-117b-492d-82db-d985166a5167 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:02.739379 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a5bbf4e7-7e9f-4d69-b1e5-4177a6bf39a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:02.746185 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79fec1-2b8b-4fff-bfad-405955499a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:02.746938 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79fec1-2b8b-4fff-bfad-405955499a4f admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:02.747289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79fec1-2b8b-4fff-bfad-405955499a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:02.747625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79fec1-2b8b-4fff-bfad-405955499a4f admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:02.748499 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79fec1-2b8b-4fff-bfad-405955499a4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:02.750671 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79fec1-2b8b-4fff-bfad-405955499a4f admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:02.769078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbf4e7-7e9f-4d69-b1e5-4177a6bf39a9 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:02.778350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f736b2-e66d-4906-8277-8ea964099f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:02.778925 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1013/1997] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:02 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:02.780548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9297fbe-16a9-4bf5-86ca-e2442d544e7c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:02.780731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f736b2-e66d-4906-8277-8ea964099f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:02.780833 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9297fbe-16a9-4bf5-86ca-e2442d544e7c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:02.781065 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f736b2-e66d-4906-8277-8ea964099f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:02.781182 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9297fbe-16a9-4bf5-86ca-e2442d544e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:02.781361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f736b2-e66d-4906-8277-8ea964099f5a admin admin] PATH_INFO: `/v3/users/85e1d1db9d4948758bf180994e6e1df3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:02.782716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f736b2-e66d-4906-8277-8ea964099f5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=85e1d1db9d4948758bf180994e6e1df3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:02.785286 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f736b2-e66d-4906-8277-8ea964099f5a admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:02.805542 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-c9297fbe-16a9-4bf5-86ca-e2442d544e7c None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:02.806792 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c9297fbe-16a9-4bf5-86ca-e2442d544e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:02.819950 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1014/1998] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:02.824109 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9297fbe-16a9-4bf5-86ca-e2442d544e7c None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:02.832333 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9297fbe-16a9-4bf5-86ca-e2442d544e7c None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:02.837468 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4a4d6-bbb9-48eb-8565-536ce9857b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:02.838097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4a4d6-bbb9-48eb-8565-536ce9857b76 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:02.838373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4a4d6-bbb9-48eb-8565-536ce9857b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:02.838641 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4a4d6-bbb9-48eb-8565-536ce9857b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:02.839802 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4a4d6-bbb9-48eb-8565-536ce9857b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:02.842092 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4a4d6-bbb9-48eb-8565-536ce9857b76 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:02.844395 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:02.860840 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1015/1999] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:02.861152 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e0f736b2-e66d-4906-8277-8ea964099f5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85e1d1db9d4948758bf180994e6e1df3'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:02.861311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4a4d6-bbb9-48eb-8565-536ce9857b76 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:02.871226 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e0f736b2-e66d-4906-8277-8ea964099f5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85e1d1db9d4948758bf180994e6e1df3'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:02.871497 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4a4d6-bbb9-48eb-8565-536ce9857b76 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:02.876722 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890f372-9792-4f08-875a-b34d4e5732b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:02.877340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890f372-9792-4f08-875a-b34d4e5732b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:02.877621 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890f372-9792-4f08-875a-b34d4e5732b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:02.877894 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890f372-9792-4f08-875a-b34d4e5732b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:02.878564 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890f372-9792-4f08-875a-b34d4e5732b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:02.880238 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890f372-9792-4f08-875a-b34d4e5732b9 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:02.890342 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e0f736b2-e66d-4906-8277-8ea964099f5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85e1d1db9d4948758bf180994e6e1df3'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:02.891115 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e0f736b2-e66d-4906-8277-8ea964099f5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85e1d1db9d4948758bf180994e6e1df3'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:02.891770 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e0f736b2-e66d-4906-8277-8ea964099f5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85e1d1db9d4948758bf180994e6e1df3'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:02.894268 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1016/2000] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:02.895548 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890f372-9792-4f08-875a-b34d4e5732b9 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:02.898973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3890f372-9792-4f08-875a-b34d4e5732b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:02.909534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 985/2001] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:02 2022] DELETE /identity/v3/users/85e1d1db9d4948758bf180994e6e1df3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:02.910589 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f736b2-e66d-4906-8277-8ea964099f5a admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:02.912472 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-e0f736b2-e66d-4906-8277-8ea964099f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:02.921140 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890f372-9792-4f08-875a-b34d4e5732b9 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:02.965236 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:03.006202 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f736b2-e66d-4906-8277-8ea964099f5a admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:03.011691 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f712d-fb45-47c8-94f3-b89601d80500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:03.012490 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f712d-fb45-47c8-94f3-b89601d80500 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:03.012827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f712d-fb45-47c8-94f3-b89601d80500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:03.013102 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f712d-fb45-47c8-94f3-b89601d80500 admin admin] PATH_INFO: `/v3/projects/ae6471c69766417ca3225d1bf5d391d7/users/831bae320a7448b3b3e59aba2c5e47b8/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:03.019175 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9c2e9-2d2e-4297-9561-b5477ff84551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:03.021087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9c2e9-2d2e-4297-9561-b5477ff84551 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:03.021409 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9c2e9-2d2e-4297-9561-b5477ff84551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:03.021686 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9c2e9-2d2e-4297-9561-b5477ff84551 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:03.022372 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9c2e9-2d2e-4297-9561-b5477ff84551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:41:03.023498 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9c2e9-2d2e-4297-9561-b5477ff84551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:03.024489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9c2e9-2d2e-4297-9561-b5477ff84551 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:03.035661 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f712d-fb45-47c8-94f3-b89601d80500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6471c69766417ca3225d1bf5d391d7, user_id=831bae320a7448b3b3e59aba2c5e47b8, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:03.039200 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f712d-fb45-47c8-94f3-b89601d80500 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:03.041530 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1017/2002] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:41:03.042430 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9c2e9-2d2e-4297-9561-b5477ff84551 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:03.045359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-faf9c2e9-2d2e-4297-9561-b5477ff84551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:03.066009 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9c2e9-2d2e-4297-9561-b5477ff84551 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:03.085057 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 986/2003] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:02 2022] PUT /identity/v3/projects/ae6471c69766417ca3225d1bf5d391d7/users/831bae320a7448b3b3e59aba2c5e47b8/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:03.085057 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f712d-fb45-47c8-94f3-b89601d80500 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:03.215136 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e87fd3-feac-4655-931a-f07244fd56a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:03.216088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e87fd3-feac-4655-931a-f07244fd56a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:03.217105 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e87fd3-feac-4655-931a-f07244fd56a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:03.220013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e87fd3-feac-4655-931a-f07244fd56a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:03.221146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e87fd3-feac-4655-931a-f07244fd56a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:03.226665 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f712d-fb45-47c8-94f3-b89601d80500 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:03.227315 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e87fd3-feac-4655-931a-f07244fd56a6 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:03.246708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4bbc0-b47b-4194-8749-8437b864a613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:03.247681 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4bbc0-b47b-4194-8749-8437b864a613 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:03.248122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1018/2004] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:03.249294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4bbc0-b47b-4194-8749-8437b864a613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:03.249518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e2873-81ea-42a1-85c4-de768f950650 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:03.249871 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e2873-81ea-42a1-85c4-de768f950650 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:03.250152 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e2873-81ea-42a1-85c4-de768f950650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:03.250638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4bbc0-b47b-4194-8749-8437b864a613 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:03.252113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4bbc0-b47b-4194-8749-8437b864a613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:03.258585 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4bbc0-b47b-4194-8749-8437b864a613 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:03.294931 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-5c5e2873-81ea-42a1-85c4-de768f950650 None None] MFA Rules not processed for user `831bae320a7448b3b3e59aba2c5e47b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:03.298527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5c5e2873-81ea-42a1-85c4-de768f950650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:03.363018 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 987/2005] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:03 2022] POST /identity/v3/projects => generated 365 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:03.376737 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4bbc0-b47b-4194-8749-8437b864a613 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:03.506936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:03.580697 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4bbc0-b47b-4194-8749-8437b864a613 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:03.589715 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1019/2006] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:03 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:03.589715 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e2873-81ea-42a1-85c4-de768f950650 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:03.596617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0e674-9cc5-4a45-a88f-f11d236415df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:03.598436 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0e674-9cc5-4a45-a88f-f11d236415df admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:03.599271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0e674-9cc5-4a45-a88f-f11d236415df admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:03.600505 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0e674-9cc5-4a45-a88f-f11d236415df admin admin] PATH_INFO: `/v3/projects/37a9055e9e824e7c9dec988094a50654/users/af3ad32b475943e98122c07b51cecf8a/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:03.610354 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e2873-81ea-42a1-85c4-de768f950650 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:03.625507 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe447c90-f4c0-4bef-b94a-456ad0909055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:03.626158 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe447c90-f4c0-4bef-b94a-456ad0909055 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:03.626452 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe447c90-f4c0-4bef-b94a-456ad0909055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:03.626863 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe447c90-f4c0-4bef-b94a-456ad0909055 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:03.627425 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe447c90-f4c0-4bef-b94a-456ad0909055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:03.633847 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe447c90-f4c0-4bef-b94a-456ad0909055 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:03.656983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0e674-9cc5-4a45-a88f-f11d236415df admin admin] RBAC: Authorizing `identity:create_grant(project_id=37a9055e9e824e7c9dec988094a50654, user_id=af3ad32b475943e98122c07b51cecf8a, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:03.663302 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0e674-9cc5-4a45-a88f-f11d236415df admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:03.666566 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1020/2007] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:03 2022] POST /identity/v3/users => generated 283 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:03.667575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe447c90-f4c0-4bef-b94a-456ad0909055 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:03.670246 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fe447c90-f4c0-4bef-b94a-456ad0909055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:03.691495 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe447c90-f4c0-4bef-b94a-456ad0909055 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:03.724215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 988/2008] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:03 2022] PUT /identity/v3/projects/37a9055e9e824e7c9dec988094a50654/users/af3ad32b475943e98122c07b51cecf8a/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:03.724215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0e674-9cc5-4a45-a88f-f11d236415df admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:03.771713 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:03.851431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd904c4-8804-45a1-a047-d4ddd2affdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:03.852109 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd904c4-8804-45a1-a047-d4ddd2affdf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:03.852421 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd904c4-8804-45a1-a047-d4ddd2affdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:03.852700 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd904c4-8804-45a1-a047-d4ddd2affdf6 admin admin] PATH_INFO: `/v3/projects/393c38bc752a4fc7933b614e39b1f419` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:03.856339 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd904c4-8804-45a1-a047-d4ddd2affdf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=393c38bc752a4fc7933b614e39b1f419)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:03.861512 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd904c4-8804-45a1-a047-d4ddd2affdf6 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:03.865207 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0e674-9cc5-4a45-a88f-f11d236415df admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:03.871804 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d2c18-f77c-4cc1-bd52-01f2f315651d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:03.873772 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d2c18-f77c-4cc1-bd52-01f2f315651d admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:03.874063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d2c18-f77c-4cc1-bd52-01f2f315651d admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:03.874344 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d2c18-f77c-4cc1-bd52-01f2f315651d admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:03.876354 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d2c18-f77c-4cc1-bd52-01f2f315651d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:03.878778 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d2c18-f77c-4cc1-bd52-01f2f315651d admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:03.942325 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1dd904c4-8804-45a1-a047-d4ddd2affdf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '393c38bc752a4fc7933b614e39b1f419', 'request_id': 'req-1dd904c4-8804-45a1-a047-d4ddd2affdf6'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:03.947982 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 989/2009] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:03 2022] POST /identity/v3/projects => generated 407 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:03.947982 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d2c18-f77c-4cc1-bd52-01f2f315651d admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:03.952387 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1dd904c4-8804-45a1-a047-d4ddd2affdf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '393c38bc752a4fc7933b614e39b1f419', 'request_id': 'req-1dd904c4-8804-45a1-a047-d4ddd2affdf6'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:03.962390 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1dd904c4-8804-45a1-a047-d4ddd2affdf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '393c38bc752a4fc7933b614e39b1f419', 'request_id': 'req-1dd904c4-8804-45a1-a047-d4ddd2affdf6'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:04.003416 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1dd904c4-8804-45a1-a047-d4ddd2affdf6 admin admin] The token cache is being invalidate because project 393c38bc752a4fc7933b614e39b1f419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:04.003798 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1dd904c4-8804-45a1-a047-d4ddd2affdf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:04.006643 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1dd904c4-8804-45a1-a047-d4ddd2affdf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:04.009281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1021/2010] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:03 2022] DELETE /identity/v3/projects/393c38bc752a4fc7933b614e39b1f419 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:04.012050 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bf6ea-2634-4967-b4b4-285acc6fd746 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:04.012050 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bf6ea-2634-4967-b4b4-285acc6fd746 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:04.012050 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bf6ea-2634-4967-b4b4-285acc6fd746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:04.057039 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d2c18-f77c-4cc1-bd52-01f2f315651d admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:04.063404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a91c12-1016-4703-884a-623fbce2cbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:04.064063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a91c12-1016-4703-884a-623fbce2cbcf admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:04.064400 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a91c12-1016-4703-884a-623fbce2cbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:04.064685 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a91c12-1016-4703-884a-623fbce2cbcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:04.065358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a91c12-1016-4703-884a-623fbce2cbcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:04.067036 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a91c12-1016-4703-884a-623fbce2cbcf admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:04.067510 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-389bf6ea-2634-4967-b4b4-285acc6fd746 None None] MFA Rules not processed for user `af3ad32b475943e98122c07b51cecf8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:04.070233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-389bf6ea-2634-4967-b4b4-285acc6fd746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:04.085058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 990/2011] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:04.085903 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a91c12-1016-4703-884a-623fbce2cbcf admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:04.087879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a3a91c12-1016-4703-884a-623fbce2cbcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:04.102265 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a91c12-1016-4703-884a-623fbce2cbcf admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:04.107742 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e52b8a-7762-4422-b418-792633ce889e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:04.108677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e52b8a-7762-4422-b418-792633ce889e admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:04.108967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e52b8a-7762-4422-b418-792633ce889e admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:04.109239 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e52b8a-7762-4422-b418-792633ce889e admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:04.109897 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e52b8a-7762-4422-b418-792633ce889e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:04.111886 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e52b8a-7762-4422-b418-792633ce889e admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:04.143045 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 991/2012] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:04 2022] POST /identity/v3/users => generated 310 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:04.144372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3037902-de49-4838-ae0f-03b24cfec33d None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:04.144814 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3037902-de49-4838-ae0f-03b24cfec33d None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:04.145102 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3037902-de49-4838-ae0f-03b24cfec33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:04.185845 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-f3037902-de49-4838-ae0f-03b24cfec33d None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:04.188019 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f3037902-de49-4838-ae0f-03b24cfec33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:04.198869 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1022/2013] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:04.198869 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bf6ea-2634-4967-b4b4-285acc6fd746 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:04.199666 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-389bf6ea-2634-4967-b4b4-285acc6fd746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:04.212120 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 992/2014] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:04.212120 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3037902-de49-4838-ae0f-03b24cfec33d None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:04.223920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3037902-de49-4838-ae0f-03b24cfec33d None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:04.226111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bf6ea-2634-4967-b4b4-285acc6fd746 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:04.232212 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea01992-39be-4e30-86f1-652003f842f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:04.233589 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea01992-39be-4e30-86f1-652003f842f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:04.233995 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950c7f7-1e01-4596-a7ae-106ce3515a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:04.234142 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea01992-39be-4e30-86f1-652003f842f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:04.234502 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea01992-39be-4e30-86f1-652003f842f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:04.235029 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950c7f7-1e01-4596-a7ae-106ce3515a90 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:04.235469 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950c7f7-1e01-4596-a7ae-106ce3515a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:04.235575 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea01992-39be-4e30-86f1-652003f842f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:04.235914 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950c7f7-1e01-4596-a7ae-106ce3515a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:04.237086 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950c7f7-1e01-4596-a7ae-106ce3515a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:04.238424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea01992-39be-4e30-86f1-652003f842f9 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:04.240144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950c7f7-1e01-4596-a7ae-106ce3515a90 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:04.240848 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:04.256323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1023/2015] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:04.257693 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950c7f7-1e01-4596-a7ae-106ce3515a90 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:04.259683 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0950c7f7-1e01-4596-a7ae-106ce3515a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:04.263966 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 993/2016] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:04.266227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab0796-1a2c-4901-bafc-28d2f1d78f22 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:04.266869 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab0796-1a2c-4901-bafc-28d2f1d78f22 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:04.267271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab0796-1a2c-4901-bafc-28d2f1d78f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:04.275187 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950c7f7-1e01-4596-a7ae-106ce3515a90 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:04.280462 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f8489-fa57-4d41-a858-299eb6bc1217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:04.281110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f8489-fa57-4d41-a858-299eb6bc1217 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:04.281389 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f8489-fa57-4d41-a858-299eb6bc1217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:04.281671 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f8489-fa57-4d41-a858-299eb6bc1217 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:04.282360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f8489-fa57-4d41-a858-299eb6bc1217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:04.284730 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f8489-fa57-4d41-a858-299eb6bc1217 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:04.302725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-58ab0796-1a2c-4901-bafc-28d2f1d78f22 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:04.304855 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-58ab0796-1a2c-4901-bafc-28d2f1d78f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:04.318889 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1024/2017] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:04 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:04.320078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 994/2018] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:04.320363 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f8489-fa57-4d41-a858-299eb6bc1217 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:04.321577 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab0796-1a2c-4901-bafc-28d2f1d78f22 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:04.340287 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab0796-1a2c-4901-bafc-28d2f1d78f22 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:04.352886 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:04.428707 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ec8b2-3d6f-4a5c-a31a-795703889cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:04.429465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ec8b2-3d6f-4a5c-a31a-795703889cb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:04.429766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ec8b2-3d6f-4a5c-a31a-795703889cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:04.430049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ec8b2-3d6f-4a5c-a31a-795703889cb2 admin admin] PATH_INFO: `/v3/projects/f435bcfb34a44235ae4c8cc62f6c96cc/users/273bfd880d324545a8662873e5233d7f/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:04.431214 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f8489-fa57-4d41-a858-299eb6bc1217 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:04.437651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc26642-2d00-40a4-8b41-e7eb61654dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:04.438648 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc26642-2d00-40a4-8b41-e7eb61654dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:04.438985 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc26642-2d00-40a4-8b41-e7eb61654dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:04.439307 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc26642-2d00-40a4-8b41-e7eb61654dd1 admin admin] PATH_INFO: `/v3/projects/85708e2f47d044c1b05af06b807caefd/users/2d515e8272c345bd8aedf1c57b0e06b6/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:04.457058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ec8b2-3d6f-4a5c-a31a-795703889cb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f435bcfb34a44235ae4c8cc62f6c96cc, user_id=273bfd880d324545a8662873e5233d7f, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:04.460650 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ec8b2-3d6f-4a5c-a31a-795703889cb2 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:04.467946 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc26642-2d00-40a4-8b41-e7eb61654dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85708e2f47d044c1b05af06b807caefd, user_id=2d515e8272c345bd8aedf1c57b0e06b6, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:04.472625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc26642-2d00-40a4-8b41-e7eb61654dd1 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:04.481356 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 995/2019] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:04 2022] PUT /identity/v3/projects/f435bcfb34a44235ae4c8cc62f6c96cc/users/273bfd880d324545a8662873e5233d7f/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:04.485819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ec8b2-3d6f-4a5c-a31a-795703889cb2 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:04.494436 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1025/2020] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:04 2022] PUT /identity/v3/projects/85708e2f47d044c1b05af06b807caefd/users/2d515e8272c345bd8aedf1c57b0e06b6/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:04.495814 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc26642-2d00-40a4-8b41-e7eb61654dd1 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:04.569253 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ec8b2-3d6f-4a5c-a31a-795703889cb2 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:04.614966 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc26642-2d00-40a4-8b41-e7eb61654dd1 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:04.623413 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffadab9-17f8-4edc-8079-5458045edff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:04.624490 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffadab9-17f8-4edc-8079-5458045edff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:04.624966 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffadab9-17f8-4edc-8079-5458045edff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:04.625461 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffadab9-17f8-4edc-8079-5458045edff7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:04.626659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffadab9-17f8-4edc-8079-5458045edff7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:41:04.627183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffadab9-17f8-4edc-8079-5458045edff7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:04.630086 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffadab9-17f8-4edc-8079-5458045edff7 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:04.642849 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedda0f-bf5c-4b24-a3de-67698516d303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:04.644263 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedda0f-bf5c-4b24-a3de-67698516d303 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:04.644559 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedda0f-bf5c-4b24-a3de-67698516d303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:04.644844 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedda0f-bf5c-4b24-a3de-67698516d303 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:04.645506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedda0f-bf5c-4b24-a3de-67698516d303 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:04.647630 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedda0f-bf5c-4b24-a3de-67698516d303 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:04.659139 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1026/2021] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:41:04.659139 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffadab9-17f8-4edc-8079-5458045edff7 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:04.676346 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffadab9-17f8-4edc-8079-5458045edff7 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:04.679885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 996/2022] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:04 2022] POST /identity/v3/users => generated 299 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:04.683559 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf84f28-011e-4b54-aa03-a12450edcc37 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:04.684220 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf84f28-011e-4b54-aa03-a12450edcc37 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:04.687325 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf84f28-011e-4b54-aa03-a12450edcc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:04.692987 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74bbbf-7b95-4ee7-b2e1-b15b913228c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:04.694191 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74bbbf-7b95-4ee7-b2e1-b15b913228c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:04.694479 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74bbbf-7b95-4ee7-b2e1-b15b913228c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:04.695214 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74bbbf-7b95-4ee7-b2e1-b15b913228c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:04.695415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74bbbf-7b95-4ee7-b2e1-b15b913228c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:04.697105 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74bbbf-7b95-4ee7-b2e1-b15b913228c6 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:04.712265 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1027/2023] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:04.712265 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74bbbf-7b95-4ee7-b2e1-b15b913228c6 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:04.723867 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74bbbf-7b95-4ee7-b2e1-b15b913228c6 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:04.726727 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:04.731064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a18d4-325b-4172-adb8-d72356bd20b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:04.731974 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a18d4-325b-4172-adb8-d72356bd20b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:04.732670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a18d4-325b-4172-adb8-d72356bd20b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:04.733167 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a18d4-325b-4172-adb8-d72356bd20b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:04.733989 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a18d4-325b-4172-adb8-d72356bd20b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:04.736671 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a18d4-325b-4172-adb8-d72356bd20b7 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:04.749728 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-daf84f28-011e-4b54-aa03-a12450edcc37 None None] MFA Rules not processed for user `2d515e8272c345bd8aedf1c57b0e06b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:04.751854 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-daf84f28-011e-4b54-aa03-a12450edcc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:04.787619 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1028/2024] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:04 2022] POST /identity/v3/projects => generated 363 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:04.787619 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a18d4-325b-4172-adb8-d72356bd20b7 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:04.894257 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 997/2025] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:04.895776 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf84f28-011e-4b54-aa03-a12450edcc37 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:04.915077 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a18d4-325b-4172-adb8-d72356bd20b7 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:04.924155 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfd04e-0262-47ab-bd55-c212f719e2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:04.925191 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfd04e-0262-47ab-bd55-c212f719e2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:04.925665 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfd04e-0262-47ab-bd55-c212f719e2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:04.926145 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfd04e-0262-47ab-bd55-c212f719e2a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:04.928989 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfd04e-0262-47ab-bd55-c212f719e2a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:04.931282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf84f28-011e-4b54-aa03-a12450edcc37 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:04.934136 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfd04e-0262-47ab-bd55-c212f719e2a2 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:04.937986 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:04.945176 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d02d82-ac5a-4ebd-977c-51e0b722c9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:04.946351 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d02d82-ac5a-4ebd-977c-51e0b722c9fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:04.946852 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d02d82-ac5a-4ebd-977c-51e0b722c9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:04.947537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d02d82-ac5a-4ebd-977c-51e0b722c9fd admin admin] PATH_INFO: `/v3/projects/f435bcfb34a44235ae4c8cc62f6c96cc/users/273bfd880d324545a8662873e5233d7f/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:04.951734 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d02d82-ac5a-4ebd-977c-51e0b722c9fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f435bcfb34a44235ae4c8cc62f6c96cc, user_id=273bfd880d324545a8662873e5233d7f, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:04.955159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1029/2026] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:04.956893 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfd04e-0262-47ab-bd55-c212f719e2a2 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:04.957896 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d02d82-ac5a-4ebd-977c-51e0b722c9fd admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:04.972497 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfd04e-0262-47ab-bd55-c212f719e2a2 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:04.988216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 998/2027] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:04 2022] PUT /identity/v3/projects/f435bcfb34a44235ae4c8cc62f6c96cc/users/273bfd880d324545a8662873e5233d7f/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:04.988216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d02d82-ac5a-4ebd-977c-51e0b722c9fd admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:05.090241 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d02d82-ac5a-4ebd-977c-51e0b722c9fd admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:05.098603 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496a52b-e65c-4523-a393-4e1ab7f5a54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:05.100776 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496a52b-e65c-4523-a393-4e1ab7f5a54d admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:05.101534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496a52b-e65c-4523-a393-4e1ab7f5a54d admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:05.102138 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496a52b-e65c-4523-a393-4e1ab7f5a54d admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:05.103229 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496a52b-e65c-4523-a393-4e1ab7f5a54d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:05.111097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496a52b-e65c-4523-a393-4e1ab7f5a54d admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:05.146114 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544402dd-99ba-49df-a6ba-9a617b04d1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:05.147188 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544402dd-99ba-49df-a6ba-9a617b04d1b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:05.147645 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544402dd-99ba-49df-a6ba-9a617b04d1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:05.155044 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544402dd-99ba-49df-a6ba-9a617b04d1b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:05.157515 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544402dd-99ba-49df-a6ba-9a617b04d1b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:05.166347 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544402dd-99ba-49df-a6ba-9a617b04d1b0 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:05.183332 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 999/2028] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:04 2022] POST /identity/v3/projects => generated 363 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:05.183972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496a52b-e65c-4523-a393-4e1ab7f5a54d admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:05.232853 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1030/2029] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:04 2022] POST /identity/v3/users => generated 282 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:05.234551 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68704f6e-ab9b-4f1b-adad-678864d0ac38 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:05.234928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68704f6e-ab9b-4f1b-adad-678864d0ac38 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:05.235290 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68704f6e-ab9b-4f1b-adad-678864d0ac38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:05.293388 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-68704f6e-ab9b-4f1b-adad-678864d0ac38 None None] MFA Rules not processed for user `273bfd880d324545a8662873e5233d7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:05.295494 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-68704f6e-ab9b-4f1b-adad-678864d0ac38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:05.331949 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496a52b-e65c-4523-a393-4e1ab7f5a54d admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:05.343819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc153c-54cd-47fd-aa52-18a40bb22a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:05.345988 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc153c-54cd-47fd-aa52-18a40bb22a55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:05.346287 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc153c-54cd-47fd-aa52-18a40bb22a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:05.346605 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc153c-54cd-47fd-aa52-18a40bb22a55 admin admin] PATH_INFO: `/v3/projects/870584d0d97642e7998742d957badde4/users/719a2384ec8140e189f97b6533e1d2ff/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:05.409367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc153c-54cd-47fd-aa52-18a40bb22a55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=870584d0d97642e7998742d957badde4, user_id=719a2384ec8140e189f97b6533e1d2ff, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:05.415090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc153c-54cd-47fd-aa52-18a40bb22a55 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:05.419168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:05.446657 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1000/2030] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:05 2022] PUT /identity/v3/projects/870584d0d97642e7998742d957badde4/users/719a2384ec8140e189f97b6533e1d2ff/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:05.448010 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc153c-54cd-47fd-aa52-18a40bb22a55 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:05.456287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1031/2031] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:05 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:05.457173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68704f6e-ab9b-4f1b-adad-678864d0ac38 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:05.471306 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68704f6e-ab9b-4f1b-adad-678864d0ac38 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:05.549079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc153c-54cd-47fd-aa52-18a40bb22a55 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:05.555560 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a021ae4-d2dd-43be-9d67-1c307d4cc996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:05.556227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a021ae4-d2dd-43be-9d67-1c307d4cc996 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:05.556558 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a021ae4-d2dd-43be-9d67-1c307d4cc996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:05.556838 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a021ae4-d2dd-43be-9d67-1c307d4cc996 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:05.557634 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a021ae4-d2dd-43be-9d67-1c307d4cc996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:05.559565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a021ae4-d2dd-43be-9d67-1c307d4cc996 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:05.583736 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb30ae-ddb9-44ee-b9b0-b1821fd4c20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:05.584934 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb30ae-ddb9-44ee-b9b0-b1821fd4c20d admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:05.585216 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb30ae-ddb9-44ee-b9b0-b1821fd4c20d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:05.585493 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb30ae-ddb9-44ee-b9b0-b1821fd4c20d admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:05.586379 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb30ae-ddb9-44ee-b9b0-b1821fd4c20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:05.588052 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb30ae-ddb9-44ee-b9b0-b1821fd4c20d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:05.598420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1001/2032] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:05 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:05.600915 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a021ae4-d2dd-43be-9d67-1c307d4cc996 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:05.601801 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1032/2033] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:05.602678 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb30ae-ddb9-44ee-b9b0-b1821fd4c20d admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:05.605126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9beb30ae-ddb9-44ee-b9b0-b1821fd4c20d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:05.622854 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a021ae4-d2dd-43be-9d67-1c307d4cc996 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:05.628517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:05.634069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1725f-e087-4bec-8a4e-f6fe82d02531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:05.635124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1725f-e087-4bec-8a4e-f6fe82d02531 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:05.635624 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1725f-e087-4bec-8a4e-f6fe82d02531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:05.636087 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1725f-e087-4bec-8a4e-f6fe82d02531 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:05.637896 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1725f-e087-4bec-8a4e-f6fe82d02531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:05.640733 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1725f-e087-4bec-8a4e-f6fe82d02531 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:05.661548 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1002/2034] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:05.663029 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1725f-e087-4bec-8a4e-f6fe82d02531 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:05.681163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1725f-e087-4bec-8a4e-f6fe82d02531 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:05.688392 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfba4b-aa4a-4b7f-81a3-3311c771c58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:05.689312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfba4b-aa4a-4b7f-81a3-3311c771c58f admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:05.689605 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfba4b-aa4a-4b7f-81a3-3311c771c58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:05.689868 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfba4b-aa4a-4b7f-81a3-3311c771c58f admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:05.690775 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfba4b-aa4a-4b7f-81a3-3311c771c58f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:05.692454 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfba4b-aa4a-4b7f-81a3-3311c771c58f admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:05.698599 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb30ae-ddb9-44ee-b9b0-b1821fd4c20d admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:05.703922 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca43e8b-67de-4403-b5af-c69995db9b82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:05.704919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca43e8b-67de-4403-b5af-c69995db9b82 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:05.705373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca43e8b-67de-4403-b5af-c69995db9b82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:05.705808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca43e8b-67de-4403-b5af-c69995db9b82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:05.709219 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1003/2035] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:05.710096 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfba4b-aa4a-4b7f-81a3-3311c771c58f admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:05.727969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfba4b-aa4a-4b7f-81a3-3311c771c58f admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:05.734606 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea980f37-931e-49e9-9eed-5f7733a4d434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:05.735772 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea980f37-931e-49e9-9eed-5f7733a4d434 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:05.736119 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea980f37-931e-49e9-9eed-5f7733a4d434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:05.736492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea980f37-931e-49e9-9eed-5f7733a4d434 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:05.737259 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea980f37-931e-49e9-9eed-5f7733a4d434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:05.739393 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea980f37-931e-49e9-9eed-5f7733a4d434 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:05.756844 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1004/2036] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:05.758482 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea980f37-931e-49e9-9eed-5f7733a4d434 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:05.784340 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea980f37-931e-49e9-9eed-5f7733a4d434 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:05.793715 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fc2a0-17ab-4e6d-8d7b-64ccbfc671ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:05.794794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fc2a0-17ab-4e6d-8d7b-64ccbfc671ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:05.795250 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fc2a0-17ab-4e6d-8d7b-64ccbfc671ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:05.795724 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fc2a0-17ab-4e6d-8d7b-64ccbfc671ff admin admin] PATH_INFO: `/v3/projects/870584d0d97642e7998742d957badde4/users/719a2384ec8140e189f97b6533e1d2ff/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:05.799304 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4fc2a0-17ab-4e6d-8d7b-64ccbfc671ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=870584d0d97642e7998742d957badde4, user_id=719a2384ec8140e189f97b6533e1d2ff, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:05.814220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca43e8b-67de-4403-b5af-c69995db9b82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:05.815657 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4fc2a0-17ab-4e6d-8d7b-64ccbfc671ff admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:05.816814 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca43e8b-67de-4403-b5af-c69995db9b82 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:05.835992 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1033/2037] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:05 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:05.837415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca43e8b-67de-4403-b5af-c69995db9b82 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:05.856219 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1005/2038] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:05 2022] PUT /identity/v3/projects/870584d0d97642e7998742d957badde4/users/719a2384ec8140e189f97b6533e1d2ff/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:05.856219 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fc2a0-17ab-4e6d-8d7b-64ccbfc671ff admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:05.857758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca43e8b-67de-4403-b5af-c69995db9b82 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:05.972225 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce402be-7422-4a21-a75c-ac030cee5386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:05.973885 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce402be-7422-4a21-a75c-ac030cee5386 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:05.974366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce402be-7422-4a21-a75c-ac030cee5386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:05.975707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce402be-7422-4a21-a75c-ac030cee5386 admin admin] PATH_INFO: `/v3/projects/52321087ef644b38b8d2b11c478bd3c4/users/c9bce1d085c748759c40b84e2ae8b1f5/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:06.011092 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce402be-7422-4a21-a75c-ac030cee5386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52321087ef644b38b8d2b11c478bd3c4, user_id=c9bce1d085c748759c40b84e2ae8b1f5, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:06.018377 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce402be-7422-4a21-a75c-ac030cee5386 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:06.025857 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fc2a0-17ab-4e6d-8d7b-64ccbfc671ff admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:06.033667 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9b9c4-7fe3-40e2-bc4a-d07c680d3aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:06.034392 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9b9c4-7fe3-40e2-bc4a-d07c680d3aa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:06.034869 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9b9c4-7fe3-40e2-bc4a-d07c680d3aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:06.035087 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9b9c4-7fe3-40e2-bc4a-d07c680d3aa9 admin admin] PATH_INFO: `/v3/projects/30efa630396449289bb0fae867ccd5f3/users/a99dc01f3c4f4573a3be33fffc0b9a41/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:06.046653 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1034/2039] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:05 2022] PUT /identity/v3/projects/52321087ef644b38b8d2b11c478bd3c4/users/c9bce1d085c748759c40b84e2ae8b1f5/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:06.048562 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693acf1b-30e9-4797-984e-a36f1404273c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:06.048983 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693acf1b-30e9-4797-984e-a36f1404273c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:06.049263 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693acf1b-30e9-4797-984e-a36f1404273c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:06.068791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9b9c4-7fe3-40e2-bc4a-d07c680d3aa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30efa630396449289bb0fae867ccd5f3, user_id=a99dc01f3c4f4573a3be33fffc0b9a41, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:06.071576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9b9c4-7fe3-40e2-bc4a-d07c680d3aa9 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:06.096329 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1006/2040] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:05 2022] PUT /identity/v3/projects/30efa630396449289bb0fae867ccd5f3/users/a99dc01f3c4f4573a3be33fffc0b9a41/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:06.096329 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9b9c4-7fe3-40e2-bc4a-d07c680d3aa9 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:06.117344 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-693acf1b-30e9-4797-984e-a36f1404273c None None] MFA Rules not processed for user `719a2384ec8140e189f97b6533e1d2ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:06.119821 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-693acf1b-30e9-4797-984e-a36f1404273c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:06.129257 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:06.185614 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:06.222653 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9b9c4-7fe3-40e2-bc4a-d07c680d3aa9 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:06.230894 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71d896-5a98-4292-be41-10042af76c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:06.232099 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71d896-5a98-4292-be41-10042af76c4d admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:06.232488 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71d896-5a98-4292-be41-10042af76c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:06.232988 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71d896-5a98-4292-be41-10042af76c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:06.234173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71d896-5a98-4292-be41-10042af76c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:06.237498 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71d896-5a98-4292-be41-10042af76c4d admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:06.238263 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1035/2041] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:06.242328 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9922b-317a-47c0-b7a5-ab4bddb3094f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:06.242826 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9922b-317a-47c0-b7a5-ab4bddb3094f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:06.243202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9922b-317a-47c0-b7a5-ab4bddb3094f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:06.266360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1007/2042] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:06.266360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71d896-5a98-4292-be41-10042af76c4d admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:06.285106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-5eb9922b-317a-47c0-b7a5-ab4bddb3094f None None] MFA Rules not processed for user `a99dc01f3c4f4573a3be33fffc0b9a41`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:06.286522 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5eb9922b-317a-47c0-b7a5-ab4bddb3094f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:06.379181 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71d896-5a98-4292-be41-10042af76c4d admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:06.397984 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e425ebd-7d26-4c8a-b73f-8a6ad08d9448 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:06.399083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e425ebd-7d26-4c8a-b73f-8a6ad08d9448 service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:06.399600 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e425ebd-7d26-4c8a-b73f-8a6ad08d9448 service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:06.400099 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e425ebd-7d26-4c8a-b73f-8a6ad08d9448 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:06.408093 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-2e425ebd-7d26-4c8a-b73f-8a6ad08d9448 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:06.434460 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1036/2043] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:06.438024 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9922b-317a-47c0-b7a5-ab4bddb3094f None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:06.439475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5eb9922b-317a-47c0-b7a5-ab4bddb3094f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:06.472332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9922b-317a-47c0-b7a5-ab4bddb3094f None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:06.491486 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c5734-3307-4523-8bf2-ea0a27913d28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:06.492685 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c5734-3307-4523-8bf2-ea0a27913d28 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:06.494004 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c5734-3307-4523-8bf2-ea0a27913d28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:06.494621 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c5734-3307-4523-8bf2-ea0a27913d28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:06.500518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ae3c5734-3307-4523-8bf2-ea0a27913d28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:06.597923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e425ebd-7d26-4c8a-b73f-8a6ad08d9448 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:06.600881 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e425ebd-7d26-4c8a-b73f-8a6ad08d9448 service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:06.634563 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1008/2044] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:06 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:06.636511 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e425ebd-7d26-4c8a-b73f-8a6ad08d9448 service cinder] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:06.644413 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c5734-3307-4523-8bf2-ea0a27913d28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:06.647739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c5734-3307-4523-8bf2-ea0a27913d28 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:06.663722 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e425ebd-7d26-4c8a-b73f-8a6ad08d9448 service cinder] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:06.666708 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1037/2045] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:06.668334 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c5734-3307-4523-8bf2-ea0a27913d28 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:06.676220 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca082a-1862-4381-901f-ae7877c411ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:06.677413 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca082a-1862-4381-901f-ae7877c411ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:06.677932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca082a-1862-4381-901f-ae7877c411ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:06.678383 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca082a-1862-4381-901f-ae7877c411ff admin admin] PATH_INFO: `/v3/projects/52321087ef644b38b8d2b11c478bd3c4/users/c9bce1d085c748759c40b84e2ae8b1f5/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:06.686120 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca082a-1862-4381-901f-ae7877c411ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=52321087ef644b38b8d2b11c478bd3c4, user_id=c9bce1d085c748759c40b84e2ae8b1f5, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:06.694526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca082a-1862-4381-901f-ae7877c411ff admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:06.695498 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c5734-3307-4523-8bf2-ea0a27913d28 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:06.705624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a1356-0768-401a-a93e-3cc79394e601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:06.706714 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a1356-0768-401a-a93e-3cc79394e601 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:06.707202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a1356-0768-401a-a93e-3cc79394e601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:06.707698 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a1356-0768-401a-a93e-3cc79394e601 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:06.709037 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a1356-0768-401a-a93e-3cc79394e601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:06.717237 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a1356-0768-401a-a93e-3cc79394e601 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:06.722395 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1009/2046] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:06 2022] PUT /identity/v3/projects/52321087ef644b38b8d2b11c478bd3c4/users/c9bce1d085c748759c40b84e2ae8b1f5/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:06.740749 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5d096-3bc4-4cd8-9ad2-4c920d53fbf6 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:06.741205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5d096-3bc4-4cd8-9ad2-4c920d53fbf6 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:06.741766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5d096-3bc4-4cd8-9ad2-4c920d53fbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:06.803846 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1038/2047] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:06 2022] POST /identity/v3/projects => generated 363 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:06.806037 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a1356-0768-401a-a93e-3cc79394e601 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:06.823217 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-9dd5d096-3bc4-4cd8-9ad2-4c920d53fbf6 None None] MFA Rules not processed for user `c9bce1d085c748759c40b84e2ae8b1f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:06.825562 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-9dd5d096-3bc4-4cd8-9ad2-4c920d53fbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:06.897344 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:06.926530 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:06.978266 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a1356-0768-401a-a93e-3cc79394e601 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:06.988760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01815bd8-33fe-4237-b363-2d47711c9f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:06.989754 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01815bd8-33fe-4237-b363-2d47711c9f13 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:06.992510 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01815bd8-33fe-4237-b363-2d47711c9f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:06.992510 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01815bd8-33fe-4237-b363-2d47711c9f13 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:06.992852 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1010/2048] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:41:06.993007 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01815bd8-33fe-4237-b363-2d47711c9f13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:06.996202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01815bd8-33fe-4237-b363-2d47711c9f13 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:07.026451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1039/2049] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:06 2022] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:07.030908 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5d096-3bc4-4cd8-9ad2-4c920d53fbf6 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:07.043547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5d096-3bc4-4cd8-9ad2-4c920d53fbf6 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:07.049953 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3f108-1fbe-4db8-9482-a42e9d9ec171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:07.050634 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3f108-1fbe-4db8-9482-a42e9d9ec171 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:07.050977 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3f108-1fbe-4db8-9482-a42e9d9ec171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:07.051417 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3f108-1fbe-4db8-9482-a42e9d9ec171 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:07.052510 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3f108-1fbe-4db8-9482-a42e9d9ec171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:07.054934 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3f108-1fbe-4db8-9482-a42e9d9ec171 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:07.072527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1011/2050] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:41:07.077773 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01815bd8-33fe-4237-b363-2d47711c9f13 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:07.090517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01815bd8-33fe-4237-b363-2d47711c9f13 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:07.103410 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dee233-4e12-46d2-94e6-977bcc0dc2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:07.104434 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dee233-4e12-46d2-94e6-977bcc0dc2d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:07.104799 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dee233-4e12-46d2-94e6-977bcc0dc2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:07.105139 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dee233-4e12-46d2-94e6-977bcc0dc2d3 admin admin] PATH_INFO: `/v3/projects/4397a7273cdc4eea9ca4e5ccf78e1fd5/users/faba9e38cf584ddb96b535c95449813a/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:07.151016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dee233-4e12-46d2-94e6-977bcc0dc2d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4397a7273cdc4eea9ca4e5ccf78e1fd5, user_id=faba9e38cf584ddb96b535c95449813a, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:07.157415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dee233-4e12-46d2-94e6-977bcc0dc2d3 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:07.171563 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3f108-1fbe-4db8-9482-a42e9d9ec171 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:07.189341 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1040/2051] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:07 2022] PUT /identity/v3/projects/4397a7273cdc4eea9ca4e5ccf78e1fd5/users/faba9e38cf584ddb96b535c95449813a/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:07.196103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dee233-4e12-46d2-94e6-977bcc0dc2d3 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:07.310216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3f108-1fbe-4db8-9482-a42e9d9ec171 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:07.375631 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dee233-4e12-46d2-94e6-977bcc0dc2d3 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:07.381705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332311e8-b8d3-44b3-9e18-ab43aa1f53d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:07.382684 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332311e8-b8d3-44b3-9e18-ab43aa1f53d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:07.383155 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332311e8-b8d3-44b3-9e18-ab43aa1f53d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:07.383547 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332311e8-b8d3-44b3-9e18-ab43aa1f53d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:07.384499 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332311e8-b8d3-44b3-9e18-ab43aa1f53d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:07.386837 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332311e8-b8d3-44b3-9e18-ab43aa1f53d4 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:07.404267 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1041/2052] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:41:07.408814 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332311e8-b8d3-44b3-9e18-ab43aa1f53d4 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:07.415188 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f5199-ea4c-4ff1-85c9-99998bd0fbab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:07.415188 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f5199-ea4c-4ff1-85c9-99998bd0fbab service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:07.416140 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f5199-ea4c-4ff1-85c9-99998bd0fbab service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:07.416350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f5199-ea4c-4ff1-85c9-99998bd0fbab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:07.428304 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332311e8-b8d3-44b3-9e18-ab43aa1f53d4 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:07.436939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee10ed-bef9-4e19-bb72-6b5fbfff2824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:07.438075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee10ed-bef9-4e19-bb72-6b5fbfff2824 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:07.438564 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee10ed-bef9-4e19-bb72-6b5fbfff2824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:07.439061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee10ed-bef9-4e19-bb72-6b5fbfff2824 admin admin] PATH_INFO: `/v3/projects/4397a7273cdc4eea9ca4e5ccf78e1fd5/users/faba9e38cf584ddb96b535c95449813a/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:07.442644 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee10ed-bef9-4e19-bb72-6b5fbfff2824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4397a7273cdc4eea9ca4e5ccf78e1fd5, user_id=faba9e38cf584ddb96b535c95449813a, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:07.449223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee10ed-bef9-4e19-bb72-6b5fbfff2824 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:07.489796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1042/2053] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:07 2022] PUT /identity/v3/projects/4397a7273cdc4eea9ca4e5ccf78e1fd5/users/faba9e38cf584ddb96b535c95449813a/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:41:07.495810 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c1fe4-eb40-408f-8483-35804f256974 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:07.496308 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c1fe4-eb40-408f-8483-35804f256974 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:07.496783 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c1fe4-eb40-408f-8483-35804f256974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:07.513958 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f5199-ea4c-4ff1-85c9-99998bd0fbab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:07.517436 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f5199-ea4c-4ff1-85c9-99998bd0fbab service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:07.536720 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1012/2054] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:41:07.538013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-447c1fe4-eb40-408f-8483-35804f256974 None None] MFA Rules not processed for user `faba9e38cf584ddb96b535c95449813a`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:07.539257 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-447c1fe4-eb40-408f-8483-35804f256974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:07.667676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1043/2055] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:07.755970 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f5199-ea4c-4ff1-85c9-99998bd0fbab service cinder] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:07.775609 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f5199-ea4c-4ff1-85c9-99998bd0fbab service cinder] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:07.910436 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:07.956798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205e561-c3d0-4c00-a4a3-883958bda55f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:07.960251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205e561-c3d0-4c00-a4a3-883958bda55f service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:07.960775 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205e561-c3d0-4c00-a4a3-883958bda55f service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:07.961273 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205e561-c3d0-4c00-a4a3-883958bda55f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:07.986069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c205e561-c3d0-4c00-a4a3-883958bda55f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:07.989476 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c205e561-c3d0-4c00-a4a3-883958bda55f service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:08.019929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1013/2056] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:08.301113 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c1fe4-eb40-408f-8483-35804f256974 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:08.323650 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c1fe4-eb40-408f-8483-35804f256974 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:08.334960 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842fd189-addf-4c02-8638-3a3551532ee5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:08.335814 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fd189-addf-4c02-8638-3a3551532ee5 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:08.337884 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fd189-addf-4c02-8638-3a3551532ee5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:08.347611 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fd189-addf-4c02-8638-3a3551532ee5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:08.354066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:08.522323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842fd189-addf-4c02-8638-3a3551532ee5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:08.524249 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842fd189-addf-4c02-8638-3a3551532ee5 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:08.545658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1044/2057] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:41:09.102367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205e561-c3d0-4c00-a4a3-883958bda55f service cinder] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:09.204912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842fd189-addf-4c02-8638-3a3551532ee5 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:09.218929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842fd189-addf-4c02-8638-3a3551532ee5 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:09.223658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7e438-c93f-49c2-905c-706e2e9dccee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:09.224392 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7e438-c93f-49c2-905c-706e2e9dccee service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:09.226292 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7e438-c93f-49c2-905c-706e2e9dccee service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:09.227359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7e438-c93f-49c2-905c-706e2e9dccee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:09.235704 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205e561-c3d0-4c00-a4a3-883958bda55f service cinder] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:09.243753 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2842f-3797-4b1a-8100-1a51ba04d25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:09.244687 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2842f-3797-4b1a-8100-1a51ba04d25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:09.245107 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2842f-3797-4b1a-8100-1a51ba04d25c admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:09.245544 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2842f-3797-4b1a-8100-1a51ba04d25c admin admin] PATH_INFO: `/v3/users/2d515e8272c345bd8aedf1c57b0e06b6` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:09.247161 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2842f-3797-4b1a-8100-1a51ba04d25c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d515e8272c345bd8aedf1c57b0e06b6)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:09.249646 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2842f-3797-4b1a-8100-1a51ba04d25c admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:09.335984 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7e438-c93f-49c2-905c-706e2e9dccee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:09.337555 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7e438-c93f-49c2-905c-706e2e9dccee service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:09.346466 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-25e2842f-3797-4b1a-8100-1a51ba04d25c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d515e8272c345bd8aedf1c57b0e06b6'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:09.351714 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1045/2058] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:09.362140 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-25e2842f-3797-4b1a-8100-1a51ba04d25c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d515e8272c345bd8aedf1c57b0e06b6'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:09.384653 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-25e2842f-3797-4b1a-8100-1a51ba04d25c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d515e8272c345bd8aedf1c57b0e06b6'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:09.385940 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-25e2842f-3797-4b1a-8100-1a51ba04d25c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d515e8272c345bd8aedf1c57b0e06b6'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:09.387191 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-25e2842f-3797-4b1a-8100-1a51ba04d25c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d515e8272c345bd8aedf1c57b0e06b6'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:09.441131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1014/2059] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:09 2022] DELETE /identity/v3/users/2d515e8272c345bd8aedf1c57b0e06b6 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:09.447342 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa53d0-2973-4884-b660-2fe160bea11a None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:09.447679 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa53d0-2973-4884-b660-2fe160bea11a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:09.448014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa53d0-2973-4884-b660-2fe160bea11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:09.505063 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-fdaa53d0-2973-4884-b660-2fe160bea11a None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:09.508073 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fdaa53d0-2973-4884-b660-2fe160bea11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:09.812564 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1046/2060] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:09.843159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2842f-3797-4b1a-8100-1a51ba04d25c admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:09.846952 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-25e2842f-3797-4b1a-8100-1a51ba04d25c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:10.126979 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2842f-3797-4b1a-8100-1a51ba04d25c admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:10.143412 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e875be-170f-483c-b563-8d51a991b24d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:10.148820 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e875be-170f-483c-b563-8d51a991b24d service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:10.151258 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e875be-170f-483c-b563-8d51a991b24d service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:10.152300 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e875be-170f-483c-b563-8d51a991b24d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:10.192811 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e875be-170f-483c-b563-8d51a991b24d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:10.211850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e875be-170f-483c-b563-8d51a991b24d service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:10.243251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1015/2061] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:10.934115 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa53d0-2973-4884-b660-2fe160bea11a None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:10.935729 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fdaa53d0-2973-4884-b660-2fe160bea11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:11.072809 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:11.111893 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa53d0-2973-4884-b660-2fe160bea11a None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:11.129285 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5c11d-8340-4571-bccf-0365abbae8cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:11.129942 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5c11d-8340-4571-bccf-0365abbae8cd service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:11.130262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5c11d-8340-4571-bccf-0365abbae8cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:11.133384 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5c11d-8340-4571-bccf-0365abbae8cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:11.140028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-7bb5c11d-8340-4571-bccf-0365abbae8cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:11.361227 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5c11d-8340-4571-bccf-0365abbae8cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:11.362663 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5c11d-8340-4571-bccf-0365abbae8cd service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:11.391724 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1047/2062] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:11.554640 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e875be-170f-483c-b563-8d51a991b24d service neutron] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:11.557330 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-60e875be-170f-483c-b563-8d51a991b24d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:11.592043 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:11.610391 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e875be-170f-483c-b563-8d51a991b24d service neutron] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:11.627728 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1b97e-a8c8-42f3-acbe-57a6ba492870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:11.628822 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1b97e-a8c8-42f3-acbe-57a6ba492870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:11.629647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1b97e-a8c8-42f3-acbe-57a6ba492870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:11.630423 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1b97e-a8c8-42f3-acbe-57a6ba492870 admin admin] PATH_INFO: `/v3/projects/85708e2f47d044c1b05af06b807caefd` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:11.634878 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1b97e-a8c8-42f3-acbe-57a6ba492870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85708e2f47d044c1b05af06b807caefd)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:11.643934 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1b97e-a8c8-42f3-acbe-57a6ba492870 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:11.778658 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-71d1b97e-a8c8-42f3-acbe-57a6ba492870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85708e2f47d044c1b05af06b807caefd', 'request_id': 'req-71d1b97e-a8c8-42f3-acbe-57a6ba492870'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:11.790382 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-71d1b97e-a8c8-42f3-acbe-57a6ba492870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85708e2f47d044c1b05af06b807caefd', 'request_id': 'req-71d1b97e-a8c8-42f3-acbe-57a6ba492870'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:11.798393 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-71d1b97e-a8c8-42f3-acbe-57a6ba492870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85708e2f47d044c1b05af06b807caefd', 'request_id': 'req-71d1b97e-a8c8-42f3-acbe-57a6ba492870'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:11.817351 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-71d1b97e-a8c8-42f3-acbe-57a6ba492870 admin admin] The token cache is being invalidate because project 85708e2f47d044c1b05af06b807caefd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:11.818101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-71d1b97e-a8c8-42f3-acbe-57a6ba492870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:11.820038 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-71d1b97e-a8c8-42f3-acbe-57a6ba492870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:11.822730 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1016/2063] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:11 2022] DELETE /identity/v3/projects/85708e2f47d044c1b05af06b807caefd => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:11.830944 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5c11d-8340-4571-bccf-0365abbae8cd service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:11.844109 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5c11d-8340-4571-bccf-0365abbae8cd service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:11.979836 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cc3aa-17c7-49fc-a8a5-93ce943821cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:11.980605 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cc3aa-17c7-49fc-a8a5-93ce943821cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:11.980881 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cc3aa-17c7-49fc-a8a5-93ce943821cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:11.981159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cc3aa-17c7-49fc-a8a5-93ce943821cd admin admin] PATH_INFO: `/v3/users/c9bce1d085c748759c40b84e2ae8b1f5` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:11.984464 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cc3aa-17c7-49fc-a8a5-93ce943821cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9bce1d085c748759c40b84e2ae8b1f5)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:11.987880 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cc3aa-17c7-49fc-a8a5-93ce943821cd admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:12.067312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-da0cc3aa-17c7-49fc-a8a5-93ce943821cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9bce1d085c748759c40b84e2ae8b1f5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:12.079716 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-da0cc3aa-17c7-49fc-a8a5-93ce943821cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9bce1d085c748759c40b84e2ae8b1f5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:12.093229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-da0cc3aa-17c7-49fc-a8a5-93ce943821cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9bce1d085c748759c40b84e2ae8b1f5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:12.094489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-da0cc3aa-17c7-49fc-a8a5-93ce943821cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9bce1d085c748759c40b84e2ae8b1f5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:12.096318 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-da0cc3aa-17c7-49fc-a8a5-93ce943821cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9bce1d085c748759c40b84e2ae8b1f5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:12.150029 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1048/2064] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:11 2022] DELETE /identity/v3/users/c9bce1d085c748759c40b84e2ae8b1f5 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:12.413937 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1b97e-a8c8-42f3-acbe-57a6ba492870 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:12.417658 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-71d1b97e-a8c8-42f3-acbe-57a6ba492870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:12.438932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1b97e-a8c8-42f3-acbe-57a6ba492870 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:12.613031 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32452f59-b81a-4911-99fe-6250eedd12b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:12.614309 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32452f59-b81a-4911-99fe-6250eedd12b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:12.615168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32452f59-b81a-4911-99fe-6250eedd12b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:12.615168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32452f59-b81a-4911-99fe-6250eedd12b5 admin admin] PATH_INFO: `/v3/users/a99dc01f3c4f4573a3be33fffc0b9a41` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:12.634109 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32452f59-b81a-4911-99fe-6250eedd12b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a99dc01f3c4f4573a3be33fffc0b9a41)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:12.637661 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32452f59-b81a-4911-99fe-6250eedd12b5 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:12.746263 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-32452f59-b81a-4911-99fe-6250eedd12b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a99dc01f3c4f4573a3be33fffc0b9a41'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:12.762858 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-32452f59-b81a-4911-99fe-6250eedd12b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a99dc01f3c4f4573a3be33fffc0b9a41'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:12.805400 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-32452f59-b81a-4911-99fe-6250eedd12b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a99dc01f3c4f4573a3be33fffc0b9a41'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:12.806348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-32452f59-b81a-4911-99fe-6250eedd12b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a99dc01f3c4f4573a3be33fffc0b9a41'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:12.807010 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-32452f59-b81a-4911-99fe-6250eedd12b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a99dc01f3c4f4573a3be33fffc0b9a41'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:12.855968 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1017/2065] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:12 2022] DELETE /identity/v3/users/a99dc01f3c4f4573a3be33fffc0b9a41 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:12.860980 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36b876-d47a-4b47-9648-8b0f1e5d46ac None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:12.861502 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36b876-d47a-4b47-9648-8b0f1e5d46ac None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:12.862169 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36b876-d47a-4b47-9648-8b0f1e5d46ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:12.872746 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32452f59-b81a-4911-99fe-6250eedd12b5 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:12.876959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-32452f59-b81a-4911-99fe-6250eedd12b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:12.914658 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:12.936382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ce36b876-d47a-4b47-9648-8b0f1e5d46ac None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:12.938349 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ce36b876-d47a-4b47-9648-8b0f1e5d46ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:12.966076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:13.088318 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1049/2066] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:41:13.102884 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36b876-d47a-4b47-9648-8b0f1e5d46ac None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:13.105975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ce36b876-d47a-4b47-9648-8b0f1e5d46ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:13.117432 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32452f59-b81a-4911-99fe-6250eedd12b5 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:13.136642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16e45b-dc1b-4f0b-8d5d-73bf44398165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:13.137941 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16e45b-dc1b-4f0b-8d5d-73bf44398165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:13.138448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16e45b-dc1b-4f0b-8d5d-73bf44398165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:13.138946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16e45b-dc1b-4f0b-8d5d-73bf44398165 admin admin] PATH_INFO: `/v3/projects/52321087ef644b38b8d2b11c478bd3c4` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:13.141472 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16e45b-dc1b-4f0b-8d5d-73bf44398165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52321087ef644b38b8d2b11c478bd3c4)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:13.145396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16e45b-dc1b-4f0b-8d5d-73bf44398165 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:13.379104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-be16e45b-dc1b-4f0b-8d5d-73bf44398165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52321087ef644b38b8d2b11c478bd3c4', 'request_id': 'req-be16e45b-dc1b-4f0b-8d5d-73bf44398165'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:13.391547 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36b876-d47a-4b47-9648-8b0f1e5d46ac None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:13.393156 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-be16e45b-dc1b-4f0b-8d5d-73bf44398165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52321087ef644b38b8d2b11c478bd3c4', 'request_id': 'req-be16e45b-dc1b-4f0b-8d5d-73bf44398165'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:13.437528 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-be16e45b-dc1b-4f0b-8d5d-73bf44398165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52321087ef644b38b8d2b11c478bd3c4', 'request_id': 'req-be16e45b-dc1b-4f0b-8d5d-73bf44398165'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:13.482096 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca58813-2981-4827-b3b7-505931ab96d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:13.483083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca58813-2981-4827-b3b7-505931ab96d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:13.483267 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca58813-2981-4827-b3b7-505931ab96d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:13.483549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca58813-2981-4827-b3b7-505931ab96d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:13.491720 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-be16e45b-dc1b-4f0b-8d5d-73bf44398165 admin admin] The token cache is being invalidate because project 52321087ef644b38b8d2b11c478bd3c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:13.492219 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-be16e45b-dc1b-4f0b-8d5d-73bf44398165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:13.502972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-be16e45b-dc1b-4f0b-8d5d-73bf44398165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:13.515598 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1018/2067] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:12 2022] DELETE /identity/v3/projects/52321087ef644b38b8d2b11c478bd3c4 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:13.518402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef6ed1-91b8-42a3-84af-2fdbec0f0184 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:13.519832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef6ed1-91b8-42a3-84af-2fdbec0f0184 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:13.519832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef6ed1-91b8-42a3-84af-2fdbec0f0184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:13.626350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-43ef6ed1-91b8-42a3-84af-2fdbec0f0184 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:13.630081 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-43ef6ed1-91b8-42a3-84af-2fdbec0f0184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:13.665898 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca58813-2981-4827-b3b7-505931ab96d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:13.674868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca58813-2981-4827-b3b7-505931ab96d0 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:13.692750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1050/2068] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:41:13.868030 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1019/2069] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:41:13.874198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f303d-d0a2-454c-9fe4-c08fb0b7995b None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:13.874607 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f303d-d0a2-454c-9fe4-c08fb0b7995b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:13.875022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f303d-d0a2-454c-9fe4-c08fb0b7995b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:13.908617 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-1f0f303d-d0a2-454c-9fe4-c08fb0b7995b None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:13.911020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1f0f303d-d0a2-454c-9fe4-c08fb0b7995b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:13.932692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1051/2070] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:13.937987 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef6ed1-91b8-42a3-84af-2fdbec0f0184 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:13.961443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef6ed1-91b8-42a3-84af-2fdbec0f0184 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:13.988952 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c4244-8b5b-4734-ac45-da1ad5cf0c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:13.991363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c4244-8b5b-4734-ac45-da1ad5cf0c04 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:13.991823 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c4244-8b5b-4734-ac45-da1ad5cf0c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:13.995296 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c4244-8b5b-4734-ac45-da1ad5cf0c04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:13.995296 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c4244-8b5b-4734-ac45-da1ad5cf0c04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:41:13.995898 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c4244-8b5b-4734-ac45-da1ad5cf0c04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:13.999410 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c4244-8b5b-4734-ac45-da1ad5cf0c04 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:14.041530 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1020/2071] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:41:14.047567 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f303d-d0a2-454c-9fe4-c08fb0b7995b None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:14.068844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f303d-d0a2-454c-9fe4-c08fb0b7995b None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:14.074956 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09c19e-a72e-4fb9-8663-8c3b976c7f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:14.075881 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09c19e-a72e-4fb9-8663-8c3b976c7f61 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:14.076294 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09c19e-a72e-4fb9-8663-8c3b976c7f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:14.076625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09c19e-a72e-4fb9-8663-8c3b976c7f61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:14.077340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09c19e-a72e-4fb9-8663-8c3b976c7f61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:14.081483 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09c19e-a72e-4fb9-8663-8c3b976c7f61 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:14.107803 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:14.143635 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1052/2072] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:14 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:41:14.148065 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c4244-8b5b-4734-ac45-da1ad5cf0c04 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:14.171589 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c4244-8b5b-4734-ac45-da1ad5cf0c04 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:14.228091 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:14.345947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484807dc-7b4d-4d1f-abbd-df4902efd81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:14.347085 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484807dc-7b4d-4d1f-abbd-df4902efd81a admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:14.347794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484807dc-7b4d-4d1f-abbd-df4902efd81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:14.348500 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484807dc-7b4d-4d1f-abbd-df4902efd81a admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:14.350247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484807dc-7b4d-4d1f-abbd-df4902efd81a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:14.353793 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484807dc-7b4d-4d1f-abbd-df4902efd81a admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:14.400352 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1021/2073] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:14 2022] POST /identity/v3/users => generated 294 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:41:14.405710 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09c19e-a72e-4fb9-8663-8c3b976c7f61 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:14.454855 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09c19e-a72e-4fb9-8663-8c3b976c7f61 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:14.477981 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623601e-bb6f-42bf-a755-e55bbffa420b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:14.478992 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623601e-bb6f-42bf-a755-e55bbffa420b admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:14.479465 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623601e-bb6f-42bf-a755-e55bbffa420b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:14.479921 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623601e-bb6f-42bf-a755-e55bbffa420b admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:14.480877 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623601e-bb6f-42bf-a755-e55bbffa420b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:14.482887 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623601e-bb6f-42bf-a755-e55bbffa420b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:14.508838 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1053/2074] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:14.516086 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484807dc-7b4d-4d1f-abbd-df4902efd81a admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:14.534386 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484807dc-7b4d-4d1f-abbd-df4902efd81a admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:14.557738 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a53f6-6cd3-4008-91bf-d7298f51ee81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:14.559191 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a53f6-6cd3-4008-91bf-d7298f51ee81 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:14.559986 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a53f6-6cd3-4008-91bf-d7298f51ee81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:14.560734 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a53f6-6cd3-4008-91bf-d7298f51ee81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:14.571284 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a53f6-6cd3-4008-91bf-d7298f51ee81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:14.573599 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a53f6-6cd3-4008-91bf-d7298f51ee81 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:14.680445 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1022/2075] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:14.681599 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623601e-bb6f-42bf-a755-e55bbffa420b admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:14.701650 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623601e-bb6f-42bf-a755-e55bbffa420b admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:14.714086 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a53f6-6cd3-4008-91bf-d7298f51ee81 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:14.719069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-522a53f6-6cd3-4008-91bf-d7298f51ee81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:14.720507 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457abd33-617d-47c7-8f98-59944416fcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:14.721187 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457abd33-617d-47c7-8f98-59944416fcea admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:14.721467 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457abd33-617d-47c7-8f98-59944416fcea admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:14.721746 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457abd33-617d-47c7-8f98-59944416fcea admin admin] PATH_INFO: `/v3/projects/5aa9da9c4bf045dbbf68173e7a754c95/users/f8424378821142979ec55e208ac2c3d5/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:14.761481 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457abd33-617d-47c7-8f98-59944416fcea admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aa9da9c4bf045dbbf68173e7a754c95, user_id=f8424378821142979ec55e208ac2c3d5, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:14.764784 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457abd33-617d-47c7-8f98-59944416fcea admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:14.773364 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a53f6-6cd3-4008-91bf-d7298f51ee81 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:14.785981 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1054/2076] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:14 2022] PUT /identity/v3/projects/5aa9da9c4bf045dbbf68173e7a754c95/users/f8424378821142979ec55e208ac2c3d5/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:14.797490 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944b2d8-ca6e-4b85-94eb-b7c5406b83ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:14.799269 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944b2d8-ca6e-4b85-94eb-b7c5406b83ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:14.799559 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944b2d8-ca6e-4b85-94eb-b7c5406b83ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:14.799838 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944b2d8-ca6e-4b85-94eb-b7c5406b83ca admin admin] PATH_INFO: `/v3/projects/30efa630396449289bb0fae867ccd5f3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:14.800317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c553b2-6d1e-4032-b7ad-579aaf07552a None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:14.800610 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c553b2-6d1e-4032-b7ad-579aaf07552a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:14.800916 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c553b2-6d1e-4032-b7ad-579aaf07552a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:14.801888 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944b2d8-ca6e-4b85-94eb-b7c5406b83ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=30efa630396449289bb0fae867ccd5f3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:14.804693 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944b2d8-ca6e-4b85-94eb-b7c5406b83ca admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:14.863663 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-c7c553b2-6d1e-4032-b7ad-579aaf07552a None None] MFA Rules not processed for user `f8424378821142979ec55e208ac2c3d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:14.867264 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c7c553b2-6d1e-4032-b7ad-579aaf07552a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:14.879207 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-5944b2d8-ca6e-4b85-94eb-b7c5406b83ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30efa630396449289bb0fae867ccd5f3', 'request_id': 'req-5944b2d8-ca6e-4b85-94eb-b7c5406b83ca'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:14.899968 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-5944b2d8-ca6e-4b85-94eb-b7c5406b83ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30efa630396449289bb0fae867ccd5f3', 'request_id': 'req-5944b2d8-ca6e-4b85-94eb-b7c5406b83ca'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:14.912090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-5944b2d8-ca6e-4b85-94eb-b7c5406b83ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30efa630396449289bb0fae867ccd5f3', 'request_id': 'req-5944b2d8-ca6e-4b85-94eb-b7c5406b83ca'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:14.945629 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-5944b2d8-ca6e-4b85-94eb-b7c5406b83ca admin admin] The token cache is being invalidate because project 30efa630396449289bb0fae867ccd5f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:14.946316 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-5944b2d8-ca6e-4b85-94eb-b7c5406b83ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:14.948616 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-5944b2d8-ca6e-4b85-94eb-b7c5406b83ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:14.952219 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1023/2077] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:14 2022] DELETE /identity/v3/projects/30efa630396449289bb0fae867ccd5f3 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:14.958063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944b2d8-ca6e-4b85-94eb-b7c5406b83ca admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:14.961039 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-5944b2d8-ca6e-4b85-94eb-b7c5406b83ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:15.044864 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1055/2078] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:41:15.053570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c553b2-6d1e-4032-b7ad-579aaf07552a None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:15.056661 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c7c553b2-6d1e-4032-b7ad-579aaf07552a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:15.114208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944b2d8-ca6e-4b85-94eb-b7c5406b83ca admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:15.125506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f4764-39cd-4d3a-a23d-03bb3208b0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:15.126854 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f4764-39cd-4d3a-a23d-03bb3208b0a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:15.127391 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f4764-39cd-4d3a-a23d-03bb3208b0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:15.127972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f4764-39cd-4d3a-a23d-03bb3208b0a6 admin admin] PATH_INFO: `/v3/users/faba9e38cf584ddb96b535c95449813a` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:15.131294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f4764-39cd-4d3a-a23d-03bb3208b0a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faba9e38cf584ddb96b535c95449813a)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:15.135351 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f4764-39cd-4d3a-a23d-03bb3208b0a6 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:15.221969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:15.250354 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c553b2-6d1e-4032-b7ad-579aaf07552a None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:15.263827 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245be9a-365d-4952-8918-40d826f24608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:15.265044 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245be9a-365d-4952-8918-40d826f24608 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:15.265948 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245be9a-365d-4952-8918-40d826f24608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:15.266435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245be9a-365d-4952-8918-40d826f24608 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:15.268011 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245be9a-365d-4952-8918-40d826f24608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:15.272916 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245be9a-365d-4952-8918-40d826f24608 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:15.297152 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-943f4764-39cd-4d3a-a23d-03bb3208b0a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faba9e38cf584ddb96b535c95449813a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:15.308288 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-943f4764-39cd-4d3a-a23d-03bb3208b0a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faba9e38cf584ddb96b535c95449813a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:15.333232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1056/2079] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:15 2022] POST /identity/v3/projects => generated 387 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:15.335779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245be9a-365d-4952-8918-40d826f24608 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:15.338862 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0245be9a-365d-4952-8918-40d826f24608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:15.339997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-943f4764-39cd-4d3a-a23d-03bb3208b0a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faba9e38cf584ddb96b535c95449813a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:15.341814 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-943f4764-39cd-4d3a-a23d-03bb3208b0a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faba9e38cf584ddb96b535c95449813a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:15.342855 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-943f4764-39cd-4d3a-a23d-03bb3208b0a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faba9e38cf584ddb96b535c95449813a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:15.370294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1024/2080] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:14 2022] DELETE /identity/v3/users/faba9e38cf584ddb96b535c95449813a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:15.374821 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f4764-39cd-4d3a-a23d-03bb3208b0a6 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:15.377192 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-943f4764-39cd-4d3a-a23d-03bb3208b0a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:15.443036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:15.536731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f4764-39cd-4d3a-a23d-03bb3208b0a6 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:15.542264 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d1dc1-c7f9-4a32-9030-22e396bd7195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:15.542902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d1dc1-c7f9-4a32-9030-22e396bd7195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:15.543180 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d1dc1-c7f9-4a32-9030-22e396bd7195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:15.543456 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d1dc1-c7f9-4a32-9030-22e396bd7195 admin admin] PATH_INFO: `/v3/users/879820719cb244f28f29b76947334112` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:15.545287 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d1dc1-c7f9-4a32-9030-22e396bd7195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=879820719cb244f28f29b76947334112)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:15.547860 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d1dc1-c7f9-4a32-9030-22e396bd7195 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:15.571277 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245be9a-365d-4952-8918-40d826f24608 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:15.599250 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ae0d1-114e-4f42-b452-a2bcb8525546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:15.601129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ae0d1-114e-4f42-b452-a2bcb8525546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:15.601647 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ae0d1-114e-4f42-b452-a2bcb8525546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:15.602221 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ae0d1-114e-4f42-b452-a2bcb8525546 admin admin] PATH_INFO: `/v3/users/831bae320a7448b3b3e59aba2c5e47b8` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:15.605762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ae0d1-114e-4f42-b452-a2bcb8525546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=831bae320a7448b3b3e59aba2c5e47b8)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:15.611331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ae0d1-114e-4f42-b452-a2bcb8525546 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:15.636575 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-045d1dc1-c7f9-4a32-9030-22e396bd7195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '879820719cb244f28f29b76947334112'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:15.646035 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-045d1dc1-c7f9-4a32-9030-22e396bd7195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '879820719cb244f28f29b76947334112'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:15.665485 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-045d1dc1-c7f9-4a32-9030-22e396bd7195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '879820719cb244f28f29b76947334112'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:15.666417 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-045d1dc1-c7f9-4a32-9030-22e396bd7195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '879820719cb244f28f29b76947334112'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:15.667062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-045d1dc1-c7f9-4a32-9030-22e396bd7195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '879820719cb244f28f29b76947334112'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:15.699599 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1025/2081] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:15 2022] DELETE /identity/v3/users/879820719cb244f28f29b76947334112 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:15.700626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d1dc1-c7f9-4a32-9030-22e396bd7195 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:15.732687 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-045d1dc1-c7f9-4a32-9030-22e396bd7195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:15.742341 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-692ae0d1-114e-4f42-b452-a2bcb8525546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '831bae320a7448b3b3e59aba2c5e47b8'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:15.752035 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-692ae0d1-114e-4f42-b452-a2bcb8525546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '831bae320a7448b3b3e59aba2c5e47b8'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:15.766951 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-692ae0d1-114e-4f42-b452-a2bcb8525546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '831bae320a7448b3b3e59aba2c5e47b8'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:15.767835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-692ae0d1-114e-4f42-b452-a2bcb8525546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '831bae320a7448b3b3e59aba2c5e47b8'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:15.768755 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-692ae0d1-114e-4f42-b452-a2bcb8525546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '831bae320a7448b3b3e59aba2c5e47b8'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:15.798709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:15.806816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1057/2082] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:15 2022] DELETE /identity/v3/users/831bae320a7448b3b3e59aba2c5e47b8 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:15.816966 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b89c96-0636-4f2f-9820-1d110093673c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:15.818460 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b89c96-0636-4f2f-9820-1d110093673c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:15.819498 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b89c96-0636-4f2f-9820-1d110093673c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:15.867021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-35b89c96-0636-4f2f-9820-1d110093673c None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:15.868616 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-35b89c96-0636-4f2f-9820-1d110093673c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:15.915058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d1dc1-c7f9-4a32-9030-22e396bd7195 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:15.956902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1058/2083] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:15.983430 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b89c96-0636-4f2f-9820-1d110093673c None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:15.986151 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-35b89c96-0636-4f2f-9820-1d110093673c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:16.074073 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b89c96-0636-4f2f-9820-1d110093673c None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:16.092230 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552e8ad-b5db-4f48-9c5e-5cf589b68743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:16.092897 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552e8ad-b5db-4f48-9c5e-5cf589b68743 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:16.093205 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552e8ad-b5db-4f48-9c5e-5cf589b68743 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:16.093451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552e8ad-b5db-4f48-9c5e-5cf589b68743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:16.096783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ce41f-9508-439b-b6ba-63720fb26d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:16.097902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ce41f-9508-439b-b6ba-63720fb26d38 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:16.098547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ce41f-9508-439b-b6ba-63720fb26d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:16.099066 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ce41f-9508-439b-b6ba-63720fb26d38 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:16.108936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:16.116451 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ce41f-9508-439b-b6ba-63720fb26d38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:16.121113 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552e8ad-b5db-4f48-9c5e-5cf589b68743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:16.125135 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552e8ad-b5db-4f48-9c5e-5cf589b68743 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:16.125570 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ce41f-9508-439b-b6ba-63720fb26d38 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:16.154915 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1059/2084] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:41:16.170890 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552e8ad-b5db-4f48-9c5e-5cf589b68743 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:16.176037 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4552e8ad-b5db-4f48-9c5e-5cf589b68743 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:16.183404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1026/2085] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:15 2022] POST /identity/v3/users => generated 300 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:16.188979 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ce41f-9508-439b-b6ba-63720fb26d38 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:16.205301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-401ce41f-9508-439b-b6ba-63720fb26d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:16.219189 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552e8ad-b5db-4f48-9c5e-5cf589b68743 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:16.226090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ce41f-9508-439b-b6ba-63720fb26d38 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:16.234796 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179f9d7-4789-4e43-bfac-d1bab5a2f9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:16.236027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179f9d7-4789-4e43-bfac-d1bab5a2f9bc admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:16.236592 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179f9d7-4789-4e43-bfac-d1bab5a2f9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:16.237106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179f9d7-4789-4e43-bfac-d1bab5a2f9bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:16.238103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179f9d7-4789-4e43-bfac-d1bab5a2f9bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:16.238306 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bed532-356f-4dc6-a8a2-85ab782b9344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:16.240918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bed532-356f-4dc6-a8a2-85ab782b9344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:16.242225 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bed532-356f-4dc6-a8a2-85ab782b9344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:16.242507 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bed532-356f-4dc6-a8a2-85ab782b9344 admin admin] PATH_INFO: `/v3/projects/4397a7273cdc4eea9ca4e5ccf78e1fd5` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:16.244738 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179f9d7-4789-4e43-bfac-d1bab5a2f9bc admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:16.246496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bed532-356f-4dc6-a8a2-85ab782b9344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4397a7273cdc4eea9ca4e5ccf78e1fd5)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:16.250955 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bed532-356f-4dc6-a8a2-85ab782b9344 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:16.287461 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1027/2086] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:16.292821 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179f9d7-4789-4e43-bfac-d1bab5a2f9bc admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:16.333732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179f9d7-4789-4e43-bfac-d1bab5a2f9bc admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:16.354929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05626af-15f8-4246-b2db-eaf89303d346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:16.358647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05626af-15f8-4246-b2db-eaf89303d346 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:16.358647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05626af-15f8-4246-b2db-eaf89303d346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:16.359256 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05626af-15f8-4246-b2db-eaf89303d346 admin admin] PATH_INFO: `/v3/projects/ae59987cfebe49c89e961a8105dc1cbc/users/abe2f0f542f344ad82e55f4e62b54894/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:16.478254 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05626af-15f8-4246-b2db-eaf89303d346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae59987cfebe49c89e961a8105dc1cbc, user_id=abe2f0f542f344ad82e55f4e62b54894, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:16.479484 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e3bed532-356f-4dc6-a8a2-85ab782b9344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4397a7273cdc4eea9ca4e5ccf78e1fd5', 'request_id': 'req-e3bed532-356f-4dc6-a8a2-85ab782b9344'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:16.487046 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05626af-15f8-4246-b2db-eaf89303d346 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:16.494883 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e3bed532-356f-4dc6-a8a2-85ab782b9344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4397a7273cdc4eea9ca4e5ccf78e1fd5', 'request_id': 'req-e3bed532-356f-4dc6-a8a2-85ab782b9344'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:16.509189 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e3bed532-356f-4dc6-a8a2-85ab782b9344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4397a7273cdc4eea9ca4e5ccf78e1fd5', 'request_id': 'req-e3bed532-356f-4dc6-a8a2-85ab782b9344'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:16.526928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1028/2087] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:16 2022] PUT /identity/v3/projects/ae59987cfebe49c89e961a8105dc1cbc/users/abe2f0f542f344ad82e55f4e62b54894/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:16.530897 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05626af-15f8-4246-b2db-eaf89303d346 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:16.539189 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a05626af-15f8-4246-b2db-eaf89303d346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:16.542358 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e3bed532-356f-4dc6-a8a2-85ab782b9344 admin admin] The token cache is being invalidate because project 4397a7273cdc4eea9ca4e5ccf78e1fd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:16.543083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e3bed532-356f-4dc6-a8a2-85ab782b9344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:16.544334 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e3bed532-356f-4dc6-a8a2-85ab782b9344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:16.554782 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1060/2088] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:16 2022] DELETE /identity/v3/projects/4397a7273cdc4eea9ca4e5ccf78e1fd5 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:16.554782 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bed532-356f-4dc6-a8a2-85ab782b9344 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:16.558462 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e3bed532-356f-4dc6-a8a2-85ab782b9344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:16.701393 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05626af-15f8-4246-b2db-eaf89303d346 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:16.706746 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cdb15-9f91-4e61-bdb0-568204408683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:16.707172 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cdb15-9f91-4e61-bdb0-568204408683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:16.707452 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cdb15-9f91-4e61-bdb0-568204408683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:16.707813 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cdb15-9f91-4e61-bdb0-568204408683 admin admin] PATH_INFO: `/v3/users/415263c287524e97ba3bf95169bc1c3f` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:16.709229 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cdb15-9f91-4e61-bdb0-568204408683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=415263c287524e97ba3bf95169bc1c3f)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:16.711171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cdb15-9f91-4e61-bdb0-568204408683 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:16.715538 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bed532-356f-4dc6-a8a2-85ab782b9344 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:16.721672 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8a217-32d3-4db7-9edc-2f667a650d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:16.722294 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8a217-32d3-4db7-9edc-2f667a650d08 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:16.722750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8a217-32d3-4db7-9edc-2f667a650d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:16.722864 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8a217-32d3-4db7-9edc-2f667a650d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:16.723892 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8a217-32d3-4db7-9edc-2f667a650d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:16.725468 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8a217-32d3-4db7-9edc-2f667a650d08 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:16.738112 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1061/2089] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:16.739762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ba8de-3f91-4ae9-bd12-c2fedd9f6bf5 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:16.740052 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ba8de-3f91-4ae9-bd12-c2fedd9f6bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:16.740363 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ba8de-3f91-4ae9-bd12-c2fedd9f6bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:16.760069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:16.764440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d13ba8de-3f91-4ae9-bd12-c2fedd9f6bf5 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:16.766494 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d13ba8de-3f91-4ae9-bd12-c2fedd9f6bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:16.776547 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1062/2090] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:16.777939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ba8de-3f91-4ae9-bd12-c2fedd9f6bf5 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:16.779332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d13ba8de-3f91-4ae9-bd12-c2fedd9f6bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:16.789647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-bb9cdb15-9f91-4e61-bdb0-568204408683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '415263c287524e97ba3bf95169bc1c3f'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:16.793354 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ba8de-3f91-4ae9-bd12-c2fedd9f6bf5 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:16.797483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-bb9cdb15-9f91-4e61-bdb0-568204408683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '415263c287524e97ba3bf95169bc1c3f'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:16.798478 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7970377-365a-4a2e-a433-55b45e42d32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:16.799113 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7970377-365a-4a2e-a433-55b45e42d32c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:16.799393 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7970377-365a-4a2e-a433-55b45e42d32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:16.799663 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7970377-365a-4a2e-a433-55b45e42d32c admin admin] PATH_INFO: `/v3/projects/ae6471c69766417ca3225d1bf5d391d7` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:16.800812 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7970377-365a-4a2e-a433-55b45e42d32c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae6471c69766417ca3225d1bf5d391d7)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:16.802726 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7970377-365a-4a2e-a433-55b45e42d32c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:16.813645 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-bb9cdb15-9f91-4e61-bdb0-568204408683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '415263c287524e97ba3bf95169bc1c3f'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:16.814450 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-bb9cdb15-9f91-4e61-bdb0-568204408683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '415263c287524e97ba3bf95169bc1c3f'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:16.815266 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-bb9cdb15-9f91-4e61-bdb0-568204408683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '415263c287524e97ba3bf95169bc1c3f'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:16.833703 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1029/2091] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:16 2022] DELETE /identity/v3/users/415263c287524e97ba3bf95169bc1c3f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:16.834777 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cdb15-9f91-4e61-bdb0-568204408683 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:16.836165 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-bb9cdb15-9f91-4e61-bdb0-568204408683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:16.874139 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d7970377-365a-4a2e-a433-55b45e42d32c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae6471c69766417ca3225d1bf5d391d7', 'request_id': 'req-d7970377-365a-4a2e-a433-55b45e42d32c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:16.883615 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d7970377-365a-4a2e-a433-55b45e42d32c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae6471c69766417ca3225d1bf5d391d7', 'request_id': 'req-d7970377-365a-4a2e-a433-55b45e42d32c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:16.891653 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:16.893327 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d7970377-365a-4a2e-a433-55b45e42d32c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae6471c69766417ca3225d1bf5d391d7', 'request_id': 'req-d7970377-365a-4a2e-a433-55b45e42d32c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:16.908865 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d7970377-365a-4a2e-a433-55b45e42d32c admin admin] The token cache is being invalidate because project ae6471c69766417ca3225d1bf5d391d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:16.909638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d7970377-365a-4a2e-a433-55b45e42d32c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:16.910322 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d7970377-365a-4a2e-a433-55b45e42d32c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:16.911844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1063/2092] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:16 2022] DELETE /identity/v3/projects/ae6471c69766417ca3225d1bf5d391d7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:16.914928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7970377-365a-4a2e-a433-55b45e42d32c admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:16.914928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d7970377-365a-4a2e-a433-55b45e42d32c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:16.927266 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cdb15-9f91-4e61-bdb0-568204408683 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:17.000515 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbce238-916f-449e-92c2-0a78d180139e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:17.001839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbce238-916f-449e-92c2-0a78d180139e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:17.002358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbce238-916f-449e-92c2-0a78d180139e admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:17.002843 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbce238-916f-449e-92c2-0a78d180139e admin admin] PATH_INFO: `/v3/projects/39069d6483c340759f651cfd94cdf8f0` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:17.004963 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbce238-916f-449e-92c2-0a78d180139e admin admin] RBAC: Authorizing `identity:delete_project(project_id=39069d6483c340759f651cfd94cdf8f0)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:17.006560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7970377-365a-4a2e-a433-55b45e42d32c admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:17.008845 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbce238-916f-449e-92c2-0a78d180139e admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:17.014873 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6401f-0033-4bd7-bb87-9cd62e1b9acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:17.016027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6401f-0033-4bd7-bb87-9cd62e1b9acb admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:17.016572 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6401f-0033-4bd7-bb87-9cd62e1b9acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:17.017073 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6401f-0033-4bd7-bb87-9cd62e1b9acb admin admin] PATH_INFO: `/v3/projects/ae59987cfebe49c89e961a8105dc1cbc/users/abe2f0f542f344ad82e55f4e62b54894/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:17.020578 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6401f-0033-4bd7-bb87-9cd62e1b9acb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae59987cfebe49c89e961a8105dc1cbc, user_id=abe2f0f542f344ad82e55f4e62b54894, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:17.026096 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6401f-0033-4bd7-bb87-9cd62e1b9acb admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:17.047777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1064/2093] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:16 2022] PUT /identity/v3/projects/ae59987cfebe49c89e961a8105dc1cbc/users/abe2f0f542f344ad82e55f4e62b54894/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:17.057714 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bb070-6a1e-4a80-8bfe-adcca5461a37 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:17.058295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bb070-6a1e-4a80-8bfe-adcca5461a37 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:17.058973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bb070-6a1e-4a80-8bfe-adcca5461a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:17.085084 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-1b2bb070-6a1e-4a80-8bfe-adcca5461a37 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:17.086272 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1b2bb070-6a1e-4a80-8bfe-adcca5461a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:17.102450 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6cbce238-916f-449e-92c2-0a78d180139e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39069d6483c340759f651cfd94cdf8f0', 'request_id': 'req-6cbce238-916f-449e-92c2-0a78d180139e'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:17.107930 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:17.117951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6cbce238-916f-449e-92c2-0a78d180139e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39069d6483c340759f651cfd94cdf8f0', 'request_id': 'req-6cbce238-916f-449e-92c2-0a78d180139e'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:17.132383 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6cbce238-916f-449e-92c2-0a78d180139e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39069d6483c340759f651cfd94cdf8f0', 'request_id': 'req-6cbce238-916f-449e-92c2-0a78d180139e'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:17.152733 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6cbce238-916f-449e-92c2-0a78d180139e admin admin] The token cache is being invalidate because project 39069d6483c340759f651cfd94cdf8f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:17.152894 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6cbce238-916f-449e-92c2-0a78d180139e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:17.153510 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6cbce238-916f-449e-92c2-0a78d180139e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:17.155475 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1030/2094] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:16 2022] DELETE /identity/v3/projects/39069d6483c340759f651cfd94cdf8f0 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:17.156954 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99870e89-3b83-49c2-b557-f0064d6e15de None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:17.157345 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99870e89-3b83-49c2-b557-f0064d6e15de None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:17.157700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99870e89-3b83-49c2-b557-f0064d6e15de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:17.188067 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1065/2095] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:17.188067 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2bb070-6a1e-4a80-8bfe-adcca5461a37 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:17.188067 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1b2bb070-6a1e-4a80-8bfe-adcca5461a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:17.197148 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-99870e89-3b83-49c2-b557-f0064d6e15de None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:17.198403 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-99870e89-3b83-49c2-b557-f0064d6e15de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:17.207877 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2bb070-6a1e-4a80-8bfe-adcca5461a37 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:17.214783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1031/2096] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:17.215986 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b84f3-fd04-4735-9f17-dd317f0bd34c None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:17.216442 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b84f3-fd04-4735-9f17-dd317f0bd34c None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:17.216715 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b84f3-fd04-4735-9f17-dd317f0bd34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:17.230347 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae3df2-2d7c-488a-bf16-5d7c97ec6cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:17.231279 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae3df2-2d7c-488a-bf16-5d7c97ec6cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:17.231736 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae3df2-2d7c-488a-bf16-5d7c97ec6cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:17.232224 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae3df2-2d7c-488a-bf16-5d7c97ec6cb2 admin admin] PATH_INFO: `/v3/users/273bfd880d324545a8662873e5233d7f` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:17.234289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae3df2-2d7c-488a-bf16-5d7c97ec6cb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=273bfd880d324545a8662873e5233d7f)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:17.238543 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae3df2-2d7c-488a-bf16-5d7c97ec6cb2 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:17.251701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-ff7b84f3-fd04-4735-9f17-dd317f0bd34c None None] MFA Rules not processed for user `abe2f0f542f344ad82e55f4e62b54894`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:17.253824 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-ff7b84f3-fd04-4735-9f17-dd317f0bd34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:17.307411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e3ae3df2-2d7c-488a-bf16-5d7c97ec6cb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '273bfd880d324545a8662873e5233d7f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:17.316010 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e3ae3df2-2d7c-488a-bf16-5d7c97ec6cb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '273bfd880d324545a8662873e5233d7f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:17.327612 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e3ae3df2-2d7c-488a-bf16-5d7c97ec6cb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '273bfd880d324545a8662873e5233d7f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:17.328774 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e3ae3df2-2d7c-488a-bf16-5d7c97ec6cb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '273bfd880d324545a8662873e5233d7f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:17.329823 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e3ae3df2-2d7c-488a-bf16-5d7c97ec6cb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '273bfd880d324545a8662873e5233d7f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:17.347245 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:17.353911 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1032/2097] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:17 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:17.355689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47626fc2-36b4-4847-b98a-e576ca7f4e6a None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:17.356210 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47626fc2-36b4-4847-b98a-e576ca7f4e6a None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:17.356664 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47626fc2-36b4-4847-b98a-e576ca7f4e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:17.357074 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1066/2098] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:17 2022] DELETE /identity/v3/users/273bfd880d324545a8662873e5233d7f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:17.361988 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae3df2-2d7c-488a-bf16-5d7c97ec6cb2 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:17.364291 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e3ae3df2-2d7c-488a-bf16-5d7c97ec6cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:17.399869 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-47626fc2-36b4-4847-b98a-e576ca7f4e6a None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:17.402206 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-47626fc2-36b4-4847-b98a-e576ca7f4e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:17.535901 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae3df2-2d7c-488a-bf16-5d7c97ec6cb2 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:17.540799 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1033/2099] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:17.542320 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47626fc2-36b4-4847-b98a-e576ca7f4e6a None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:17.544168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-47626fc2-36b4-4847-b98a-e576ca7f4e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:17.556254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec72a9e-88d1-498f-86cd-dcbbc3a05a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:17.557962 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec72a9e-88d1-498f-86cd-dcbbc3a05a05 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:17.558332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec72a9e-88d1-498f-86cd-dcbbc3a05a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:17.558622 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec72a9e-88d1-498f-86cd-dcbbc3a05a05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:17.559318 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec72a9e-88d1-498f-86cd-dcbbc3a05a05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:41:17.559784 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec72a9e-88d1-498f-86cd-dcbbc3a05a05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:17.562266 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec72a9e-88d1-498f-86cd-dcbbc3a05a05 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:17.581474 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1067/2100] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:41:17.583044 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec72a9e-88d1-498f-86cd-dcbbc3a05a05 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:17.585680 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0ec72a9e-88d1-498f-86cd-dcbbc3a05a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:17.709032 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec72a9e-88d1-498f-86cd-dcbbc3a05a05 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:17.710294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47626fc2-36b4-4847-b98a-e576ca7f4e6a None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:17.719530 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304a1d3-9080-4ded-b72e-72a631d3051e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:17.720557 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304a1d3-9080-4ded-b72e-72a631d3051e service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:17.720843 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304a1d3-9080-4ded-b72e-72a631d3051e service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:17.721172 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304a1d3-9080-4ded-b72e-72a631d3051e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:17.732882 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-9304a1d3-9080-4ded-b72e-72a631d3051e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:17.733163 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81547848-debb-4951-aa84-089a468ac608 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:17.733163 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81547848-debb-4951-aa84-089a468ac608 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:17.733163 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81547848-debb-4951-aa84-089a468ac608 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:17.733163 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81547848-debb-4951-aa84-089a468ac608 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:17.739653 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304a1d3-9080-4ded-b72e-72a631d3051e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:17.741274 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304a1d3-9080-4ded-b72e-72a631d3051e service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:17.756761 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1034/2101] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:17.758166 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4212619-5b56-47c6-a676-d281ae1691a7 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:17.758451 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4212619-5b56-47c6-a676-d281ae1691a7 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:17.758728 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4212619-5b56-47c6-a676-d281ae1691a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:17.777348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:17.797966 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-d4212619-5b56-47c6-a676-d281ae1691a7 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:17.802070 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-d4212619-5b56-47c6-a676-d281ae1691a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:17.815095 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1035/2102] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:17.816276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4212619-5b56-47c6-a676-d281ae1691a7 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:17.833027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4212619-5b56-47c6-a676-d281ae1691a7 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:17.840578 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d456cc-1971-4272-8b29-59546280bfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:17.841298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d456cc-1971-4272-8b29-59546280bfa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:17.841627 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d456cc-1971-4272-8b29-59546280bfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:17.841956 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d456cc-1971-4272-8b29-59546280bfa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:17.842807 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d456cc-1971-4272-8b29-59546280bfa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:17.845438 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d456cc-1971-4272-8b29-59546280bfa3 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:17.851527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81547848-debb-4951-aa84-089a468ac608 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:17.854106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81547848-debb-4951-aa84-089a468ac608 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:17.874558 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1068/2103] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:17.876054 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81547848-debb-4951-aa84-089a468ac608 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:17.902623 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81547848-debb-4951-aa84-089a468ac608 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:17.914499 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1036/2104] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:17 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:17.919958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188027e4-c310-44c2-af89-0878bfd897f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:17.920257 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d456cc-1971-4272-8b29-59546280bfa3 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:17.920987 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188027e4-c310-44c2-af89-0878bfd897f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:17.924396 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188027e4-c310-44c2-af89-0878bfd897f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:17.924396 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188027e4-c310-44c2-af89-0878bfd897f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:17.925849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188027e4-c310-44c2-af89-0878bfd897f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:41:17.929217 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188027e4-c310-44c2-af89-0878bfd897f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:17.933056 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188027e4-c310-44c2-af89-0878bfd897f5 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:17.994817 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1069/2105] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:41:18.002648 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188027e4-c310-44c2-af89-0878bfd897f5 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:18.028716 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188027e4-c310-44c2-af89-0878bfd897f5 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:18.101160 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:18.123132 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d456cc-1971-4272-8b29-59546280bfa3 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:18.133166 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fb8d9-5bdc-4f3f-8604-371fcfe88675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:18.133772 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fb8d9-5bdc-4f3f-8604-371fcfe88675 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:18.134161 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fb8d9-5bdc-4f3f-8604-371fcfe88675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:18.134500 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fb8d9-5bdc-4f3f-8604-371fcfe88675 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:18.135072 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749fb8d9-5bdc-4f3f-8604-371fcfe88675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:18.137257 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749fb8d9-5bdc-4f3f-8604-371fcfe88675 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:18.182551 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a94df8-a78b-4466-96f7-825f5b40652a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:18.183477 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a94df8-a78b-4466-96f7-825f5b40652a admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:18.183666 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a94df8-a78b-4466-96f7-825f5b40652a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:18.183935 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a94df8-a78b-4466-96f7-825f5b40652a admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:18.184698 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a94df8-a78b-4466-96f7-825f5b40652a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:18.187584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a94df8-a78b-4466-96f7-825f5b40652a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:18.197176 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1037/2106] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:17 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:18.198130 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fb8d9-5bdc-4f3f-8604-371fcfe88675 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:18.201616 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-749fb8d9-5bdc-4f3f-8604-371fcfe88675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:18.227551 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fb8d9-5bdc-4f3f-8604-371fcfe88675 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:18.235617 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1070/2107] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:18 2022] POST /identity/v3/projects => generated 373 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:41:18.235617 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a94df8-a78b-4466-96f7-825f5b40652a admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:18.235617 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d9a94df8-a78b-4466-96f7-825f5b40652a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:18.244814 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b314a-70d9-48c6-a3e6-02e5c2ddfff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:18.249587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b314a-70d9-48c6-a3e6-02e5c2ddfff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:18.250950 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b314a-70d9-48c6-a3e6-02e5c2ddfff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:18.251570 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b314a-70d9-48c6-a3e6-02e5c2ddfff7 admin admin] PATH_INFO: `/v3/projects/f435bcfb34a44235ae4c8cc62f6c96cc` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:18.253832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b314a-70d9-48c6-a3e6-02e5c2ddfff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f435bcfb34a44235ae4c8cc62f6c96cc)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:18.256724 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b314a-70d9-48c6-a3e6-02e5c2ddfff7 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:18.347856 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-427b314a-70d9-48c6-a3e6-02e5c2ddfff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f435bcfb34a44235ae4c8cc62f6c96cc', 'request_id': 'req-427b314a-70d9-48c6-a3e6-02e5c2ddfff7'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:18.361808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a94df8-a78b-4466-96f7-825f5b40652a admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:18.365144 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-427b314a-70d9-48c6-a3e6-02e5c2ddfff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f435bcfb34a44235ae4c8cc62f6c96cc', 'request_id': 'req-427b314a-70d9-48c6-a3e6-02e5c2ddfff7'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:18.381723 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-427b314a-70d9-48c6-a3e6-02e5c2ddfff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f435bcfb34a44235ae4c8cc62f6c96cc', 'request_id': 'req-427b314a-70d9-48c6-a3e6-02e5c2ddfff7'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:18.417647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-427b314a-70d9-48c6-a3e6-02e5c2ddfff7 admin admin] The token cache is being invalidate because project f435bcfb34a44235ae4c8cc62f6c96cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:18.418283 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-427b314a-70d9-48c6-a3e6-02e5c2ddfff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:18.420390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-427b314a-70d9-48c6-a3e6-02e5c2ddfff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:18.423490 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1038/2108] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:18 2022] DELETE /identity/v3/projects/f435bcfb34a44235ae4c8cc62f6c96cc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:18.424928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b314a-70d9-48c6-a3e6-02e5c2ddfff7 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:18.426953 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-427b314a-70d9-48c6-a3e6-02e5c2ddfff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:18.498812 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875858a-b41d-4861-a197-d405ed5197f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:18.500845 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875858a-b41d-4861-a197-d405ed5197f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:18.501170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875858a-b41d-4861-a197-d405ed5197f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:18.501455 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875858a-b41d-4861-a197-d405ed5197f2 admin admin] PATH_INFO: `/v3/users/f8424378821142979ec55e208ac2c3d5` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:18.505490 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875858a-b41d-4861-a197-d405ed5197f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8424378821142979ec55e208ac2c3d5)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:18.510461 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875858a-b41d-4861-a197-d405ed5197f2 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:18.554985 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:18.588250 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b314a-70d9-48c6-a3e6-02e5c2ddfff7 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:18.599643 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c5920-2053-4873-9378-57d9039eace2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:18.600788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c5920-2053-4873-9378-57d9039eace2 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:18.601114 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2875858a-b41d-4861-a197-d405ed5197f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8424378821142979ec55e208ac2c3d5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:18.601236 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c5920-2053-4873-9378-57d9039eace2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:18.601661 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c5920-2053-4873-9378-57d9039eace2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:18.602898 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c5920-2053-4873-9378-57d9039eace2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:18.605691 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c5920-2053-4873-9378-57d9039eace2 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:18.617281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2875858a-b41d-4861-a197-d405ed5197f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8424378821142979ec55e208ac2c3d5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:18.623450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:18.628661 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1039/2109] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:18.630199 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c5920-2053-4873-9378-57d9039eace2 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:18.635287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2875858a-b41d-4861-a197-d405ed5197f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8424378821142979ec55e208ac2c3d5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:18.635518 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-1e5c5920-2053-4873-9378-57d9039eace2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:18.636729 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2875858a-b41d-4861-a197-d405ed5197f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8424378821142979ec55e208ac2c3d5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:18.638979 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2875858a-b41d-4861-a197-d405ed5197f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8424378821142979ec55e208ac2c3d5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:18.658151 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c5920-2053-4873-9378-57d9039eace2 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:18.666101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfa380-3f9d-4e50-a705-54c235fc6c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:18.667121 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfa380-3f9d-4e50-a705-54c235fc6c47 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:18.670732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfa380-3f9d-4e50-a705-54c235fc6c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:18.670732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfa380-3f9d-4e50-a705-54c235fc6c47 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:18.670732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfa380-3f9d-4e50-a705-54c235fc6c47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:18.672035 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfa380-3f9d-4e50-a705-54c235fc6c47 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:18.677602 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1071/2110] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:18 2022] DELETE /identity/v3/users/f8424378821142979ec55e208ac2c3d5 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:18.678999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7597e1c-0130-4c44-b61f-9b7b7bb2102d None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:18.679288 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7597e1c-0130-4c44-b61f-9b7b7bb2102d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:18.679699 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7597e1c-0130-4c44-b61f-9b7b7bb2102d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:18.708768 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-e7597e1c-0130-4c44-b61f-9b7b7bb2102d None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:18.711964 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e7597e1c-0130-4c44-b61f-9b7b7bb2102d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:18.717866 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1040/2111] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:18 2022] POST /identity/v3/users => generated 287 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:18.717866 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfa380-3f9d-4e50-a705-54c235fc6c47 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:18.720254 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-4adfa380-3f9d-4e50-a705-54c235fc6c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:18.739526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfa380-3f9d-4e50-a705-54c235fc6c47 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:18.855846 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1072/2112] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:18.858957 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7597e1c-0130-4c44-b61f-9b7b7bb2102d None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:18.862807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e7597e1c-0130-4c44-b61f-9b7b7bb2102d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:18.897183 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635d47a-a2ac-4062-85cf-8904182fe203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:18.898350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635d47a-a2ac-4062-85cf-8904182fe203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:18.898834 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635d47a-a2ac-4062-85cf-8904182fe203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:18.899325 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635d47a-a2ac-4062-85cf-8904182fe203 admin admin] PATH_INFO: `/v3/projects/855a0259cd86453ca24702268b6c5250` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:18.903873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635d47a-a2ac-4062-85cf-8904182fe203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=855a0259cd86453ca24702268b6c5250)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:18.908234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635d47a-a2ac-4062-85cf-8904182fe203 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:18.910844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7597e1c-0130-4c44-b61f-9b7b7bb2102d None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:18.920252 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e11e4-11be-4d4c-9107-684463a37dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:18.921283 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e11e4-11be-4d4c-9107-684463a37dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:18.921741 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e11e4-11be-4d4c-9107-684463a37dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:18.922337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e11e4-11be-4d4c-9107-684463a37dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:18.923550 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e11e4-11be-4d4c-9107-684463a37dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:18.925946 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e11e4-11be-4d4c-9107-684463a37dd2 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:18.950039 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1073/2113] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:18.950039 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c201c37-83e8-4f4f-8851-1bab369366bc None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:18.950039 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c201c37-83e8-4f4f-8851-1bab369366bc None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:18.950039 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c201c37-83e8-4f4f-8851-1bab369366bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:18.979832 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-2c201c37-83e8-4f4f-8851-1bab369366bc None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:18.985566 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2c201c37-83e8-4f4f-8851-1bab369366bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:19.012318 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e635d47a-a2ac-4062-85cf-8904182fe203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '855a0259cd86453ca24702268b6c5250', 'request_id': 'req-e635d47a-a2ac-4062-85cf-8904182fe203'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:19.025108 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e635d47a-a2ac-4062-85cf-8904182fe203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '855a0259cd86453ca24702268b6c5250', 'request_id': 'req-e635d47a-a2ac-4062-85cf-8904182fe203'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:19.035227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e635d47a-a2ac-4062-85cf-8904182fe203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '855a0259cd86453ca24702268b6c5250', 'request_id': 'req-e635d47a-a2ac-4062-85cf-8904182fe203'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:19.051348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e635d47a-a2ac-4062-85cf-8904182fe203 admin admin] The token cache is being invalidate because project 855a0259cd86453ca24702268b6c5250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:19.051348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e635d47a-a2ac-4062-85cf-8904182fe203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:19.052000 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e635d47a-a2ac-4062-85cf-8904182fe203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:19.054208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1041/2114] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:18 2022] DELETE /identity/v3/projects/855a0259cd86453ca24702268b6c5250 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:19.055106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635d47a-a2ac-4062-85cf-8904182fe203 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:19.056527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-e635d47a-a2ac-4062-85cf-8904182fe203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:19.097117 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1074/2115] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:19.098542 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6819a1-6d51-447b-9e9c-4cc56eb20cb9 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:19.098875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6819a1-6d51-447b-9e9c-4cc56eb20cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:19.099111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6819a1-6d51-447b-9e9c-4cc56eb20cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:19.121060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-4a6819a1-6d51-447b-9e9c-4cc56eb20cb9 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:19.122178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4a6819a1-6d51-447b-9e9c-4cc56eb20cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:19.132925 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1075/2116] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:19.134572 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6819a1-6d51-447b-9e9c-4cc56eb20cb9 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:19.136891 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:19.138506 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4a6819a1-6d51-447b-9e9c-4cc56eb20cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:19.146009 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635d47a-a2ac-4062-85cf-8904182fe203 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:19.154490 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6819a1-6d51-447b-9e9c-4cc56eb20cb9 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:19.155310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db7ce8-99d9-40bb-8841-118b47dcd7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:19.156406 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db7ce8-99d9-40bb-8841-118b47dcd7ba admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:19.156868 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db7ce8-99d9-40bb-8841-118b47dcd7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:19.157361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db7ce8-99d9-40bb-8841-118b47dcd7ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:19.158477 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db7ce8-99d9-40bb-8841-118b47dcd7ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:19.161674 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db7ce8-99d9-40bb-8841-118b47dcd7ba admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:19.162178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26c011-8f2a-47af-840a-18373c8bde4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:19.163217 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26c011-8f2a-47af-840a-18373c8bde4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:19.163653 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26c011-8f2a-47af-840a-18373c8bde4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:19.164048 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26c011-8f2a-47af-840a-18373c8bde4e admin admin] PATH_INFO: `/v3/projects/ce1c51d1085145ea8d2aff4ef0bba5f0/users/897d281a31c342028b32a4b85496f29a/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:19.175810 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1042/2117] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:19.176964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db7ce8-99d9-40bb-8841-118b47dcd7ba admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:19.180112 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-54db7ce8-99d9-40bb-8841-118b47dcd7ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:19.195082 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26c011-8f2a-47af-840a-18373c8bde4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1c51d1085145ea8d2aff4ef0bba5f0, user_id=897d281a31c342028b32a4b85496f29a, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:19.198862 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26c011-8f2a-47af-840a-18373c8bde4e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:19.199913 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db7ce8-99d9-40bb-8841-118b47dcd7ba admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:19.206199 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b817d-f96f-4950-9683-8bdac848bb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:19.207023 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b817d-f96f-4950-9683-8bdac848bb8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:19.207776 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b817d-f96f-4950-9683-8bdac848bb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:19.207983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b817d-f96f-4950-9683-8bdac848bb8a admin admin] PATH_INFO: `/v3/users/af3ad32b475943e98122c07b51cecf8a` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:19.209775 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b817d-f96f-4950-9683-8bdac848bb8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=af3ad32b475943e98122c07b51cecf8a)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:19.212758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b817d-f96f-4950-9683-8bdac848bb8a admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:19.222828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1076/2118] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:19 2022] PUT /identity/v3/projects/ce1c51d1085145ea8d2aff4ef0bba5f0/users/897d281a31c342028b32a4b85496f29a/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:19.224648 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26c011-8f2a-47af-840a-18373c8bde4e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:19.227805 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-be26c011-8f2a-47af-840a-18373c8bde4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:19.291751 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:19.292644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-c85b817d-f96f-4950-9683-8bdac848bb8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af3ad32b475943e98122c07b51cecf8a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:19.304965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-c85b817d-f96f-4950-9683-8bdac848bb8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af3ad32b475943e98122c07b51cecf8a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:19.323336 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26c011-8f2a-47af-840a-18373c8bde4e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:19.328866 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-c85b817d-f96f-4950-9683-8bdac848bb8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af3ad32b475943e98122c07b51cecf8a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:19.330324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-c85b817d-f96f-4950-9683-8bdac848bb8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af3ad32b475943e98122c07b51cecf8a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:19.331173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c69a9-bca4-4d30-addb-07323a72b938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:19.331389 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-c85b817d-f96f-4950-9683-8bdac848bb8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af3ad32b475943e98122c07b51cecf8a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:19.332145 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c69a9-bca4-4d30-addb-07323a72b938 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:19.332515 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c69a9-bca4-4d30-addb-07323a72b938 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:19.332840 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c69a9-bca4-4d30-addb-07323a72b938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:19.334900 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-695c69a9-bca4-4d30-addb-07323a72b938 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:19.350771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1043/2119] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:19 2022] DELETE /identity/v3/users/af3ad32b475943e98122c07b51cecf8a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:19.351628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b817d-f96f-4950-9683-8bdac848bb8a admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:19.353068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-c85b817d-f96f-4950-9683-8bdac848bb8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:19.423346 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c69a9-bca4-4d30-addb-07323a72b938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:19.435848 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c69a9-bca4-4d30-addb-07323a72b938 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:19.457335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1077/2120] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:19.459484 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c69a9-bca4-4d30-addb-07323a72b938 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:19.462250 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-695c69a9-bca4-4d30-addb-07323a72b938 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:19.484851 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c69a9-bca4-4d30-addb-07323a72b938 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:19.487661 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b817d-f96f-4950-9683-8bdac848bb8a admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:19.493865 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4748c94-7848-434d-af84-092fb0dc727c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:19.494703 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4748c94-7848-434d-af84-092fb0dc727c admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:19.495266 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4748c94-7848-434d-af84-092fb0dc727c admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:19.496276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4748c94-7848-434d-af84-092fb0dc727c admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:19.498157 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25384b85-d7b3-4390-bbd5-012092557126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:19.498346 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4748c94-7848-434d-af84-092fb0dc727c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:41:19.498346 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4748c94-7848-434d-af84-092fb0dc727c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:19.498536 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25384b85-d7b3-4390-bbd5-012092557126 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:19.498536 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25384b85-d7b3-4390-bbd5-012092557126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:19.498904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25384b85-d7b3-4390-bbd5-012092557126 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:19.499519 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4748c94-7848-434d-af84-092fb0dc727c admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:19.500379 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25384b85-d7b3-4390-bbd5-012092557126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:19.504254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25384b85-d7b3-4390-bbd5-012092557126 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:19.522786 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1044/2121] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:41:19.525167 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4794e0-b8a0-4a0a-bde6-c28e01f4fb3c None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:19.525630 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4794e0-b8a0-4a0a-bde6-c28e01f4fb3c None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:19.526080 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4794e0-b8a0-4a0a-bde6-c28e01f4fb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:19.528951 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1078/2122] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:19.530739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25384b85-d7b3-4390-bbd5-012092557126 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:19.552295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25384b85-d7b3-4390-bbd5-012092557126 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:19.560888 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7317c67-61fe-4c72-aff1-0ec4c23027a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:19.562171 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7317c67-61fe-4c72-aff1-0ec4c23027a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:19.562805 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7317c67-61fe-4c72-aff1-0ec4c23027a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:19.563383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7317c67-61fe-4c72-aff1-0ec4c23027a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:19.565413 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7317c67-61fe-4c72-aff1-0ec4c23027a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:19.570271 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7317c67-61fe-4c72-aff1-0ec4c23027a0 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:19.581358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-ad4794e0-b8a0-4a0a-bde6-c28e01f4fb3c None None] MFA Rules not processed for user `897d281a31c342028b32a4b85496f29a`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:19.582863 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-ad4794e0-b8a0-4a0a-bde6-c28e01f4fb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:19.630598 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1079/2123] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:19 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:19.633477 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7317c67-61fe-4c72-aff1-0ec4c23027a0 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:19.689741 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:19.757866 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1045/2124] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:19.759353 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4794e0-b8a0-4a0a-bde6-c28e01f4fb3c None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:19.779956 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4794e0-b8a0-4a0a-bde6-c28e01f4fb3c None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:19.790314 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7eeada-675b-4624-a220-e35407e55e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:19.791329 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7eeada-675b-4624-a220-e35407e55e43 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:19.791801 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7eeada-675b-4624-a220-e35407e55e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:19.792478 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7eeada-675b-4624-a220-e35407e55e43 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:19.793690 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7eeada-675b-4624-a220-e35407e55e43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:19.795368 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7317c67-61fe-4c72-aff1-0ec4c23027a0 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:19.798381 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7eeada-675b-4624-a220-e35407e55e43 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:19.807001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77f890-a060-4883-bd49-3c9e645c0c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:19.808132 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77f890-a060-4883-bd49-3c9e645c0c52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:19.808711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77f890-a060-4883-bd49-3c9e645c0c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:19.809392 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77f890-a060-4883-bd49-3c9e645c0c52 admin admin] PATH_INFO: `/v3/projects/bfa5001d627743b7b84cdd426a6cc275/users/0d38cb68bef94e32abccab5f3772a330/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:19.843441 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1046/2125] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:19 2022] POST /identity/v3/users => generated 290 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:19.848691 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7eeada-675b-4624-a220-e35407e55e43 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:19.852847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-6b7eeada-675b-4624-a220-e35407e55e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:19.854695 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77f890-a060-4883-bd49-3c9e645c0c52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfa5001d627743b7b84cdd426a6cc275, user_id=0d38cb68bef94e32abccab5f3772a330, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:19.860858 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77f890-a060-4883-bd49-3c9e645c0c52 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:19.907183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1080/2126] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:19 2022] PUT /identity/v3/projects/bfa5001d627743b7b84cdd426a6cc275/users/0d38cb68bef94e32abccab5f3772a330/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:19.912168 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77f890-a060-4883-bd49-3c9e645c0c52 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:19.925131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7eeada-675b-4624-a220-e35407e55e43 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:20.052908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:20.116778 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6ff11-311b-4951-a088-67df516e8717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:20.118293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6ff11-311b-4951-a088-67df516e8717 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:20.119137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6ff11-311b-4951-a088-67df516e8717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:20.119889 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6ff11-311b-4951-a088-67df516e8717 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:20.121759 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6ff11-311b-4951-a088-67df516e8717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:20.126995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6ff11-311b-4951-a088-67df516e8717 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:20.153753 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77f890-a060-4883-bd49-3c9e645c0c52 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:20.183471 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba0140-0f04-47b4-9af7-9d3ed796f678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:20.184657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba0140-0f04-47b4-9af7-9d3ed796f678 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:20.185169 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba0140-0f04-47b4-9af7-9d3ed796f678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:20.185655 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba0140-0f04-47b4-9af7-9d3ed796f678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:20.186859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba0140-0f04-47b4-9af7-9d3ed796f678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:20.190776 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba0140-0f04-47b4-9af7-9d3ed796f678 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:20.206330 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1047/2127] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:19 2022] POST /identity/v3/projects => generated 385 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:20.209530 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711704f-84b1-4e15-a579-9e5f373f564f None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:20.211592 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711704f-84b1-4e15-a579-9e5f373f564f None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:20.213269 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711704f-84b1-4e15-a579-9e5f373f564f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:20.239000 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1081/2128] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:20.242426 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba0140-0f04-47b4-9af7-9d3ed796f678 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:20.247798 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cfba0140-0f04-47b4-9af7-9d3ed796f678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:20.252330 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-f711704f-84b1-4e15-a579-9e5f373f564f None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:20.254607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f711704f-84b1-4e15-a579-9e5f373f564f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:20.273294 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba0140-0f04-47b4-9af7-9d3ed796f678 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:20.402741 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1048/2129] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:20.404360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711704f-84b1-4e15-a579-9e5f373f564f None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:20.424230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711704f-84b1-4e15-a579-9e5f373f564f None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:20.441358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbbcd5-cadf-406a-88fa-40185a2687bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:20.442797 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbbcd5-cadf-406a-88fa-40185a2687bf admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:20.443408 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbbcd5-cadf-406a-88fa-40185a2687bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:20.445419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbbcd5-cadf-406a-88fa-40185a2687bf admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:20.446461 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbbcd5-cadf-406a-88fa-40185a2687bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:20.449613 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbbcd5-cadf-406a-88fa-40185a2687bf admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:20.471254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941d8c4-e8ff-421e-bec1-4a7204cad849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:20.472246 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941d8c4-e8ff-421e-bec1-4a7204cad849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:20.472731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941d8c4-e8ff-421e-bec1-4a7204cad849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:20.473298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941d8c4-e8ff-421e-bec1-4a7204cad849 admin admin] PATH_INFO: `/v3/projects/37a9055e9e824e7c9dec988094a50654` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:20.475429 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941d8c4-e8ff-421e-bec1-4a7204cad849 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37a9055e9e824e7c9dec988094a50654)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:20.479524 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941d8c4-e8ff-421e-bec1-4a7204cad849 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:20.493811 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1049/2130] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:20 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:20.495260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbbcd5-cadf-406a-88fa-40185a2687bf admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:20.523941 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbbcd5-cadf-406a-88fa-40185a2687bf admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:20.535832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044d722-3e54-478c-95f6-6e3bc94c56be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:20.536936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044d722-3e54-478c-95f6-6e3bc94c56be admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:20.537415 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044d722-3e54-478c-95f6-6e3bc94c56be admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:20.538041 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044d722-3e54-478c-95f6-6e3bc94c56be admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:20.539081 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044d722-3e54-478c-95f6-6e3bc94c56be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:20.541656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044d722-3e54-478c-95f6-6e3bc94c56be admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:20.554730 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1050/2131] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:20.555567 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044d722-3e54-478c-95f6-6e3bc94c56be admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:20.557527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-8044d722-3e54-478c-95f6-6e3bc94c56be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:20.572298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e941d8c4-e8ff-421e-bec1-4a7204cad849 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37a9055e9e824e7c9dec988094a50654', 'request_id': 'req-e941d8c4-e8ff-421e-bec1-4a7204cad849'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:20.573676 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044d722-3e54-478c-95f6-6e3bc94c56be admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:20.582917 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e941d8c4-e8ff-421e-bec1-4a7204cad849 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37a9055e9e824e7c9dec988094a50654', 'request_id': 'req-e941d8c4-e8ff-421e-bec1-4a7204cad849'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:20.603149 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e941d8c4-e8ff-421e-bec1-4a7204cad849 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37a9055e9e824e7c9dec988094a50654', 'request_id': 'req-e941d8c4-e8ff-421e-bec1-4a7204cad849'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:20.607267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:20.630082 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e941d8c4-e8ff-421e-bec1-4a7204cad849 admin admin] The token cache is being invalidate because project 37a9055e9e824e7c9dec988094a50654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:20.630669 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e941d8c4-e8ff-421e-bec1-4a7204cad849 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:20.631777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e941d8c4-e8ff-421e-bec1-4a7204cad849 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:20.644312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1082/2132] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:20 2022] DELETE /identity/v3/projects/37a9055e9e824e7c9dec988094a50654 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:20.645323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941d8c4-e8ff-421e-bec1-4a7204cad849 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:20.650641 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e941d8c4-e8ff-421e-bec1-4a7204cad849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:20.650941 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831acdbd-25da-4a9b-af9f-7e035cc22ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:20.651900 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831acdbd-25da-4a9b-af9f-7e035cc22ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:20.652423 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831acdbd-25da-4a9b-af9f-7e035cc22ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:20.653112 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831acdbd-25da-4a9b-af9f-7e035cc22ba4 admin admin] PATH_INFO: `/v3/projects/5aa9da9c4bf045dbbf68173e7a754c95` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:20.655346 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831acdbd-25da-4a9b-af9f-7e035cc22ba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aa9da9c4bf045dbbf68173e7a754c95)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:20.660089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831acdbd-25da-4a9b-af9f-7e035cc22ba4 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:20.765057 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-831acdbd-25da-4a9b-af9f-7e035cc22ba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aa9da9c4bf045dbbf68173e7a754c95', 'request_id': 'req-831acdbd-25da-4a9b-af9f-7e035cc22ba4'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:20.768063 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941d8c4-e8ff-421e-bec1-4a7204cad849 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:20.780425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-831acdbd-25da-4a9b-af9f-7e035cc22ba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aa9da9c4bf045dbbf68173e7a754c95', 'request_id': 'req-831acdbd-25da-4a9b-af9f-7e035cc22ba4'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:20.793002 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-831acdbd-25da-4a9b-af9f-7e035cc22ba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aa9da9c4bf045dbbf68173e7a754c95', 'request_id': 'req-831acdbd-25da-4a9b-af9f-7e035cc22ba4'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:20.818194 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-831acdbd-25da-4a9b-af9f-7e035cc22ba4 admin admin] The token cache is being invalidate because project 5aa9da9c4bf045dbbf68173e7a754c95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:20.818574 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-831acdbd-25da-4a9b-af9f-7e035cc22ba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:20.819840 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-831acdbd-25da-4a9b-af9f-7e035cc22ba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:20.821708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1051/2133] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:20 2022] DELETE /identity/v3/projects/5aa9da9c4bf045dbbf68173e7a754c95 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:20.824973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831acdbd-25da-4a9b-af9f-7e035cc22ba4 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:20.825167 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:20.825299 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-831acdbd-25da-4a9b-af9f-7e035cc22ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:20.887535 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f606c-dc22-40bd-98f7-e407e3ee6d5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:20.888208 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f606c-dc22-40bd-98f7-e407e3ee6d5d service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:20.888619 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f606c-dc22-40bd-98f7-e407e3ee6d5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:20.888826 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f606c-dc22-40bd-98f7-e407e3ee6d5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:20.891268 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-854f606c-dc22-40bd-98f7-e407e3ee6d5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:20.917673 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831acdbd-25da-4a9b-af9f-7e035cc22ba4 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:20.923389 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902902c9-2f8f-4ffb-b48a-872ffe0d8920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:20.924072 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902902c9-2f8f-4ffb-b48a-872ffe0d8920 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:20.924422 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902902c9-2f8f-4ffb-b48a-872ffe0d8920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:20.924696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902902c9-2f8f-4ffb-b48a-872ffe0d8920 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:20.925358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902902c9-2f8f-4ffb-b48a-872ffe0d8920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:20.927045 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902902c9-2f8f-4ffb-b48a-872ffe0d8920 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:20.941749 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1052/2134] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:20.946109 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902902c9-2f8f-4ffb-b48a-872ffe0d8920 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:20.948138 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-902902c9-2f8f-4ffb-b48a-872ffe0d8920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:20.966597 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902902c9-2f8f-4ffb-b48a-872ffe0d8920 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:20.973852 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888ecb6-c3a3-4163-bad6-8cd86549115a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:20.974548 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888ecb6-c3a3-4163-bad6-8cd86549115a admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:20.974825 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888ecb6-c3a3-4163-bad6-8cd86549115a admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:20.975729 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888ecb6-c3a3-4163-bad6-8cd86549115a admin admin] PATH_INFO: `/v3/projects/f177e758272d4ab198ae8409036d4036/users/7cc49be43d034b01b7bfbaf54b4df63b/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:20.989459 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f606c-dc22-40bd-98f7-e407e3ee6d5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:20.990655 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f606c-dc22-40bd-98f7-e407e3ee6d5d service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:20.994484 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888ecb6-c3a3-4163-bad6-8cd86549115a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f177e758272d4ab198ae8409036d4036, user_id=7cc49be43d034b01b7bfbaf54b4df63b, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:20.997752 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888ecb6-c3a3-4163-bad6-8cd86549115a admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:21.015316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1083/2135] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:21.017007 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f606c-dc22-40bd-98f7-e407e3ee6d5d service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:21.019504 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-854f606c-dc22-40bd-98f7-e407e3ee6d5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:21.041773 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1053/2136] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:20 2022] PUT /identity/v3/projects/f177e758272d4ab198ae8409036d4036/users/7cc49be43d034b01b7bfbaf54b4df63b/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:21.043804 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888ecb6-c3a3-4163-bad6-8cd86549115a admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:21.047972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-b888ecb6-c3a3-4163-bad6-8cd86549115a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:21.048474 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f606c-dc22-40bd-98f7-e407e3ee6d5d service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:21.151162 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:21.226127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc92b8-b1e7-4971-9202-f71cc0ec30ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:21.228314 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc92b8-b1e7-4971-9202-f71cc0ec30ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:21.229057 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc92b8-b1e7-4971-9202-f71cc0ec30ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:21.229769 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc92b8-b1e7-4971-9202-f71cc0ec30ae admin admin] PATH_INFO: `/v3/users/719a2384ec8140e189f97b6533e1d2ff` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:21.234475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc92b8-b1e7-4971-9202-f71cc0ec30ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=719a2384ec8140e189f97b6533e1d2ff)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:21.239147 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc92b8-b1e7-4971-9202-f71cc0ec30ae admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:21.239315 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888ecb6-c3a3-4163-bad6-8cd86549115a admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:21.250217 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90388bdd-4679-4685-9acf-0859ccb77a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:21.251445 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90388bdd-4679-4685-9acf-0859ccb77a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:21.252270 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90388bdd-4679-4685-9acf-0859ccb77a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:21.252904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90388bdd-4679-4685-9acf-0859ccb77a25 admin admin] PATH_INFO: `/v3/users/abe2f0f542f344ad82e55f4e62b54894` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:21.259285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90388bdd-4679-4685-9acf-0859ccb77a25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abe2f0f542f344ad82e55f4e62b54894)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:21.264751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90388bdd-4679-4685-9acf-0859ccb77a25 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:21.359282 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f7cc92b8-b1e7-4971-9202-f71cc0ec30ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '719a2384ec8140e189f97b6533e1d2ff'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:21.383094 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f7cc92b8-b1e7-4971-9202-f71cc0ec30ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '719a2384ec8140e189f97b6533e1d2ff'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:21.401735 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f7cc92b8-b1e7-4971-9202-f71cc0ec30ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '719a2384ec8140e189f97b6533e1d2ff'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:21.403110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f7cc92b8-b1e7-4971-9202-f71cc0ec30ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '719a2384ec8140e189f97b6533e1d2ff'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:21.403903 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f7cc92b8-b1e7-4971-9202-f71cc0ec30ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '719a2384ec8140e189f97b6533e1d2ff'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:21.407715 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-90388bdd-4679-4685-9acf-0859ccb77a25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abe2f0f542f344ad82e55f4e62b54894'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:21.425212 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:21.433772 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-90388bdd-4679-4685-9acf-0859ccb77a25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abe2f0f542f344ad82e55f4e62b54894'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:21.464561 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1084/2137] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:21 2022] DELETE /identity/v3/users/719a2384ec8140e189f97b6533e1d2ff => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:21.465802 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc92b8-b1e7-4971-9202-f71cc0ec30ae admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:21.467554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f7cc92b8-b1e7-4971-9202-f71cc0ec30ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:21.470910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-90388bdd-4679-4685-9acf-0859ccb77a25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abe2f0f542f344ad82e55f4e62b54894'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:21.473287 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-90388bdd-4679-4685-9acf-0859ccb77a25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abe2f0f542f344ad82e55f4e62b54894'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:21.474465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-90388bdd-4679-4685-9acf-0859ccb77a25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abe2f0f542f344ad82e55f4e62b54894'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:21.527531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1054/2138] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:21 2022] DELETE /identity/v3/users/abe2f0f542f344ad82e55f4e62b54894 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:21.530715 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5bd71-92b3-4b4e-ae5f-17dca0f9b592 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:21.531372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5bd71-92b3-4b4e-ae5f-17dca0f9b592 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:21.532154 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5bd71-92b3-4b4e-ae5f-17dca0f9b592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:21.646613 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-d9f5bd71-92b3-4b4e-ae5f-17dca0f9b592 None None] MFA Rules not processed for user `7cc49be43d034b01b7bfbaf54b4df63b`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:21.650266 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-d9f5bd71-92b3-4b4e-ae5f-17dca0f9b592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:21.764315 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc92b8-b1e7-4971-9202-f71cc0ec30ae admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:21.890444 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1055/2139] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:21.896312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5bd71-92b3-4b4e-ae5f-17dca0f9b592 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:21.903842 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-d9f5bd71-92b3-4b4e-ae5f-17dca0f9b592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:21.914219 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a32e5-4586-49a0-8c0a-d4042917239c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:21.916111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a32e5-4586-49a0-8c0a-d4042917239c admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:21.916465 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a32e5-4586-49a0-8c0a-d4042917239c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:21.917715 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a32e5-4586-49a0-8c0a-d4042917239c admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:21.918700 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a32e5-4586-49a0-8c0a-d4042917239c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:21.922288 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a32e5-4586-49a0-8c0a-d4042917239c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:21.940258 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1085/2140] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 471 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:21.944421 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a32e5-4586-49a0-8c0a-d4042917239c admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:21.953008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-534a32e5-4586-49a0-8c0a-d4042917239c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:21.958471 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5bd71-92b3-4b4e-ae5f-17dca0f9b592 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:21.974706 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeea4c3-3bae-466d-a874-069037598fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:21.976716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeea4c3-3bae-466d-a874-069037598fcc admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:21.977249 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeea4c3-3bae-466d-a874-069037598fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:21.977765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeea4c3-3bae-466d-a874-069037598fcc admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:21.979034 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeea4c3-3bae-466d-a874-069037598fcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:21.982019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a32e5-4586-49a0-8c0a-d4042917239c admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:21.983796 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeea4c3-3bae-466d-a874-069037598fcc admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:21.994241 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c052f0-65f7-4da7-95ed-a00061b9b543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:21.995816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c052f0-65f7-4da7-95ed-a00061b9b543 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:21.996409 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c052f0-65f7-4da7-95ed-a00061b9b543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:21.996991 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c052f0-65f7-4da7-95ed-a00061b9b543 admin admin] PATH_INFO: `/v3/projects/6276754d7f264d288b49b792fd0a60fc/users/6faee4f676654db98140bfe6c1f3f698/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:22.034759 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c052f0-65f7-4da7-95ed-a00061b9b543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6276754d7f264d288b49b792fd0a60fc, user_id=6faee4f676654db98140bfe6c1f3f698, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:22.043558 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c052f0-65f7-4da7-95ed-a00061b9b543 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:22.060815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1056/2141] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:21 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:22.066345 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeea4c3-3bae-466d-a874-069037598fcc admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:22.092422 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1086/2142] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:21 2022] PUT /identity/v3/projects/6276754d7f264d288b49b792fd0a60fc/users/6faee4f676654db98140bfe6c1f3f698/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:22.104804 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453feed-01a5-4747-b3e0-e94229716c0c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:22.105957 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453feed-01a5-4747-b3e0-e94229716c0c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:22.106723 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453feed-01a5-4747-b3e0-e94229716c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:22.118113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:22.197530 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-2453feed-01a5-4747-b3e0-e94229716c0c None None] MFA Rules not processed for user `6faee4f676654db98140bfe6c1f3f698`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:22.201315 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2453feed-01a5-4747-b3e0-e94229716c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:22.289033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeea4c3-3bae-466d-a874-069037598fcc admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:22.340886 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:22.346234 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1087/2143] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:41:22.347504 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453feed-01a5-4747-b3e0-e94229716c0c None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:22.349127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2453feed-01a5-4747-b3e0-e94229716c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:22.433501 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c4324-6d36-4966-9aff-9ee5e4d2b26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:22.434264 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c4324-6d36-4966-9aff-9ee5e4d2b26c admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:22.434551 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c4324-6d36-4966-9aff-9ee5e4d2b26c admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:22.434854 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c4324-6d36-4966-9aff-9ee5e4d2b26c admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:22.435795 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c4324-6d36-4966-9aff-9ee5e4d2b26c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:22.438460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c4324-6d36-4966-9aff-9ee5e4d2b26c admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:22.472725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1057/2144] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:22 2022] POST /identity/v3/users => generated 289 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:41:22.476864 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c4324-6d36-4966-9aff-9ee5e4d2b26c admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:22.485799 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453feed-01a5-4747-b3e0-e94229716c0c None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:22.493281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3cd0f-0382-4b93-8401-5575ce80a7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:22.495826 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3cd0f-0382-4b93-8401-5575ce80a7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:22.496238 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3cd0f-0382-4b93-8401-5575ce80a7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:22.496609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3cd0f-0382-4b93-8401-5575ce80a7f3 admin admin] PATH_INFO: `/v3/projects/870584d0d97642e7998742d957badde4` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:22.499426 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b3cd0f-0382-4b93-8401-5575ce80a7f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=870584d0d97642e7998742d957badde4)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:22.501666 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b3cd0f-0382-4b93-8401-5575ce80a7f3 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:22.505808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c4324-6d36-4966-9aff-9ee5e4d2b26c admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:22.519562 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767b00c-8004-4ffc-bdf6-1a14b233e016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:22.520397 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767b00c-8004-4ffc-bdf6-1a14b233e016 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:22.520685 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767b00c-8004-4ffc-bdf6-1a14b233e016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:22.520963 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767b00c-8004-4ffc-bdf6-1a14b233e016 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:22.521736 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767b00c-8004-4ffc-bdf6-1a14b233e016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:22.528705 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767b00c-8004-4ffc-bdf6-1a14b233e016 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:22.598225 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1058/2145] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:22 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:22.598225 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767b00c-8004-4ffc-bdf6-1a14b233e016 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:22.665755 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-41b3cd0f-0382-4b93-8401-5575ce80a7f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '870584d0d97642e7998742d957badde4', 'request_id': 'req-41b3cd0f-0382-4b93-8401-5575ce80a7f3'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:22.684499 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-41b3cd0f-0382-4b93-8401-5575ce80a7f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '870584d0d97642e7998742d957badde4', 'request_id': 'req-41b3cd0f-0382-4b93-8401-5575ce80a7f3'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:22.708860 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-41b3cd0f-0382-4b93-8401-5575ce80a7f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '870584d0d97642e7998742d957badde4', 'request_id': 'req-41b3cd0f-0382-4b93-8401-5575ce80a7f3'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:22.745704 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-41b3cd0f-0382-4b93-8401-5575ce80a7f3 admin admin] The token cache is being invalidate because project 870584d0d97642e7998742d957badde4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:22.751974 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-41b3cd0f-0382-4b93-8401-5575ce80a7f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:22.753764 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-41b3cd0f-0382-4b93-8401-5575ce80a7f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:22.761041 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1088/2146] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:22 2022] DELETE /identity/v3/projects/870584d0d97642e7998742d957badde4 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:22.764571 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3cd0f-0382-4b93-8401-5575ce80a7f3 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:22.765453 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767b00c-8004-4ffc-bdf6-1a14b233e016 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:22.766014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-41b3cd0f-0382-4b93-8401-5575ce80a7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:22.817620 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:22.854380 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57786bff-9154-4943-a727-21650fda3d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:22.855123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57786bff-9154-4943-a727-21650fda3d88 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:22.855608 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57786bff-9154-4943-a727-21650fda3d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:22.855985 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57786bff-9154-4943-a727-21650fda3d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:22.856761 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57786bff-9154-4943-a727-21650fda3d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:22.858424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57786bff-9154-4943-a727-21650fda3d88 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:22.873681 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1059/2147] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:22.874874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57786bff-9154-4943-a727-21650fda3d88 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:22.878323 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-57786bff-9154-4943-a727-21650fda3d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:22.880698 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3cd0f-0382-4b93-8401-5575ce80a7f3 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:22.889318 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69a34e-a540-4c10-9236-baf166b6daae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:22.890350 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69a34e-a540-4c10-9236-baf166b6daae admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:22.890707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69a34e-a540-4c10-9236-baf166b6daae admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:22.891444 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69a34e-a540-4c10-9236-baf166b6daae admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:22.892210 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69a34e-a540-4c10-9236-baf166b6daae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:22.894328 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69a34e-a540-4c10-9236-baf166b6daae admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:22.911226 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57786bff-9154-4943-a727-21650fda3d88 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:22.919538 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eaeced-bf6b-43dd-8e9a-43deca505e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:22.920350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaeced-bf6b-43dd-8e9a-43deca505e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:22.920753 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaeced-bf6b-43dd-8e9a-43deca505e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:22.921231 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaeced-bf6b-43dd-8e9a-43deca505e3a admin admin] PATH_INFO: `/v3/projects/ae59987cfebe49c89e961a8105dc1cbc` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:22.922226 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1089/2148] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:22 2022] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:22.922890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eaeced-bf6b-43dd-8e9a-43deca505e3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae59987cfebe49c89e961a8105dc1cbc)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:22.926032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eaeced-bf6b-43dd-8e9a-43deca505e3a admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:22.928992 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91569a-f36a-4d73-b566-48a96903ee0b None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:22.928992 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91569a-f36a-4d73-b566-48a96903ee0b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:22.928992 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91569a-f36a-4d73-b566-48a96903ee0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:22.954708 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-2b91569a-f36a-4d73-b566-48a96903ee0b None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:22.956870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2b91569a-f36a-4d73-b566-48a96903ee0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:22.979486 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1090/2149] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:22.979486 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91569a-f36a-4d73-b566-48a96903ee0b None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:22.981492 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2b91569a-f36a-4d73-b566-48a96903ee0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:22.996551 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-14eaeced-bf6b-43dd-8e9a-43deca505e3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae59987cfebe49c89e961a8105dc1cbc', 'request_id': 'req-14eaeced-bf6b-43dd-8e9a-43deca505e3a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:23.001277 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91569a-f36a-4d73-b566-48a96903ee0b None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:23.005951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-14eaeced-bf6b-43dd-8e9a-43deca505e3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae59987cfebe49c89e961a8105dc1cbc', 'request_id': 'req-14eaeced-bf6b-43dd-8e9a-43deca505e3a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:23.011337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:23.017254 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-14eaeced-bf6b-43dd-8e9a-43deca505e3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae59987cfebe49c89e961a8105dc1cbc', 'request_id': 'req-14eaeced-bf6b-43dd-8e9a-43deca505e3a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:23.041759 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-14eaeced-bf6b-43dd-8e9a-43deca505e3a admin admin] The token cache is being invalidate because project ae59987cfebe49c89e961a8105dc1cbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:23.042153 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-14eaeced-bf6b-43dd-8e9a-43deca505e3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:23.044135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-14eaeced-bf6b-43dd-8e9a-43deca505e3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:23.046531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1060/2150] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:22 2022] DELETE /identity/v3/projects/ae59987cfebe49c89e961a8105dc1cbc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:23.047463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eaeced-bf6b-43dd-8e9a-43deca505e3a admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:23.049051 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-14eaeced-bf6b-43dd-8e9a-43deca505e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:23.099137 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e043b3b-651a-4ac4-a54f-84ebe8de080e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:23.100795 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e043b3b-651a-4ac4-a54f-84ebe8de080e admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:23.101251 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e043b3b-651a-4ac4-a54f-84ebe8de080e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:23.101615 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e043b3b-651a-4ac4-a54f-84ebe8de080e admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:23.102397 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e043b3b-651a-4ac4-a54f-84ebe8de080e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:23.105684 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e043b3b-651a-4ac4-a54f-84ebe8de080e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:23.126624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1091/2151] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:23.128392 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141207b-e5ef-424d-abab-f3c9cc9cfa2b None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:23.128791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141207b-e5ef-424d-abab-f3c9cc9cfa2b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:23.129171 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141207b-e5ef-424d-abab-f3c9cc9cfa2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:23.146827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eaeced-bf6b-43dd-8e9a-43deca505e3a admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:23.155304 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4d1ca-d67e-4e72-a005-66089ce714c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:23.155804 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-a141207b-e5ef-424d-abab-f3c9cc9cfa2b None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:23.155978 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4d1ca-d67e-4e72-a005-66089ce714c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:23.156313 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4d1ca-d67e-4e72-a005-66089ce714c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:23.156829 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4d1ca-d67e-4e72-a005-66089ce714c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:23.157529 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4d1ca-d67e-4e72-a005-66089ce714c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:23.158054 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a141207b-e5ef-424d-abab-f3c9cc9cfa2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:23.159246 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4d1ca-d67e-4e72-a005-66089ce714c6 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:23.171394 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1092/2152] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:23.171394 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6256229-4de8-403b-9563-33dfe29bab54 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:23.171394 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6256229-4de8-403b-9563-33dfe29bab54 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:23.171394 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6256229-4de8-403b-9563-33dfe29bab54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:23.180073 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1061/2153] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:23.180073 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4d1ca-d67e-4e72-a005-66089ce714c6 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:23.180073 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-fea4d1ca-d67e-4e72-a005-66089ce714c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:23.196926 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-a6256229-4de8-403b-9563-33dfe29bab54 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:23.198669 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a6256229-4de8-403b-9563-33dfe29bab54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:23.200217 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4d1ca-d67e-4e72-a005-66089ce714c6 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:23.211512 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1093/2154] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:23.212682 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6256229-4de8-403b-9563-33dfe29bab54 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:23.218964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d13043-c120-4765-98ac-ae5f560a0035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:23.220390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d13043-c120-4765-98ac-ae5f560a0035 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:23.221232 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d13043-c120-4765-98ac-ae5f560a0035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:23.221232 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d13043-c120-4765-98ac-ae5f560a0035 admin admin] PATH_INFO: `/v3/projects/9ce39f6884c14cae9f256a5001810a7c/users/e8694defe59a446fa99ae9b616e487af/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:23.223741 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6256229-4de8-403b-9563-33dfe29bab54 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:23.229632 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845a62a-4c5f-4ef5-b800-eddd4c2d349f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:23.230224 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845a62a-4c5f-4ef5-b800-eddd4c2d349f admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:23.230508 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845a62a-4c5f-4ef5-b800-eddd4c2d349f admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:23.230819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845a62a-4c5f-4ef5-b800-eddd4c2d349f admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:23.231445 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845a62a-4c5f-4ef5-b800-eddd4c2d349f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:41:23.231756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845a62a-4c5f-4ef5-b800-eddd4c2d349f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:23.233565 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845a62a-4c5f-4ef5-b800-eddd4c2d349f admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:23.256258 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1094/2155] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:41:23.256258 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845a62a-4c5f-4ef5-b800-eddd4c2d349f admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:23.259173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d13043-c120-4765-98ac-ae5f560a0035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ce39f6884c14cae9f256a5001810a7c, user_id=e8694defe59a446fa99ae9b616e487af, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:23.262690 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d13043-c120-4765-98ac-ae5f560a0035 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:23.269326 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845a62a-4c5f-4ef5-b800-eddd4c2d349f admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:23.281515 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43861463-03fd-472a-9eb3-0b795a558fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:23.282902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43861463-03fd-472a-9eb3-0b795a558fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:23.283515 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43861463-03fd-472a-9eb3-0b795a558fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:23.284978 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43861463-03fd-472a-9eb3-0b795a558fd3 admin admin] PATH_INFO: `/v3/projects/3460cc2fd6464604a0d87a56f0eb581f/users/b513811772c642eaa9f93187cdfda320/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:23.288029 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1062/2156] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:23 2022] PUT /identity/v3/projects/9ce39f6884c14cae9f256a5001810a7c/users/e8694defe59a446fa99ae9b616e487af/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:23.289674 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff139dd-56ff-423c-93aa-328bfbe29297 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:23.290076 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff139dd-56ff-423c-93aa-328bfbe29297 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:23.290421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff139dd-56ff-423c-93aa-328bfbe29297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:23.327821 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-bff139dd-56ff-423c-93aa-328bfbe29297 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:23.333613 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-bff139dd-56ff-423c-93aa-328bfbe29297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:23.375473 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43861463-03fd-472a-9eb3-0b795a558fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3460cc2fd6464604a0d87a56f0eb581f, user_id=b513811772c642eaa9f93187cdfda320, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:23.389003 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43861463-03fd-472a-9eb3-0b795a558fd3 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:23.389971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:23.435017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1095/2157] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:23 2022] PUT /identity/v3/projects/3460cc2fd6464604a0d87a56f0eb581f/users/b513811772c642eaa9f93187cdfda320/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:23.437378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43861463-03fd-472a-9eb3-0b795a558fd3 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:23.469474 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1063/2158] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:23.471630 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf664a9-e791-4fdf-b695-d168a833abdc None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:23.472294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf664a9-e791-4fdf-b695-d168a833abdc None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:23.473991 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf664a9-e791-4fdf-b695-d168a833abdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:23.563781 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-dcf664a9-e791-4fdf-b695-d168a833abdc None None] MFA Rules not processed for user `e8694defe59a446fa99ae9b616e487af`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:23.564376 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-dcf664a9-e791-4fdf-b695-d168a833abdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:23.631901 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43861463-03fd-472a-9eb3-0b795a558fd3 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:23.657895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b3e02-e258-4567-bd6c-2008a3ca2150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:23.658513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b3e02-e258-4567-bd6c-2008a3ca2150 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:23.659029 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b3e02-e258-4567-bd6c-2008a3ca2150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:23.659758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b3e02-e258-4567-bd6c-2008a3ca2150 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:23.660939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b3e02-e258-4567-bd6c-2008a3ca2150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:23.666440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b3e02-e258-4567-bd6c-2008a3ca2150 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:23.782273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1096/2159] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:23 2022] POST /identity/v3/projects => generated 363 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:23.786822 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b3e02-e258-4567-bd6c-2008a3ca2150 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:23.810819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1064/2160] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:23.815727 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf664a9-e791-4fdf-b695-d168a833abdc None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:23.853928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf664a9-e791-4fdf-b695-d168a833abdc None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:24.017245 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:24.044791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a047338-68c7-46af-9eea-f1b078a42c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:24.045873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a047338-68c7-46af-9eea-f1b078a42c2b admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:24.046387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a047338-68c7-46af-9eea-f1b078a42c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:24.052712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a047338-68c7-46af-9eea-f1b078a42c2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:24.054001 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a047338-68c7-46af-9eea-f1b078a42c2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:41:24.054389 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a047338-68c7-46af-9eea-f1b078a42c2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:24.058557 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a047338-68c7-46af-9eea-f1b078a42c2b admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:24.065855 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b3e02-e258-4567-bd6c-2008a3ca2150 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:24.076965 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7f51b-adc3-4770-afa3-272151d6558f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:24.077808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7f51b-adc3-4770-afa3-272151d6558f admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:24.078345 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7f51b-adc3-4770-afa3-272151d6558f admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:24.078870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7f51b-adc3-4770-afa3-272151d6558f admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:24.080017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7f51b-adc3-4770-afa3-272151d6558f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:24.081158 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1065/2161] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:41:24.082334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a047338-68c7-46af-9eea-f1b078a42c2b admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:24.088443 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7f51b-adc3-4770-afa3-272151d6558f admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:24.094970 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a047338-68c7-46af-9eea-f1b078a42c2b admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:24.110532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1097/2162] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:24.112396 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7f51b-adc3-4770-afa3-272151d6558f admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:24.113322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab215ae-1012-4a97-a639-a9ec7895d124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:24.115227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab215ae-1012-4a97-a639-a9ec7895d124 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:24.116293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab215ae-1012-4a97-a639-a9ec7895d124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:24.116766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab215ae-1012-4a97-a639-a9ec7895d124 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:24.117917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab215ae-1012-4a97-a639-a9ec7895d124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:24.123051 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab215ae-1012-4a97-a639-a9ec7895d124 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:24.134353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7f51b-adc3-4770-afa3-272151d6558f admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:24.147661 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da1d65-a989-4d0a-bf47-0de597e1ce33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:24.149066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da1d65-a989-4d0a-bf47-0de597e1ce33 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:24.151035 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da1d65-a989-4d0a-bf47-0de597e1ce33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:24.151819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da1d65-a989-4d0a-bf47-0de597e1ce33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:24.153252 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da1d65-a989-4d0a-bf47-0de597e1ce33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:24.156254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da1d65-a989-4d0a-bf47-0de597e1ce33 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:24.176745 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1066/2163] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:24 2022] POST /identity/v3/users => generated 282 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:24.178900 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab215ae-1012-4a97-a639-a9ec7895d124 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:24.206995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab215ae-1012-4a97-a639-a9ec7895d124 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:24.217757 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bec84d-ac1f-4e2d-bba1-356fcee6d744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:24.218752 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bec84d-ac1f-4e2d-bba1-356fcee6d744 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:24.219256 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bec84d-ac1f-4e2d-bba1-356fcee6d744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:24.219771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bec84d-ac1f-4e2d-bba1-356fcee6d744 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:24.221224 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bec84d-ac1f-4e2d-bba1-356fcee6d744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:24.225231 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bec84d-ac1f-4e2d-bba1-356fcee6d744 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:24.241173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1098/2164] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:24 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:24.241173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da1d65-a989-4d0a-bf47-0de597e1ce33 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:24.274787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1067/2165] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:24 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:24.275517 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bec84d-ac1f-4e2d-bba1-356fcee6d744 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:24.295803 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:24.341822 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da1d65-a989-4d0a-bf47-0de597e1ce33 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:24.397837 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bec84d-ac1f-4e2d-bba1-356fcee6d744 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:24.408303 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3a954-d30f-4a63-bbf6-bea6e7b9b4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:24.408945 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3a954-d30f-4a63-bbf6-bea6e7b9b4ea admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:24.409228 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3a954-d30f-4a63-bbf6-bea6e7b9b4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:24.409803 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3a954-d30f-4a63-bbf6-bea6e7b9b4ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:24.410441 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3a954-d30f-4a63-bbf6-bea6e7b9b4ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:24.415434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3a954-d30f-4a63-bbf6-bea6e7b9b4ea admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:24.448242 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1068/2166] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:24.448242 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3a954-d30f-4a63-bbf6-bea6e7b9b4ea admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:24.456880 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e2164-3a72-400f-9676-c583735a1c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:24.457605 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e2164-3a72-400f-9676-c583735a1c8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:24.462672 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e2164-3a72-400f-9676-c583735a1c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:24.462672 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e2164-3a72-400f-9676-c583735a1c8f admin admin] PATH_INFO: `/v3/projects/3460cc2fd6464604a0d87a56f0eb581f/users/b513811772c642eaa9f93187cdfda320/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:24.465226 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e2164-3a72-400f-9676-c583735a1c8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3460cc2fd6464604a0d87a56f0eb581f, user_id=b513811772c642eaa9f93187cdfda320, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:24.470859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e2164-3a72-400f-9676-c583735a1c8f admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:24.480245 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3a954-d30f-4a63-bbf6-bea6e7b9b4ea admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:24.493249 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1099/2167] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:24 2022] PUT /identity/v3/projects/3460cc2fd6464604a0d87a56f0eb581f/users/b513811772c642eaa9f93187cdfda320/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:24.498988 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e2164-3a72-400f-9676-c583735a1c8f admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:24.601634 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c145f05-761c-4dc0-89aa-00bca0704e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:24.602271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c145f05-761c-4dc0-89aa-00bca0704e9a admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:24.602540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c145f05-761c-4dc0-89aa-00bca0704e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:24.602813 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c145f05-761c-4dc0-89aa-00bca0704e9a admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:24.603459 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c145f05-761c-4dc0-89aa-00bca0704e9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:24.606204 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c145f05-761c-4dc0-89aa-00bca0704e9a admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:24.609405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:24.628353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e2164-3a72-400f-9676-c583735a1c8f admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:24.642005 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077f59a-1432-49a7-bd11-b21c14ec6d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:24.642307 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1069/2168] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:24 2022] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:24.644069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c145f05-761c-4dc0-89aa-00bca0704e9a admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:24.644328 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077f59a-1432-49a7-bd11-b21c14ec6d08 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:24.645510 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077f59a-1432-49a7-bd11-b21c14ec6d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:24.646573 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077f59a-1432-49a7-bd11-b21c14ec6d08 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:24.648396 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077f59a-1432-49a7-bd11-b21c14ec6d08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:24.654818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077f59a-1432-49a7-bd11-b21c14ec6d08 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:24.660219 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c145f05-761c-4dc0-89aa-00bca0704e9a admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:24.666988 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2938c87-e33e-475b-8325-a6f9397454c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:24.667661 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2938c87-e33e-475b-8325-a6f9397454c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:24.667944 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2938c87-e33e-475b-8325-a6f9397454c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:24.668261 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2938c87-e33e-475b-8325-a6f9397454c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:24.668944 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2938c87-e33e-475b-8325-a6f9397454c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:24.670881 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2938c87-e33e-475b-8325-a6f9397454c5 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:24.696251 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1100/2169] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:24 2022] POST /identity/v3/users => generated 292 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:24.696251 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f76b2-b426-49b5-b22f-d710af0459c3 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:24.696251 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f76b2-b426-49b5-b22f-d710af0459c3 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:24.696251 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f76b2-b426-49b5-b22f-d710af0459c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:24.697223 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1070/2170] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:24.698236 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2938c87-e33e-475b-8325-a6f9397454c5 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:24.716855 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2938c87-e33e-475b-8325-a6f9397454c5 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:24.730069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04565557-d1b1-4f25-b110-16267a2a1d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:24.730069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04565557-d1b1-4f25-b110-16267a2a1d1c admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:24.730069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04565557-d1b1-4f25-b110-16267a2a1d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:24.730069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04565557-d1b1-4f25-b110-16267a2a1d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:24.730825 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04565557-d1b1-4f25-b110-16267a2a1d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:24.730825 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04565557-d1b1-4f25-b110-16267a2a1d1c admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:24.747213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1071/2171] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:24.748678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04565557-d1b1-4f25-b110-16267a2a1d1c admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:24.761683 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04565557-d1b1-4f25-b110-16267a2a1d1c admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:24.774083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04036c-57bf-4e13-b6d2-1d525e6571f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:24.775260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04036c-57bf-4e13-b6d2-1d525e6571f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:24.775729 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04036c-57bf-4e13-b6d2-1d525e6571f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:24.776496 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04036c-57bf-4e13-b6d2-1d525e6571f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:24.778720 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04036c-57bf-4e13-b6d2-1d525e6571f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:24.783145 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04036c-57bf-4e13-b6d2-1d525e6571f7 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:24.790362 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d82f76b2-b426-49b5-b22f-d710af0459c3 None None] MFA Rules not processed for user `b513811772c642eaa9f93187cdfda320`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:24.794964 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d82f76b2-b426-49b5-b22f-d710af0459c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:24.800286 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1072/2172] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:24.803094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04036c-57bf-4e13-b6d2-1d525e6571f7 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:24.824302 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04036c-57bf-4e13-b6d2-1d525e6571f7 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:24.843792 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e866ca-49b7-427e-a617-cb4fe77d4cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:24.845137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e866ca-49b7-427e-a617-cb4fe77d4cba admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:24.845890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e866ca-49b7-427e-a617-cb4fe77d4cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:24.846629 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e866ca-49b7-427e-a617-cb4fe77d4cba admin admin] PATH_INFO: `/v3/projects/dc2972f169774afab421a27c67c4e371/users/ba3740be7eba4f8f9f29d53b89824d5d/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:24.880152 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e866ca-49b7-427e-a617-cb4fe77d4cba admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc2972f169774afab421a27c67c4e371, user_id=ba3740be7eba4f8f9f29d53b89824d5d, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:24.887612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e866ca-49b7-427e-a617-cb4fe77d4cba admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:24.909917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1073/2173] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:24 2022] PUT /identity/v3/projects/dc2972f169774afab421a27c67c4e371/users/ba3740be7eba4f8f9f29d53b89824d5d/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:24.924490 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e866ca-49b7-427e-a617-cb4fe77d4cba admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:24.944329 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1101/2174] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:24.947834 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f76b2-b426-49b5-b22f-d710af0459c3 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:24.977157 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f76b2-b426-49b5-b22f-d710af0459c3 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:25.021595 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:25.057371 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e866ca-49b7-427e-a617-cb4fe77d4cba admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:25.065429 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f29cc-3332-4c0f-84f3-fb3d49694afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:25.067085 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f29cc-3332-4c0f-84f3-fb3d49694afd admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:25.067869 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f29cc-3332-4c0f-84f3-fb3d49694afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:25.068616 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f29cc-3332-4c0f-84f3-fb3d49694afd admin admin] PATH_INFO: `/v3/projects/3f45420eef234e6c9a996c7cf2b866ab/users/01b76ed1efa34b25a1e0cc846af83d8c/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:25.095836 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f29cc-3332-4c0f-84f3-fb3d49694afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f45420eef234e6c9a996c7cf2b866ab, user_id=01b76ed1efa34b25a1e0cc846af83d8c, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:25.106587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f29cc-3332-4c0f-84f3-fb3d49694afd admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:25.125761 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c49a7c-a24b-4123-9ee7-280bf4161ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:25.125761 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c49a7c-a24b-4123-9ee7-280bf4161ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:25.126283 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c49a7c-a24b-4123-9ee7-280bf4161ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:25.126635 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c49a7c-a24b-4123-9ee7-280bf4161ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:25.131085 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c49a7c-a24b-4123-9ee7-280bf4161ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:25.133105 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c49a7c-a24b-4123-9ee7-280bf4161ff1 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:25.133589 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1074/2175] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:24 2022] PUT /identity/v3/projects/3f45420eef234e6c9a996c7cf2b866ab/users/01b76ed1efa34b25a1e0cc846af83d8c/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:25.136840 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd1942-df36-48e6-9212-12274dffd5fb None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:25.137554 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd1942-df36-48e6-9212-12274dffd5fb None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:25.138203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd1942-df36-48e6-9212-12274dffd5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:25.146887 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1102/2176] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:25.148655 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c49a7c-a24b-4123-9ee7-280bf4161ff1 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:25.150775 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-43c49a7c-a24b-4123-9ee7-280bf4161ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:25.200889 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-6ddd1942-df36-48e6-9212-12274dffd5fb None None] MFA Rules not processed for user `ba3740be7eba4f8f9f29d53b89824d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:25.202970 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-6ddd1942-df36-48e6-9212-12274dffd5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:25.311595 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c49a7c-a24b-4123-9ee7-280bf4161ff1 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:25.393006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:25.473592 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1075/2177] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:25.477599 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae149f5-8553-45f1-b39e-06b1b2b1de18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:25.479033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae149f5-8553-45f1-b39e-06b1b2b1de18 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:25.479473 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae149f5-8553-45f1-b39e-06b1b2b1de18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:25.479921 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae149f5-8553-45f1-b39e-06b1b2b1de18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:25.487989 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd1942-df36-48e6-9212-12274dffd5fb None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:25.650136 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd1942-df36-48e6-9212-12274dffd5fb None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:25.657050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30807f45-40c8-488a-adc3-5061e8504ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:25.657792 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30807f45-40c8-488a-adc3-5061e8504ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:25.658266 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30807f45-40c8-488a-adc3-5061e8504ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:25.658661 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30807f45-40c8-488a-adc3-5061e8504ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:25.660148 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30807f45-40c8-488a-adc3-5061e8504ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:25.664663 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae149f5-8553-45f1-b39e-06b1b2b1de18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:25.666852 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae149f5-8553-45f1-b39e-06b1b2b1de18 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:25.666975 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30807f45-40c8-488a-adc3-5061e8504ee3 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:25.688775 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1103/2178] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:25.701967 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae149f5-8553-45f1-b39e-06b1b2b1de18 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:25.714837 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1076/2179] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:25.719427 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30807f45-40c8-488a-adc3-5061e8504ee3 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:25.721321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-30807f45-40c8-488a-adc3-5061e8504ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:25.738789 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30807f45-40c8-488a-adc3-5061e8504ee3 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:25.747298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae149f5-8553-45f1-b39e-06b1b2b1de18 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:25.753200 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fef8d-4cd4-4872-a035-bd77a111cd0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:25.755110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fef8d-4cd4-4872-a035-bd77a111cd0f service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:25.757375 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fef8d-4cd4-4872-a035-bd77a111cd0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:25.757900 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fef8d-4cd4-4872-a035-bd77a111cd0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:25.780571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fef8d-4cd4-4872-a035-bd77a111cd0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:25.783411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fef8d-4cd4-4872-a035-bd77a111cd0f service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:25.784472 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cbd75-8837-4440-82a6-ae52a9cce715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:25.786271 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cbd75-8837-4440-82a6-ae52a9cce715 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:25.786831 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cbd75-8837-4440-82a6-ae52a9cce715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:25.787346 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cbd75-8837-4440-82a6-ae52a9cce715 admin admin] PATH_INFO: `/v3/projects/0d446ab83d4a49aca9f9e6dc5ef2f65a/users/d9e0cdba4124401d9edb31f73832557a/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:25.806386 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1077/2180] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:25.821079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fef8d-4cd4-4872-a035-bd77a111cd0f service cinder] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:25.823386 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fef8d-4cd4-4872-a035-bd77a111cd0f service cinder] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:25.837161 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cbd75-8837-4440-82a6-ae52a9cce715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d446ab83d4a49aca9f9e6dc5ef2f65a, user_id=d9e0cdba4124401d9edb31f73832557a, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:25.840969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616aac7-df0e-4ec7-b1fd-e73679021ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:25.841257 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cbd75-8837-4440-82a6-ae52a9cce715 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:25.847427 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616aac7-df0e-4ec7-b1fd-e73679021ab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:25.847878 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616aac7-df0e-4ec7-b1fd-e73679021ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:25.848845 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616aac7-df0e-4ec7-b1fd-e73679021ab9 admin admin] PATH_INFO: `/v3/projects/3f45420eef234e6c9a996c7cf2b866ab/users/01b76ed1efa34b25a1e0cc846af83d8c/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:25.855928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616aac7-df0e-4ec7-b1fd-e73679021ab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f45420eef234e6c9a996c7cf2b866ab, user_id=01b76ed1efa34b25a1e0cc846af83d8c, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:25.864468 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616aac7-df0e-4ec7-b1fd-e73679021ab9 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:25.883439 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1104/2181] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:25 2022] PUT /identity/v3/projects/0d446ab83d4a49aca9f9e6dc5ef2f65a/users/d9e0cdba4124401d9edb31f73832557a/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:25.885662 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5f7c6-8754-424b-b3e0-d8427e26f556 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:25.885960 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5f7c6-8754-424b-b3e0-d8427e26f556 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:25.886826 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5f7c6-8754-424b-b3e0-d8427e26f556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:25.919107 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1078/2182] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:25 2022] PUT /identity/v3/projects/3f45420eef234e6c9a996c7cf2b866ab/users/01b76ed1efa34b25a1e0cc846af83d8c/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:25.940603 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0ab5b-d5f6-4b6d-b3b4-85bd9f012cd9 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:25.941311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0ab5b-d5f6-4b6d-b3b4-85bd9f012cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:25.942113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0ab5b-d5f6-4b6d-b3b4-85bd9f012cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:25.951202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-3ce5f7c6-8754-424b-b3e0-d8427e26f556 None None] MFA Rules not processed for user `d9e0cdba4124401d9edb31f73832557a`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:25.954340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3ce5f7c6-8754-424b-b3e0-d8427e26f556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:26.007883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-abb0ab5b-d5f6-4b6d-b3b4-85bd9f012cd9 None None] MFA Rules not processed for user `01b76ed1efa34b25a1e0cc846af83d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:26.009409 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-abb0ab5b-d5f6-4b6d-b3b4-85bd9f012cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:26.041636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:26.225934 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1079/2183] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:41:26.226896 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1105/2184] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:41:26.231925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0ab5b-d5f6-4b6d-b3b4-85bd9f012cd9 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:26.259243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5f7c6-8754-424b-b3e0-d8427e26f556 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:26.378993 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:26.413533 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0ab5b-d5f6-4b6d-b3b4-85bd9f012cd9 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:26.430295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5f7c6-8754-424b-b3e0-d8427e26f556 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:26.432158 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d64897-779a-4db7-9b5f-f82abea76b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:26.432402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d64897-779a-4db7-9b5f-f82abea76b03 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:26.432758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d64897-779a-4db7-9b5f-f82abea76b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:26.433619 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d64897-779a-4db7-9b5f-f82abea76b03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:26.434109 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d64897-779a-4db7-9b5f-f82abea76b03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:26.437045 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d64897-779a-4db7-9b5f-f82abea76b03 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:26.446811 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885cabe-e2c3-421e-91b0-766abe4aabaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:26.447448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885cabe-e2c3-421e-91b0-766abe4aabaf service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:26.447733 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885cabe-e2c3-421e-91b0-766abe4aabaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:26.448465 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885cabe-e2c3-421e-91b0-766abe4aabaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:26.505067 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885cabe-e2c3-421e-91b0-766abe4aabaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:26.506687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885cabe-e2c3-421e-91b0-766abe4aabaf service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:26.536494 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1080/2185] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:26 2022] POST /identity/v3/projects => generated 383 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:41:26.538848 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d64897-779a-4db7-9b5f-f82abea76b03 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:26.555431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1106/2186] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:41:26.651604 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885cabe-e2c3-421e-91b0-766abe4aabaf service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:26.662002 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d64897-779a-4db7-9b5f-f82abea76b03 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:26.675668 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885cabe-e2c3-421e-91b0-766abe4aabaf service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:26.688169 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd471bc-662a-4dec-815b-ee6a6a070517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:26.688962 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd471bc-662a-4dec-815b-ee6a6a070517 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:26.689342 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd471bc-662a-4dec-815b-ee6a6a070517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:26.689734 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd471bc-662a-4dec-815b-ee6a6a070517 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:26.690611 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd471bc-662a-4dec-815b-ee6a6a070517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:26.694385 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd471bc-662a-4dec-815b-ee6a6a070517 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:26.756026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1081/2187] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:26 2022] POST /identity/v3/users => generated 298 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:26.766703 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd471bc-662a-4dec-815b-ee6a6a070517 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:26.820951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd471bc-662a-4dec-815b-ee6a6a070517 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:26.839036 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edce71d-d6b7-48c2-9487-be1213778c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:26.839036 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edce71d-d6b7-48c2-9487-be1213778c47 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:26.839036 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edce71d-d6b7-48c2-9487-be1213778c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:26.839036 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edce71d-d6b7-48c2-9487-be1213778c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:26.841912 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edce71d-d6b7-48c2-9487-be1213778c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:26.849094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edce71d-d6b7-48c2-9487-be1213778c47 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:26.880710 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1082/2188] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:26.885483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edce71d-d6b7-48c2-9487-be1213778c47 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:26.905844 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edce71d-d6b7-48c2-9487-be1213778c47 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:26.908448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573b921-3f59-40ed-b1d4-70f700dbce40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:26.909460 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573b921-3f59-40ed-b1d4-70f700dbce40 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:26.910177 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573b921-3f59-40ed-b1d4-70f700dbce40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:26.910987 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573b921-3f59-40ed-b1d4-70f700dbce40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:26.919985 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c573b921-3f59-40ed-b1d4-70f700dbce40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:26.921200 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a443f3-e4fb-484d-bbc1-a914ee1dee64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:26.924440 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a443f3-e4fb-484d-bbc1-a914ee1dee64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:26.925094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a443f3-e4fb-484d-bbc1-a914ee1dee64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:26.925595 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a443f3-e4fb-484d-bbc1-a914ee1dee64 admin admin] PATH_INFO: `/v3/projects/d18e934cc5794f708167103e3dd69405/users/db6f8783ddb947c5ba6377393760b04a/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:26.944883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:26.954365 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a443f3-e4fb-484d-bbc1-a914ee1dee64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18e934cc5794f708167103e3dd69405, user_id=db6f8783ddb947c5ba6377393760b04a, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:26.958940 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a443f3-e4fb-484d-bbc1-a914ee1dee64 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:26.994379 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1083/2189] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:26 2022] PUT /identity/v3/projects/d18e934cc5794f708167103e3dd69405/users/db6f8783ddb947c5ba6377393760b04a/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:27.001423 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a443f3-e4fb-484d-bbc1-a914ee1dee64 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:27.127823 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a443f3-e4fb-484d-bbc1-a914ee1dee64 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:27.133373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573b921-3f59-40ed-b1d4-70f700dbce40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:27.135776 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eddeca-1c68-43a4-9928-bac07f73b6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:27.136300 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eddeca-1c68-43a4-9928-bac07f73b6ae admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:27.136531 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573b921-3f59-40ed-b1d4-70f700dbce40 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:27.136856 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eddeca-1c68-43a4-9928-bac07f73b6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:27.138171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eddeca-1c68-43a4-9928-bac07f73b6ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:27.139192 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eddeca-1c68-43a4-9928-bac07f73b6ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:27.141472 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eddeca-1c68-43a4-9928-bac07f73b6ae admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:27.164144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1107/2190] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:41:27.168609 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1084/2191] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:27.175598 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573b921-3f59-40ed-b1d4-70f700dbce40 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:27.198637 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573b921-3f59-40ed-b1d4-70f700dbce40 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:27.213353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ce6d7-5e10-49ef-a8ec-59577d3c3b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:27.214494 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ce6d7-5e10-49ef-a8ec-59577d3c3b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:27.214962 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ce6d7-5e10-49ef-a8ec-59577d3c3b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:27.216280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ce6d7-5e10-49ef-a8ec-59577d3c3b53 admin admin] PATH_INFO: `/v3/projects/d18e934cc5794f708167103e3dd69405/users/db6f8783ddb947c5ba6377393760b04a/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:27.221843 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ce6d7-5e10-49ef-a8ec-59577d3c3b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18e934cc5794f708167103e3dd69405, user_id=db6f8783ddb947c5ba6377393760b04a, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:27.235839 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ce6d7-5e10-49ef-a8ec-59577d3c3b53 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:27.265195 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1108/2192] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:27 2022] PUT /identity/v3/projects/d18e934cc5794f708167103e3dd69405/users/db6f8783ddb947c5ba6377393760b04a/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:27.291431 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79043e9-1105-426f-93d6-3ae8fa40a6fa None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:27.291973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79043e9-1105-426f-93d6-3ae8fa40a6fa None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:27.292887 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79043e9-1105-426f-93d6-3ae8fa40a6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:27.372386 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-a79043e9-1105-426f-93d6-3ae8fa40a6fa None None] MFA Rules not processed for user `db6f8783ddb947c5ba6377393760b04a`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:27.396720 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a79043e9-1105-426f-93d6-3ae8fa40a6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:27.626673 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1085/2193] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:27.744129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ce6d7-5e10-49ef-a8ec-59577d3c3b53 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:27.876818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ce6d7-5e10-49ef-a8ec-59577d3c3b53 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:27.885126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41986882-82bb-4b4d-bdd2-a4ca2651ac35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:27.886222 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41986882-82bb-4b4d-bdd2-a4ca2651ac35 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:27.886732 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41986882-82bb-4b4d-bdd2-a4ca2651ac35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:27.889065 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41986882-82bb-4b4d-bdd2-a4ca2651ac35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:27.908923 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41986882-82bb-4b4d-bdd2-a4ca2651ac35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:27.911632 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41986882-82bb-4b4d-bdd2-a4ca2651ac35 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:27.933583 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1109/2194] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:27 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:28.071835 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79043e9-1105-426f-93d6-3ae8fa40a6fa None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:28.115176 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79043e9-1105-426f-93d6-3ae8fa40a6fa None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:28.138928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cdccc-fdcd-4488-8486-6bb98b746ac4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:28.139936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cdccc-fdcd-4488-8486-6bb98b746ac4 service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:28.140478 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cdccc-fdcd-4488-8486-6bb98b746ac4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:28.141225 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cdccc-fdcd-4488-8486-6bb98b746ac4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:28.149863 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-1f6cdccc-fdcd-4488-8486-6bb98b746ac4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:28.399213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cdccc-fdcd-4488-8486-6bb98b746ac4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:28.403346 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cdccc-fdcd-4488-8486-6bb98b746ac4 service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:28.426370 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1086/2195] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:41:28.440797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41986882-82bb-4b4d-bdd2-a4ca2651ac35 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:28.451383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41986882-82bb-4b4d-bdd2-a4ca2651ac35 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:28.468391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511bb9e-36b4-4cdb-be11-1a23d3cd09e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:28.469176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511bb9e-36b4-4cdb-be11-1a23d3cd09e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:28.469324 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511bb9e-36b4-4cdb-be11-1a23d3cd09e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:28.469604 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511bb9e-36b4-4cdb-be11-1a23d3cd09e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:28.501791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:28.607849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511bb9e-36b4-4cdb-be11-1a23d3cd09e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:28.615372 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511bb9e-36b4-4cdb-be11-1a23d3cd09e5 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:28.646731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1110/2196] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:41:29.133878 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa90d60-5d09-48f7-9129-f16787b0a014 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:29.134550 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa90d60-5d09-48f7-9129-f16787b0a014 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:29.134927 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa90d60-5d09-48f7-9129-f16787b0a014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:29.217208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:29.277838 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-3aa90d60-5d09-48f7-9129-f16787b0a014 None None] MFA Rules not processed for user `0d38cb68bef94e32abccab5f3772a330`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:29.280401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-3aa90d60-5d09-48f7-9129-f16787b0a014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:29.495884 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1087/2197] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:29.508943 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511bb9e-36b4-4cdb-be11-1a23d3cd09e5 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:29.511055 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-8511bb9e-36b4-4cdb-be11-1a23d3cd09e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:29.650877 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa90d60-5d09-48f7-9129-f16787b0a014 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:29.668590 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511bb9e-36b4-4cdb-be11-1a23d3cd09e5 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:29.676297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb68fd8-72d6-4c92-aa96-952d432ddaa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:29.677497 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb68fd8-72d6-4c92-aa96-952d432ddaa3 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:29.678138 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb68fd8-72d6-4c92-aa96-952d432ddaa3 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:29.678638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb68fd8-72d6-4c92-aa96-952d432ddaa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:29.693055 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb68fd8-72d6-4c92-aa96-952d432ddaa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:29.696267 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb68fd8-72d6-4c92-aa96-952d432ddaa3 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:29.724015 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1111/2198] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:29.915457 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa90d60-5d09-48f7-9129-f16787b0a014 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:29.936795 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d7e86-be81-4370-b16c-072f7d6168b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:29.938686 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d7e86-be81-4370-b16c-072f7d6168b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:29.939101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d7e86-be81-4370-b16c-072f7d6168b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:29.939390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d7e86-be81-4370-b16c-072f7d6168b9 admin admin] PATH_INFO: `/v3/users/d9e0cdba4124401d9edb31f73832557a` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:29.941919 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d7e86-be81-4370-b16c-072f7d6168b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9e0cdba4124401d9edb31f73832557a)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:29.949478 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d7e86-be81-4370-b16c-072f7d6168b9 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:30.161469 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-835d7e86-be81-4370-b16c-072f7d6168b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9e0cdba4124401d9edb31f73832557a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:30.178472 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-835d7e86-be81-4370-b16c-072f7d6168b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9e0cdba4124401d9edb31f73832557a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:30.252285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-835d7e86-be81-4370-b16c-072f7d6168b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9e0cdba4124401d9edb31f73832557a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:30.255813 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-835d7e86-be81-4370-b16c-072f7d6168b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9e0cdba4124401d9edb31f73832557a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:30.256145 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-835d7e86-be81-4370-b16c-072f7d6168b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9e0cdba4124401d9edb31f73832557a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:30.298320 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1088/2199] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:29 2022] DELETE /identity/v3/users/d9e0cdba4124401d9edb31f73832557a => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:30.305206 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a35f8-6ef5-439c-9e48-5e45db84d6d4 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:30.305473 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a35f8-6ef5-439c-9e48-5e45db84d6d4 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:30.305753 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a35f8-6ef5-439c-9e48-5e45db84d6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:30.357853 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-1d0a35f8-6ef5-439c-9e48-5e45db84d6d4 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:30.372467 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1d0a35f8-6ef5-439c-9e48-5e45db84d6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:30.551873 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1112/2200] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:30.566439 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d7e86-be81-4370-b16c-072f7d6168b9 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:30.568069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-835d7e86-be81-4370-b16c-072f7d6168b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:30.631665 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:30.722079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d7e86-be81-4370-b16c-072f7d6168b9 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:30.730561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f4f63-d1c5-4846-bc34-75d9f348ef51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:30.732101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f4f63-d1c5-4846-bc34-75d9f348ef51 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:30.732751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f4f63-d1c5-4846-bc34-75d9f348ef51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:30.733904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f4f63-d1c5-4846-bc34-75d9f348ef51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:30.755489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f4f63-d1c5-4846-bc34-75d9f348ef51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:30.758144 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f4f63-d1c5-4846-bc34-75d9f348ef51 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:30.778551 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1089/2201] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:41:31.577243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a35f8-6ef5-439c-9e48-5e45db84d6d4 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:31.579160 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1d0a35f8-6ef5-439c-9e48-5e45db84d6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:31.595879 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a35f8-6ef5-439c-9e48-5e45db84d6d4 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:31.604013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168c0f0-e377-40df-bfc0-2c7cd5a6e454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:31.605227 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168c0f0-e377-40df-bfc0-2c7cd5a6e454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:31.605766 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168c0f0-e377-40df-bfc0-2c7cd5a6e454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:31.606554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168c0f0-e377-40df-bfc0-2c7cd5a6e454 admin admin] PATH_INFO: `/v3/projects/0d446ab83d4a49aca9f9e6dc5ef2f65a` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:31.608171 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168c0f0-e377-40df-bfc0-2c7cd5a6e454 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d446ab83d4a49aca9f9e6dc5ef2f65a)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:31.611099 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168c0f0-e377-40df-bfc0-2c7cd5a6e454 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:31.761377 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:31.779031 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5168c0f0-e377-40df-bfc0-2c7cd5a6e454 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d446ab83d4a49aca9f9e6dc5ef2f65a', 'request_id': 'req-5168c0f0-e377-40df-bfc0-2c7cd5a6e454'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:31.808897 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5168c0f0-e377-40df-bfc0-2c7cd5a6e454 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d446ab83d4a49aca9f9e6dc5ef2f65a', 'request_id': 'req-5168c0f0-e377-40df-bfc0-2c7cd5a6e454'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:31.824093 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f4f63-d1c5-4846-bc34-75d9f348ef51 service neutron] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:31.828682 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-e60f4f63-d1c5-4846-bc34-75d9f348ef51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:31.830175 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5168c0f0-e377-40df-bfc0-2c7cd5a6e454 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d446ab83d4a49aca9f9e6dc5ef2f65a', 'request_id': 'req-5168c0f0-e377-40df-bfc0-2c7cd5a6e454'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:31.877525 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f4f63-d1c5-4846-bc34-75d9f348ef51 service neutron] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:31.904390 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5168c0f0-e377-40df-bfc0-2c7cd5a6e454 admin admin] The token cache is being invalidate because project 0d446ab83d4a49aca9f9e6dc5ef2f65a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:31.906108 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5168c0f0-e377-40df-bfc0-2c7cd5a6e454 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:31.909525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5168c0f0-e377-40df-bfc0-2c7cd5a6e454 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:31.927887 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1113/2202] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:31 2022] DELETE /identity/v3/projects/0d446ab83d4a49aca9f9e6dc5ef2f65a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:31.932169 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168c0f0-e377-40df-bfc0-2c7cd5a6e454 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:31.934687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5168c0f0-e377-40df-bfc0-2c7cd5a6e454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:32.026806 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe40eb3-c4ce-4129-adc7-2638c5c3517a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:32.028534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe40eb3-c4ce-4129-adc7-2638c5c3517a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:32.028997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe40eb3-c4ce-4129-adc7-2638c5c3517a admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:32.029417 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe40eb3-c4ce-4129-adc7-2638c5c3517a admin admin] PATH_INFO: `/v3/users/7cc49be43d034b01b7bfbaf54b4df63b` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:32.033754 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe40eb3-c4ce-4129-adc7-2638c5c3517a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cc49be43d034b01b7bfbaf54b4df63b)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:32.059382 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe40eb3-c4ce-4129-adc7-2638c5c3517a admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:32.187207 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168c0f0-e377-40df-bfc0-2c7cd5a6e454 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:32.196442 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0231da0-0a8a-40e9-b64f-dffa587652a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:32.198661 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0231da0-0a8a-40e9-b64f-dffa587652a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:32.199923 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0231da0-0a8a-40e9-b64f-dffa587652a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:32.200438 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0231da0-0a8a-40e9-b64f-dffa587652a5 admin admin] PATH_INFO: `/v3/users/db6f8783ddb947c5ba6377393760b04a` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:32.215063 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0231da0-0a8a-40e9-b64f-dffa587652a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db6f8783ddb947c5ba6377393760b04a)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:32.219113 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0231da0-0a8a-40e9-b64f-dffa587652a5 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:32.235788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-bfe40eb3-c4ce-4129-adc7-2638c5c3517a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cc49be43d034b01b7bfbaf54b4df63b'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:32.250207 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-bfe40eb3-c4ce-4129-adc7-2638c5c3517a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cc49be43d034b01b7bfbaf54b4df63b'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:32.322024 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-bfe40eb3-c4ce-4129-adc7-2638c5c3517a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cc49be43d034b01b7bfbaf54b4df63b'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:32.323949 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-bfe40eb3-c4ce-4129-adc7-2638c5c3517a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cc49be43d034b01b7bfbaf54b4df63b'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:32.325412 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-bfe40eb3-c4ce-4129-adc7-2638c5c3517a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cc49be43d034b01b7bfbaf54b4df63b'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:32.352130 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1090/2203] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:31 2022] DELETE /identity/v3/users/7cc49be43d034b01b7bfbaf54b4df63b => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:32.358669 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35303685-e476-44c9-9044-a75a7a80056d None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:32.358669 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35303685-e476-44c9-9044-a75a7a80056d None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:32.359100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35303685-e476-44c9-9044-a75a7a80056d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:32.407848 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-35303685-e476-44c9-9044-a75a7a80056d None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:32.417034 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-35303685-e476-44c9-9044-a75a7a80056d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:32.439580 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-c0231da0-0a8a-40e9-b64f-dffa587652a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db6f8783ddb947c5ba6377393760b04a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:32.470943 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:32.517739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-c0231da0-0a8a-40e9-b64f-dffa587652a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db6f8783ddb947c5ba6377393760b04a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:32.519774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1091/2204] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:32.549047 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-c0231da0-0a8a-40e9-b64f-dffa587652a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db6f8783ddb947c5ba6377393760b04a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:32.550229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-c0231da0-0a8a-40e9-b64f-dffa587652a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db6f8783ddb947c5ba6377393760b04a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:32.553983 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-c0231da0-0a8a-40e9-b64f-dffa587652a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db6f8783ddb947c5ba6377393760b04a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:32.599431 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35303685-e476-44c9-9044-a75a7a80056d None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:32.603450 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-35303685-e476-44c9-9044-a75a7a80056d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:32.654344 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1114/2205] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:31 2022] DELETE /identity/v3/users/db6f8783ddb947c5ba6377393760b04a => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:41:32.780628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35303685-e476-44c9-9044-a75a7a80056d None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:32.899765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab33eaa-d151-4365-87b4-ecf0a968ecae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:32.900881 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab33eaa-d151-4365-87b4-ecf0a968ecae service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:32.900881 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab33eaa-d151-4365-87b4-ecf0a968ecae service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:32.901166 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab33eaa-d151-4365-87b4-ecf0a968ecae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:32.903324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-fab33eaa-d151-4365-87b4-ecf0a968ecae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:33.045389 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab33eaa-d151-4365-87b4-ecf0a968ecae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:33.047236 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab33eaa-d151-4365-87b4-ecf0a968ecae service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:33.068754 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1092/2206] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:33.116461 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41c3c5-522d-4f62-96c2-1fcacbbef487 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:33.118049 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41c3c5-522d-4f62-96c2-1fcacbbef487 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:33.118769 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41c3c5-522d-4f62-96c2-1fcacbbef487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:33.174302 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-3b41c3c5-522d-4f62-96c2-1fcacbbef487 None None] MFA Rules not processed for user `0d38cb68bef94e32abccab5f3772a330`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:33.175860 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3b41c3c5-522d-4f62-96c2-1fcacbbef487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:33.245659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:33.276792 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1115/2207] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:33.580058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab33eaa-d151-4365-87b4-ecf0a968ecae service neutron] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:33.582711 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-fab33eaa-d151-4365-87b4-ecf0a968ecae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:33.610423 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab33eaa-d151-4365-87b4-ecf0a968ecae service neutron] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:33.624227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d45b4-20b9-414d-98e1-74527dabb6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:33.625522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d45b4-20b9-414d-98e1-74527dabb6f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:33.626101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d45b4-20b9-414d-98e1-74527dabb6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:33.626655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d45b4-20b9-414d-98e1-74527dabb6f0 admin admin] PATH_INFO: `/v3/projects/d18e934cc5794f708167103e3dd69405` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:33.628930 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d45b4-20b9-414d-98e1-74527dabb6f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d18e934cc5794f708167103e3dd69405)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:33.632531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d45b4-20b9-414d-98e1-74527dabb6f0 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:33.765503 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:33.787958 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-884d45b4-20b9-414d-98e1-74527dabb6f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd18e934cc5794f708167103e3dd69405', 'request_id': 'req-884d45b4-20b9-414d-98e1-74527dabb6f0'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:33.807886 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-884d45b4-20b9-414d-98e1-74527dabb6f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd18e934cc5794f708167103e3dd69405', 'request_id': 'req-884d45b4-20b9-414d-98e1-74527dabb6f0'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:33.847811 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-884d45b4-20b9-414d-98e1-74527dabb6f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd18e934cc5794f708167103e3dd69405', 'request_id': 'req-884d45b4-20b9-414d-98e1-74527dabb6f0'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:33.919537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-884d45b4-20b9-414d-98e1-74527dabb6f0 admin admin] The token cache is being invalidate because project d18e934cc5794f708167103e3dd69405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:33.920246 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-884d45b4-20b9-414d-98e1-74527dabb6f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:33.924608 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-884d45b4-20b9-414d-98e1-74527dabb6f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:33.930812 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1093/2208] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:33 2022] DELETE /identity/v3/projects/d18e934cc5794f708167103e3dd69405 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:33.939241 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff3fd6-12bc-414c-b846-b2d575de0bb9 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:33.945936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff3fd6-12bc-414c-b846-b2d575de0bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:33.946516 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff3fd6-12bc-414c-b846-b2d575de0bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:34.035609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ebff3fd6-12bc-414c-b846-b2d575de0bb9 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:34.037889 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ebff3fd6-12bc-414c-b846-b2d575de0bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:34.404811 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1116/2209] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:34.407307 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1f059-b07a-4b85-af4e-c8cf3d1d7f13 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:34.408534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1f059-b07a-4b85-af4e-c8cf3d1d7f13 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:34.409017 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1f059-b07a-4b85-af4e-c8cf3d1d7f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:34.461865 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff3fd6-12bc-414c-b846-b2d575de0bb9 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:34.464905 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ebff3fd6-12bc-414c-b846-b2d575de0bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:34.484442 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-14c1f059-b07a-4b85-af4e-c8cf3d1d7f13 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:34.487537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-14c1f059-b07a-4b85-af4e-c8cf3d1d7f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:34.518945 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1094/2210] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:34.520228 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1f059-b07a-4b85-af4e-c8cf3d1d7f13 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:34.535930 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff3fd6-12bc-414c-b846-b2d575de0bb9 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:34.550573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1f059-b07a-4b85-af4e-c8cf3d1d7f13 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:34.575067 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008da1f1-7b51-4d1f-a3ff-1169354f53a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:34.576791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008da1f1-7b51-4d1f-a3ff-1169354f53a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:34.578609 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e9ae4-ab77-4cee-89b3-c5ef6e2cc3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:34.579394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e9ae4-ab77-4cee-89b3-c5ef6e2cc3fd admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:34.579777 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e9ae4-ab77-4cee-89b3-c5ef6e2cc3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:34.580975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008da1f1-7b51-4d1f-a3ff-1169354f53a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:34.581281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e9ae4-ab77-4cee-89b3-c5ef6e2cc3fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:34.582203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e9ae4-ab77-4cee-89b3-c5ef6e2cc3fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:41:34.583425 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008da1f1-7b51-4d1f-a3ff-1169354f53a5 admin admin] PATH_INFO: `/v3/projects/f177e758272d4ab198ae8409036d4036` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:34.586820 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e9ae4-ab77-4cee-89b3-c5ef6e2cc3fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:34.592444 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008da1f1-7b51-4d1f-a3ff-1169354f53a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f177e758272d4ab198ae8409036d4036)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:34.593649 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e9ae4-ab77-4cee-89b3-c5ef6e2cc3fd admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:34.602159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008da1f1-7b51-4d1f-a3ff-1169354f53a5 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:34.647716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1095/2211] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:41:34.650985 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e9ae4-ab77-4cee-89b3-c5ef6e2cc3fd admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:34.681027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e9ae4-ab77-4cee-89b3-c5ef6e2cc3fd admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:34.694498 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6418b-07fd-44ee-aea3-965ca8061177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:34.695135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6418b-07fd-44ee-aea3-965ca8061177 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:34.695435 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6418b-07fd-44ee-aea3-965ca8061177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:34.695706 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6418b-07fd-44ee-aea3-965ca8061177 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:34.697702 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6418b-07fd-44ee-aea3-965ca8061177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:34.703046 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6418b-07fd-44ee-aea3-965ca8061177 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:34.737219 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-008da1f1-7b51-4d1f-a3ff-1169354f53a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f177e758272d4ab198ae8409036d4036', 'request_id': 'req-008da1f1-7b51-4d1f-a3ff-1169354f53a5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:34.781992 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-008da1f1-7b51-4d1f-a3ff-1169354f53a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f177e758272d4ab198ae8409036d4036', 'request_id': 'req-008da1f1-7b51-4d1f-a3ff-1169354f53a5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:34.800819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1096/2212] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:34 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:34.804106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6418b-07fd-44ee-aea3-965ca8061177 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:34.811471 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-008da1f1-7b51-4d1f-a3ff-1169354f53a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f177e758272d4ab198ae8409036d4036', 'request_id': 'req-008da1f1-7b51-4d1f-a3ff-1169354f53a5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:34.840821 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-008da1f1-7b51-4d1f-a3ff-1169354f53a5 admin admin] The token cache is being invalidate because project f177e758272d4ab198ae8409036d4036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:34.845213 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-008da1f1-7b51-4d1f-a3ff-1169354f53a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:34.848213 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-008da1f1-7b51-4d1f-a3ff-1169354f53a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:34.858041 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1117/2213] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:34 2022] DELETE /identity/v3/projects/f177e758272d4ab198ae8409036d4036 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:34.858041 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008da1f1-7b51-4d1f-a3ff-1169354f53a5 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:34.861039 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-008da1f1-7b51-4d1f-a3ff-1169354f53a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:35.103654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008da1f1-7b51-4d1f-a3ff-1169354f53a5 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:35.177799 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6418b-07fd-44ee-aea3-965ca8061177 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:35.184080 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab97c1-4ccd-4522-898d-6ed8e8135525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:35.185779 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab97c1-4ccd-4522-898d-6ed8e8135525 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:35.186066 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab97c1-4ccd-4522-898d-6ed8e8135525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:35.186345 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab97c1-4ccd-4522-898d-6ed8e8135525 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:35.187016 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab97c1-4ccd-4522-898d-6ed8e8135525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:35.189526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab97c1-4ccd-4522-898d-6ed8e8135525 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:35.205460 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:35.249005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1097/2214] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:34 2022] POST /identity/v3/users => generated 292 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:35.250220 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab97c1-4ccd-4522-898d-6ed8e8135525 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:35.252857 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-e9ab97c1-4ccd-4522-898d-6ed8e8135525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:35.256804 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e827d4d-9f21-4622-891b-204c6dcb603a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:35.258363 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e827d4d-9f21-4622-891b-204c6dcb603a service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:35.258363 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e827d4d-9f21-4622-891b-204c6dcb603a service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:35.259086 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e827d4d-9f21-4622-891b-204c6dcb603a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:35.266398 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1e827d4d-9f21-4622-891b-204c6dcb603a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:35.273562 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab97c1-4ccd-4522-898d-6ed8e8135525 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:35.286897 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1acfe-b35c-4ebe-906d-2a52d17caa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:35.288893 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1acfe-b35c-4ebe-906d-2a52d17caa97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:35.289394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1acfe-b35c-4ebe-906d-2a52d17caa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:35.289874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1acfe-b35c-4ebe-906d-2a52d17caa97 admin admin] PATH_INFO: `/v3/users/e8694defe59a446fa99ae9b616e487af` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:35.291749 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1acfe-b35c-4ebe-906d-2a52d17caa97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8694defe59a446fa99ae9b616e487af)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:35.295097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1acfe-b35c-4ebe-906d-2a52d17caa97 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:35.437824 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-eaa1acfe-b35c-4ebe-906d-2a52d17caa97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8694defe59a446fa99ae9b616e487af'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:35.451620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e827d4d-9f21-4622-891b-204c6dcb603a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:35.455353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e827d4d-9f21-4622-891b-204c6dcb603a service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:35.468705 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-eaa1acfe-b35c-4ebe-906d-2a52d17caa97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8694defe59a446fa99ae9b616e487af'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:35.477985 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1118/2215] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:35.480374 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e827d4d-9f21-4622-891b-204c6dcb603a service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:35.487050 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1e827d4d-9f21-4622-891b-204c6dcb603a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:35.515448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e827d4d-9f21-4622-891b-204c6dcb603a service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:35.528903 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3c400-214b-4c43-87eb-3f471bd6b55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:35.530280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3c400-214b-4c43-87eb-3f471bd6b55d admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:35.531124 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3c400-214b-4c43-87eb-3f471bd6b55d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:35.531869 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3c400-214b-4c43-87eb-3f471bd6b55d admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:35.536429 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3c400-214b-4c43-87eb-3f471bd6b55d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:35.540709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=82,keystone:DELETE=13,keystone:INSERT=5 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:35.546543 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3c400-214b-4c43-87eb-3f471bd6b55d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:35.546928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-eaa1acfe-b35c-4ebe-906d-2a52d17caa97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8694defe59a446fa99ae9b616e487af'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:35.552155 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-eaa1acfe-b35c-4ebe-906d-2a52d17caa97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8694defe59a446fa99ae9b616e487af'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:35.553549 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-eaa1acfe-b35c-4ebe-906d-2a52d17caa97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8694defe59a446fa99ae9b616e487af'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:35.582589 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1119/2216] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:35.584058 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3c400-214b-4c43-87eb-3f471bd6b55d admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:35.586721 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a4d3c400-214b-4c43-87eb-3f471bd6b55d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:35.593840 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1098/2217] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:35 2022] DELETE /identity/v3/users/e8694defe59a446fa99ae9b616e487af => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:35.630871 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3c400-214b-4c43-87eb-3f471bd6b55d admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:35.825221 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c021a83-9880-4e61-822f-1298e357ea49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:35.826674 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c021a83-9880-4e61-822f-1298e357ea49 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:35.827165 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c021a83-9880-4e61-822f-1298e357ea49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:35.827466 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c021a83-9880-4e61-822f-1298e357ea49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:35.829280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c021a83-9880-4e61-822f-1298e357ea49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:35.832855 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c021a83-9880-4e61-822f-1298e357ea49 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:35.859683 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1120/2218] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:35.865134 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1acfe-b35c-4ebe-906d-2a52d17caa97 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:35.894430 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1acfe-b35c-4ebe-906d-2a52d17caa97 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:35.903050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f51194-7098-4e14-9c5f-d96452170c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:35.904454 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f51194-7098-4e14-9c5f-d96452170c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:35.905016 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f51194-7098-4e14-9c5f-d96452170c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:35.906382 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f51194-7098-4e14-9c5f-d96452170c6b admin admin] PATH_INFO: `/v3/projects/2da2ca6bc1bd4b24a3bc0f4e13767b85/users/23a8132255e7489b9b53e2790301927a/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:35.927667 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f51194-7098-4e14-9c5f-d96452170c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da2ca6bc1bd4b24a3bc0f4e13767b85, user_id=23a8132255e7489b9b53e2790301927a, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:35.931147 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f51194-7098-4e14-9c5f-d96452170c6b admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:35.985299 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1099/2219] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:35 2022] PUT /identity/v3/projects/2da2ca6bc1bd4b24a3bc0f4e13767b85/users/23a8132255e7489b9b53e2790301927a/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:36.008277 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d58f07-8153-4006-a14d-659716676428 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:36.008772 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d58f07-8153-4006-a14d-659716676428 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:36.009220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d58f07-8153-4006-a14d-659716676428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:36.095926 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-a3d58f07-8153-4006-a14d-659716676428 None None] MFA Rules not processed for user `23a8132255e7489b9b53e2790301927a`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:36.098809 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a3d58f07-8153-4006-a14d-659716676428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:36.469718 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1121/2220] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:36.622175 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f51194-7098-4e14-9c5f-d96452170c6b admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:36.624653 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-b3f51194-7098-4e14-9c5f-d96452170c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:36.860604 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f51194-7098-4e14-9c5f-d96452170c6b admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:36.873434 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d58f07-8153-4006-a14d-659716676428 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:36.875859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a3d58f07-8153-4006-a14d-659716676428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:36.876254 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13feff1b-e5fd-4d74-a024-abbc895891e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:36.877628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13feff1b-e5fd-4d74-a024-abbc895891e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:36.878515 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13feff1b-e5fd-4d74-a024-abbc895891e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:36.880721 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13feff1b-e5fd-4d74-a024-abbc895891e7 admin admin] PATH_INFO: `/v3/projects/9ce39f6884c14cae9f256a5001810a7c` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:36.884521 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13feff1b-e5fd-4d74-a024-abbc895891e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ce39f6884c14cae9f256a5001810a7c)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:36.890852 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13feff1b-e5fd-4d74-a024-abbc895891e7 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:36.943096 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:37.128682 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-13feff1b-e5fd-4d74-a024-abbc895891e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ce39f6884c14cae9f256a5001810a7c', 'request_id': 'req-13feff1b-e5fd-4d74-a024-abbc895891e7'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:37.191202 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-13feff1b-e5fd-4d74-a024-abbc895891e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ce39f6884c14cae9f256a5001810a7c', 'request_id': 'req-13feff1b-e5fd-4d74-a024-abbc895891e7'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:37.201075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d58f07-8153-4006-a14d-659716676428 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:37.236060 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-13feff1b-e5fd-4d74-a024-abbc895891e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ce39f6884c14cae9f256a5001810a7c', 'request_id': 'req-13feff1b-e5fd-4d74-a024-abbc895891e7'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:37.278453 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-13feff1b-e5fd-4d74-a024-abbc895891e7 admin admin] The token cache is being invalidate because project 9ce39f6884c14cae9f256a5001810a7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:37.281193 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-13feff1b-e5fd-4d74-a024-abbc895891e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:37.282771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-13feff1b-e5fd-4d74-a024-abbc895891e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:37.285835 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1100/2221] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:36 2022] DELETE /identity/v3/projects/9ce39f6884c14cae9f256a5001810a7c => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:37.293433 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13feff1b-e5fd-4d74-a024-abbc895891e7 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:37.301697 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-13feff1b-e5fd-4d74-a024-abbc895891e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:37.474965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:37.482581 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8989007-51a6-4fe1-a930-05a5fc4aa8f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:37.483436 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13feff1b-e5fd-4d74-a024-abbc895891e7 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:37.483708 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8989007-51a6-4fe1-a930-05a5fc4aa8f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:37.484569 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8989007-51a6-4fe1-a930-05a5fc4aa8f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:37.484569 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8989007-51a6-4fe1-a930-05a5fc4aa8f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:37.490972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d47f5-c6f4-440c-8c98-b3964e33ed5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:37.491844 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d47f5-c6f4-440c-8c98-b3964e33ed5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:37.493379 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d47f5-c6f4-440c-8c98-b3964e33ed5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:37.493379 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d47f5-c6f4-440c-8c98-b3964e33ed5c admin admin] PATH_INFO: `/v3/users/01b76ed1efa34b25a1e0cc846af83d8c` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:37.493860 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f8989007-51a6-4fe1-a930-05a5fc4aa8f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:37.495185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d47f5-c6f4-440c-8c98-b3964e33ed5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=01b76ed1efa34b25a1e0cc846af83d8c)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:37.497521 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d47f5-c6f4-440c-8c98-b3964e33ed5c admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:37.638217 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8989007-51a6-4fe1-a930-05a5fc4aa8f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:37.640008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8989007-51a6-4fe1-a930-05a5fc4aa8f9 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:37.655890 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1122/2222] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 784 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:37.709811 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8989007-51a6-4fe1-a930-05a5fc4aa8f9 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:37.711932 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f8989007-51a6-4fe1-a930-05a5fc4aa8f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:37.742952 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-2e7d47f5-c6f4-440c-8c98-b3964e33ed5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01b76ed1efa34b25a1e0cc846af83d8c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:37.751557 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8989007-51a6-4fe1-a930-05a5fc4aa8f9 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:37.759998 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-2e7d47f5-c6f4-440c-8c98-b3964e33ed5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01b76ed1efa34b25a1e0cc846af83d8c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:37.760387 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6caa7-6e9e-4747-844d-792d912a740c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:37.761229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6caa7-6e9e-4747-844d-792d912a740c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:37.761666 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6caa7-6e9e-4747-844d-792d912a740c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:37.762485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6caa7-6e9e-4747-844d-792d912a740c admin admin] PATH_INFO: `/v3/users/23a8132255e7489b9b53e2790301927a` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:37.764093 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6caa7-6e9e-4747-844d-792d912a740c admin admin] RBAC: Authorizing `identity:delete_user(user_id=23a8132255e7489b9b53e2790301927a)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:37.766754 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6caa7-6e9e-4747-844d-792d912a740c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:37.818747 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-2e7d47f5-c6f4-440c-8c98-b3964e33ed5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01b76ed1efa34b25a1e0cc846af83d8c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:37.824797 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-2e7d47f5-c6f4-440c-8c98-b3964e33ed5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01b76ed1efa34b25a1e0cc846af83d8c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:37.827990 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-2e7d47f5-c6f4-440c-8c98-b3964e33ed5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01b76ed1efa34b25a1e0cc846af83d8c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:37.871498 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1101/2223] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:37 2022] DELETE /identity/v3/users/01b76ed1efa34b25a1e0cc846af83d8c => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:37.926409 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1da6caa7-6e9e-4747-844d-792d912a740c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23a8132255e7489b9b53e2790301927a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:37.944942 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1da6caa7-6e9e-4747-844d-792d912a740c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23a8132255e7489b9b53e2790301927a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:37.959464 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1da6caa7-6e9e-4747-844d-792d912a740c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23a8132255e7489b9b53e2790301927a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:37.962792 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1da6caa7-6e9e-4747-844d-792d912a740c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23a8132255e7489b9b53e2790301927a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:37.964243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1da6caa7-6e9e-4747-844d-792d912a740c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23a8132255e7489b9b53e2790301927a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:37.982245 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:38.019492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3363cca-29e7-4ec2-960c-ec2901c98cbd None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:38.020416 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3363cca-29e7-4ec2-960c-ec2901c98cbd None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:38.021293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3363cca-29e7-4ec2-960c-ec2901c98cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:38.028272 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1123/2224] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:37 2022] DELETE /identity/v3/users/23a8132255e7489b9b53e2790301927a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:41:38.081517 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-b3363cca-29e7-4ec2-960c-ec2901c98cbd None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:38.083150 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-b3363cca-29e7-4ec2-960c-ec2901c98cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:38.195731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1102/2225] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:38.211665 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6caa7-6e9e-4747-844d-792d912a740c admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:38.213293 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1da6caa7-6e9e-4747-844d-792d912a740c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:38.374221 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6caa7-6e9e-4747-844d-792d912a740c admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:38.381697 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68446978-3f3d-43ee-87c6-4c075f83b11b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:38.382787 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68446978-3f3d-43ee-87c6-4c075f83b11b service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:38.383272 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68446978-3f3d-43ee-87c6-4c075f83b11b service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:38.383735 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68446978-3f3d-43ee-87c6-4c075f83b11b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:38.420375 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68446978-3f3d-43ee-87c6-4c075f83b11b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:38.429807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68446978-3f3d-43ee-87c6-4c075f83b11b service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:38.443479 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1124/2226] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:38.506926 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3363cca-29e7-4ec2-960c-ec2901c98cbd None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:38.508663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-b3363cca-29e7-4ec2-960c-ec2901c98cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:38.530558 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3363cca-29e7-4ec2-960c-ec2901c98cbd None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:38.555417 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56020ef6-e0f6-44c7-97e8-935eb438ff2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:38.556586 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56020ef6-e0f6-44c7-97e8-935eb438ff2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:38.556988 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56020ef6-e0f6-44c7-97e8-935eb438ff2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:38.557457 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56020ef6-e0f6-44c7-97e8-935eb438ff2d admin admin] PATH_INFO: `/v3/projects/3f45420eef234e6c9a996c7cf2b866ab` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:38.561476 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56020ef6-e0f6-44c7-97e8-935eb438ff2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f45420eef234e6c9a996c7cf2b866ab)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:38.565932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56020ef6-e0f6-44c7-97e8-935eb438ff2d admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:38.700251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-56020ef6-e0f6-44c7-97e8-935eb438ff2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f45420eef234e6c9a996c7cf2b866ab', 'request_id': 'req-56020ef6-e0f6-44c7-97e8-935eb438ff2d'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:38.734132 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-56020ef6-e0f6-44c7-97e8-935eb438ff2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f45420eef234e6c9a996c7cf2b866ab', 'request_id': 'req-56020ef6-e0f6-44c7-97e8-935eb438ff2d'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:38.770568 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-56020ef6-e0f6-44c7-97e8-935eb438ff2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f45420eef234e6c9a996c7cf2b866ab', 'request_id': 'req-56020ef6-e0f6-44c7-97e8-935eb438ff2d'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:38.797149 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:38.820033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-56020ef6-e0f6-44c7-97e8-935eb438ff2d admin admin] The token cache is being invalidate because project 3f45420eef234e6c9a996c7cf2b866ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:38.822830 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-56020ef6-e0f6-44c7-97e8-935eb438ff2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:38.824582 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-56020ef6-e0f6-44c7-97e8-935eb438ff2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:38.832688 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1103/2227] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:38 2022] DELETE /identity/v3/projects/3f45420eef234e6c9a996c7cf2b866ab => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:38.842379 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcfbd5-a339-42b5-93ee-b315f98abc7f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:38.843436 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcfbd5-a339-42b5-93ee-b315f98abc7f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:38.843933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcfbd5-a339-42b5-93ee-b315f98abc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:38.901178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f6dcfbd5-a339-42b5-93ee-b315f98abc7f None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:38.903315 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f6dcfbd5-a339-42b5-93ee-b315f98abc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:39.020373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1125/2228] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:39.031227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a793314-8d9a-49c9-8487-6e5bdb9e60f9 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:39.031525 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a793314-8d9a-49c9-8487-6e5bdb9e60f9 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:39.031818 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a793314-8d9a-49c9-8487-6e5bdb9e60f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:39.075709 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcfbd5-a339-42b5-93ee-b315f98abc7f None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:39.078996 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f6dcfbd5-a339-42b5-93ee-b315f98abc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:39.089939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-2a793314-8d9a-49c9-8487-6e5bdb9e60f9 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:39.096347 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-2a793314-8d9a-49c9-8487-6e5bdb9e60f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:39.114680 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcfbd5-a339-42b5-93ee-b315f98abc7f None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:39.130599 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98068b0-6300-406f-ac9b-e112d7b0963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:39.131336 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98068b0-6300-406f-ac9b-e112d7b0963a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:39.132659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98068b0-6300-406f-ac9b-e112d7b0963a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:39.135031 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98068b0-6300-406f-ac9b-e112d7b0963a admin admin] PATH_INFO: `/v3/projects/2da2ca6bc1bd4b24a3bc0f4e13767b85` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:39.137587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1104/2229] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:39.138299 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98068b0-6300-406f-ac9b-e112d7b0963a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2da2ca6bc1bd4b24a3bc0f4e13767b85)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:39.141472 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98068b0-6300-406f-ac9b-e112d7b0963a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:39.144311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a793314-8d9a-49c9-8487-6e5bdb9e60f9 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:39.161077 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a793314-8d9a-49c9-8487-6e5bdb9e60f9 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:39.168955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afecf2-cd74-4b99-91bd-35410f53fed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:39.169799 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afecf2-cd74-4b99-91bd-35410f53fed9 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:39.170659 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afecf2-cd74-4b99-91bd-35410f53fed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:39.170659 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afecf2-cd74-4b99-91bd-35410f53fed9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:39.171407 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afecf2-cd74-4b99-91bd-35410f53fed9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:41:39.172039 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afecf2-cd74-4b99-91bd-35410f53fed9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:39.173950 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afecf2-cd74-4b99-91bd-35410f53fed9 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:39.238354 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1105/2230] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:41:39.246100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afecf2-cd74-4b99-91bd-35410f53fed9 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:39.268713 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d98068b0-6300-406f-ac9b-e112d7b0963a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2da2ca6bc1bd4b24a3bc0f4e13767b85', 'request_id': 'req-d98068b0-6300-406f-ac9b-e112d7b0963a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:39.280555 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afecf2-cd74-4b99-91bd-35410f53fed9 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:39.282209 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d98068b0-6300-406f-ac9b-e112d7b0963a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2da2ca6bc1bd4b24a3bc0f4e13767b85', 'request_id': 'req-d98068b0-6300-406f-ac9b-e112d7b0963a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:39.295796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d98068b0-6300-406f-ac9b-e112d7b0963a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2da2ca6bc1bd4b24a3bc0f4e13767b85', 'request_id': 'req-d98068b0-6300-406f-ac9b-e112d7b0963a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:39.327339 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d98068b0-6300-406f-ac9b-e112d7b0963a admin admin] The token cache is being invalidate because project 2da2ca6bc1bd4b24a3bc0f4e13767b85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:39.329315 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d98068b0-6300-406f-ac9b-e112d7b0963a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:39.330910 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d98068b0-6300-406f-ac9b-e112d7b0963a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:39.342641 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1126/2231] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:39 2022] DELETE /identity/v3/projects/2da2ca6bc1bd4b24a3bc0f4e13767b85 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:39.346298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37204038-1246-44ba-b922-d3487f5e2ff5 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:39.346559 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37204038-1246-44ba-b922-d3487f5e2ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:39.347041 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37204038-1246-44ba-b922-d3487f5e2ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:39.417660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-37204038-1246-44ba-b922-d3487f5e2ff5 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:39.423997 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-37204038-1246-44ba-b922-d3487f5e2ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:39.450741 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:39.459888 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d031fce-4023-4698-bc07-dd90b22cf961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:39.460243 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d031fce-4023-4698-bc07-dd90b22cf961 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:39.460717 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d031fce-4023-4698-bc07-dd90b22cf961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:39.471041 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d031fce-4023-4698-bc07-dd90b22cf961 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:39.472340 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d031fce-4023-4698-bc07-dd90b22cf961 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:39.479795 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d031fce-4023-4698-bc07-dd90b22cf961 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:39.569682 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1106/2232] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:39 2022] POST /identity/v3/projects => generated 375 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:39.569682 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d031fce-4023-4698-bc07-dd90b22cf961 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:39.573167 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-4d031fce-4023-4698-bc07-dd90b22cf961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:39.686400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1127/2233] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:41:39.703253 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebde6b-d070-4d09-b583-0d4d187ce84f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:39.703810 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebde6b-d070-4d09-b583-0d4d187ce84f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:39.705971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebde6b-d070-4d09-b583-0d4d187ce84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:39.796288 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-97ebde6b-d070-4d09-b583-0d4d187ce84f None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:39.799737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-97ebde6b-d070-4d09-b583-0d4d187ce84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:39.892279 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d031fce-4023-4698-bc07-dd90b22cf961 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:39.921038 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd5d6f-415b-49ff-84b2-9cab19ffaeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:39.922090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd5d6f-415b-49ff-84b2-9cab19ffaeda admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:39.922571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd5d6f-415b-49ff-84b2-9cab19ffaeda admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:39.923062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd5d6f-415b-49ff-84b2-9cab19ffaeda admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:39.930887 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd5d6f-415b-49ff-84b2-9cab19ffaeda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:39.934477 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd5d6f-415b-49ff-84b2-9cab19ffaeda admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:40.062694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1107/2234] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:39 2022] POST /identity/v3/users => generated 288 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:40.067797 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd5d6f-415b-49ff-84b2-9cab19ffaeda admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:40.111100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd5d6f-415b-49ff-84b2-9cab19ffaeda admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:40.121351 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4c289-073b-4bae-a702-65a4697e5c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:40.133520 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4c289-073b-4bae-a702-65a4697e5c88 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:40.134011 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4c289-073b-4bae-a702-65a4697e5c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:40.134503 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4c289-073b-4bae-a702-65a4697e5c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:40.136042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4c289-073b-4bae-a702-65a4697e5c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:40.141727 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4c289-073b-4bae-a702-65a4697e5c88 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:40.172568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1128/2235] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:40.182124 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebde6b-d070-4d09-b583-0d4d187ce84f None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:40.190726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1108/2236] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:40.193006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4c289-073b-4bae-a702-65a4697e5c88 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:40.218050 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebde6b-d070-4d09-b583-0d4d187ce84f None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:40.228953 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4c289-073b-4bae-a702-65a4697e5c88 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:40.240913 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e68965-e93b-461e-8314-29023094950d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:40.241876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e68965-e93b-461e-8314-29023094950d admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:40.242523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e68965-e93b-461e-8314-29023094950d admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:40.242939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e68965-e93b-461e-8314-29023094950d admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:40.244351 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e68965-e93b-461e-8314-29023094950d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:40.249581 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e68965-e93b-461e-8314-29023094950d admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:40.270075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62533526-4c78-45db-87d0-5d1abd4abed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:40.277206 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1109/2237] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:40.277470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62533526-4c78-45db-87d0-5d1abd4abed0 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:40.277470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62533526-4c78-45db-87d0-5d1abd4abed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:40.277470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62533526-4c78-45db-87d0-5d1abd4abed0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:40.277470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62533526-4c78-45db-87d0-5d1abd4abed0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:41:40.277470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62533526-4c78-45db-87d0-5d1abd4abed0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:40.279941 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e68965-e93b-461e-8314-29023094950d admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:40.287603 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62533526-4c78-45db-87d0-5d1abd4abed0 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:40.323358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e68965-e93b-461e-8314-29023094950d admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:40.328798 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1129/2238] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:41:40.339015 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62533526-4c78-45db-87d0-5d1abd4abed0 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:40.342656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b227dca-d18a-49b4-aca6-6fd8b33f2614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:40.344855 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b227dca-d18a-49b4-aca6-6fd8b33f2614 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:40.346500 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b227dca-d18a-49b4-aca6-6fd8b33f2614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:40.347088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b227dca-d18a-49b4-aca6-6fd8b33f2614 admin admin] PATH_INFO: `/v3/projects/69895086e7ec427bbc28ac8239dd7e3e/users/1c27ab036e7145b897c3387255b07e31/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:40.428213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b227dca-d18a-49b4-aca6-6fd8b33f2614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69895086e7ec427bbc28ac8239dd7e3e, user_id=1c27ab036e7145b897c3387255b07e31, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:40.428550 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62533526-4c78-45db-87d0-5d1abd4abed0 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:40.433607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b227dca-d18a-49b4-aca6-6fd8b33f2614 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:40.465122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72490308-b7bb-4271-81a5-09626074a082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:40.466135 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72490308-b7bb-4271-81a5-09626074a082 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:40.466617 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72490308-b7bb-4271-81a5-09626074a082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:40.467088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72490308-b7bb-4271-81a5-09626074a082 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:40.480624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72490308-b7bb-4271-81a5-09626074a082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:40.503219 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72490308-b7bb-4271-81a5-09626074a082 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:40.523698 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1110/2239] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:40 2022] PUT /identity/v3/projects/69895086e7ec427bbc28ac8239dd7e3e/users/1c27ab036e7145b897c3387255b07e31/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:40.548437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902f20b-86be-4842-aa2a-6403ca453f83 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:40.549643 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902f20b-86be-4842-aa2a-6403ca453f83 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:40.549643 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902f20b-86be-4842-aa2a-6403ca453f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:40.570570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1130/2240] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:40 2022] POST /identity/v3/projects => generated 361 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:40.572252 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72490308-b7bb-4271-81a5-09626074a082 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:40.598677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:40.650345 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-0902f20b-86be-4842-aa2a-6403ca453f83 None None] MFA Rules not processed for user `1c27ab036e7145b897c3387255b07e31`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:40.652665 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-0902f20b-86be-4842-aa2a-6403ca453f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:40.740554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72490308-b7bb-4271-81a5-09626074a082 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:40.753922 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a221c-3118-4f37-9732-e56b7eec3503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:40.755872 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a221c-3118-4f37-9732-e56b7eec3503 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:40.757544 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a221c-3118-4f37-9732-e56b7eec3503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:40.758391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a221c-3118-4f37-9732-e56b7eec3503 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:40.759858 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a221c-3118-4f37-9732-e56b7eec3503 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:40.765474 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a221c-3118-4f37-9732-e56b7eec3503 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:40.817925 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1131/2241] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:40 2022] POST /identity/v3/users => generated 281 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:40.820581 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a221c-3118-4f37-9732-e56b7eec3503 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:40.823412 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-602a221c-3118-4f37-9732-e56b7eec3503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:40.830479 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1111/2242] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:40.832088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902f20b-86be-4842-aa2a-6403ca453f83 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:40.852723 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a221c-3118-4f37-9732-e56b7eec3503 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:40.862471 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902f20b-86be-4842-aa2a-6403ca453f83 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:40.864565 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a49b0-4358-4eab-b47a-b03ebbaac589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:40.865737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a49b0-4358-4eab-b47a-b03ebbaac589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:40.866941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a49b0-4358-4eab-b47a-b03ebbaac589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:40.867672 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a49b0-4358-4eab-b47a-b03ebbaac589 admin admin] PATH_INFO: `/v3/users/897d281a31c342028b32a4b85496f29a` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:40.869922 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a49b0-4358-4eab-b47a-b03ebbaac589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=897d281a31c342028b32a4b85496f29a)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:40.874135 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a49b0-4358-4eab-b47a-b03ebbaac589 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:40.876325 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90f424-fceb-4861-ad49-60e187597168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:40.877944 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90f424-fceb-4861-ad49-60e187597168 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:40.878522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90f424-fceb-4861-ad49-60e187597168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:40.879168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90f424-fceb-4861-ad49-60e187597168 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:40.882579 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a90f424-fceb-4861-ad49-60e187597168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:40.885895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:40.887776 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a90f424-fceb-4861-ad49-60e187597168 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:40.948845 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1112/2243] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:40.950079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90f424-fceb-4861-ad49-60e187597168 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:40.953714 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-8a90f424-fceb-4861-ad49-60e187597168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:41.034711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bd0a49b0-4358-4eab-b47a-b03ebbaac589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '897d281a31c342028b32a4b85496f29a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:41.058831 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bd0a49b0-4358-4eab-b47a-b03ebbaac589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '897d281a31c342028b32a4b85496f29a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:41.090338 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bd0a49b0-4358-4eab-b47a-b03ebbaac589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '897d281a31c342028b32a4b85496f29a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:41.091831 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bd0a49b0-4358-4eab-b47a-b03ebbaac589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '897d281a31c342028b32a4b85496f29a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:41.093009 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bd0a49b0-4358-4eab-b47a-b03ebbaac589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '897d281a31c342028b32a4b85496f29a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:41.171844 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90f424-fceb-4861-ad49-60e187597168 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:41.188620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1132/2244] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:40 2022] DELETE /identity/v3/users/897d281a31c342028b32a4b85496f29a => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:41.189669 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a49b0-4358-4eab-b47a-b03ebbaac589 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:41.191824 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-bd0a49b0-4358-4eab-b47a-b03ebbaac589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:41.193638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eafafc5-ca85-4213-b87f-78424a3638e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:41.194317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafafc5-ca85-4213-b87f-78424a3638e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:41.194601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafafc5-ca85-4213-b87f-78424a3638e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:41.194906 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafafc5-ca85-4213-b87f-78424a3638e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:41.201854 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-4eafafc5-ca85-4213-b87f-78424a3638e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:41.231140 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eafafc5-ca85-4213-b87f-78424a3638e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:41.234526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eafafc5-ca85-4213-b87f-78424a3638e7 service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:41.254849 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1113/2245] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:41.257764 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4862b32-10f6-47ef-98dc-27224715ed60 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:41.258261 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4862b32-10f6-47ef-98dc-27224715ed60 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:41.258779 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4862b32-10f6-47ef-98dc-27224715ed60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:41.296784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-e4862b32-10f6-47ef-98dc-27224715ed60 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:41.299556 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-e4862b32-10f6-47ef-98dc-27224715ed60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:41.328700 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a49b0-4358-4eab-b47a-b03ebbaac589 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:41.341162 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc3d66-bcf1-499a-8962-9122fb3fbee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:41.342361 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc3d66-bcf1-499a-8962-9122fb3fbee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:41.342837 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc3d66-bcf1-499a-8962-9122fb3fbee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:41.343294 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc3d66-bcf1-499a-8962-9122fb3fbee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:41.345631 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc3d66-bcf1-499a-8962-9122fb3fbee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:41.348820 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc3d66-bcf1-499a-8962-9122fb3fbee4 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:41.384460 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1133/2246] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:41.386593 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc3d66-bcf1-499a-8962-9122fb3fbee4 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:41.412234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1114/2247] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:41.421325 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc3d66-bcf1-499a-8962-9122fb3fbee4 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:41.427395 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4862b32-10f6-47ef-98dc-27224715ed60 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:41.431322 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b738b6-fe72-438d-8368-7563154cfa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:41.431641 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-e4862b32-10f6-47ef-98dc-27224715ed60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:41.433433 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b738b6-fe72-438d-8368-7563154cfa58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:41.434251 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b738b6-fe72-438d-8368-7563154cfa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:41.434746 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b738b6-fe72-438d-8368-7563154cfa58 admin admin] PATH_INFO: `/v3/projects/d769b99269a848e0ae3740b131ee9aed/users/48d52db7c1b64246a28edfdf7358cd49/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:41.473416 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b738b6-fe72-438d-8368-7563154cfa58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d769b99269a848e0ae3740b131ee9aed, user_id=48d52db7c1b64246a28edfdf7358cd49, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:41.478620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b738b6-fe72-438d-8368-7563154cfa58 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:41.497094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:41.513883 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1134/2248] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:41 2022] PUT /identity/v3/projects/d769b99269a848e0ae3740b131ee9aed/users/48d52db7c1b64246a28edfdf7358cd49/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:41.537771 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27631753-fab7-4f03-8f55-57dba25b7684 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:41.537771 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27631753-fab7-4f03-8f55-57dba25b7684 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:41.537771 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27631753-fab7-4f03-8f55-57dba25b7684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:41.583864 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4862b32-10f6-47ef-98dc-27224715ed60 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:41.626473 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-27631753-fab7-4f03-8f55-57dba25b7684 None None] MFA Rules not processed for user `48d52db7c1b64246a28edfdf7358cd49`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:41.628974 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-27631753-fab7-4f03-8f55-57dba25b7684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:41.695169 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2810ee-8654-4579-9c21-7177b6858fa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:41.696019 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2810ee-8654-4579-9c21-7177b6858fa5 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:41.696443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2810ee-8654-4579-9c21-7177b6858fa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:41.696839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2810ee-8654-4579-9c21-7177b6858fa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:41.749849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:41.818391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1135/2249] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:41.880286 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27631753-fab7-4f03-8f55-57dba25b7684 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:41.883142 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-27631753-fab7-4f03-8f55-57dba25b7684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:41.906958 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2810ee-8654-4579-9c21-7177b6858fa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:41.909891 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2810ee-8654-4579-9c21-7177b6858fa5 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:41.933038 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1115/2250] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:41:41.993143 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27631753-fab7-4f03-8f55-57dba25b7684 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:41.999493 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9132e-ed02-408a-a832-b936b8555ae0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:42.000137 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9132e-ed02-408a-a832-b936b8555ae0 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:42.000435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9132e-ed02-408a-a832-b936b8555ae0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:42.000711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9132e-ed02-408a-a832-b936b8555ae0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:42.012658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9132e-ed02-408a-a832-b936b8555ae0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:42.019283 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9132e-ed02-408a-a832-b936b8555ae0 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:42.037602 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1136/2251] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:41:42.064302 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2810ee-8654-4579-9c21-7177b6858fa5 service neutron] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:42.083501 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2810ee-8654-4579-9c21-7177b6858fa5 service neutron] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:42.092317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf0bfd-cf4b-4bbf-9a17-35d0bae91b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:42.093543 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf0bfd-cf4b-4bbf-9a17-35d0bae91b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:42.094121 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf0bfd-cf4b-4bbf-9a17-35d0bae91b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:42.094696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf0bfd-cf4b-4bbf-9a17-35d0bae91b03 admin admin] PATH_INFO: `/v3/users/48d52db7c1b64246a28edfdf7358cd49` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:42.097002 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf0bfd-cf4b-4bbf-9a17-35d0bae91b03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48d52db7c1b64246a28edfdf7358cd49)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:42.101415 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf0bfd-cf4b-4bbf-9a17-35d0bae91b03 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:42.238803 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-ddcf0bfd-cf4b-4bbf-9a17-35d0bae91b03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48d52db7c1b64246a28edfdf7358cd49'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:42.260403 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-ddcf0bfd-cf4b-4bbf-9a17-35d0bae91b03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48d52db7c1b64246a28edfdf7358cd49'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:42.315414 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-ddcf0bfd-cf4b-4bbf-9a17-35d0bae91b03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48d52db7c1b64246a28edfdf7358cd49'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:42.316554 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-ddcf0bfd-cf4b-4bbf-9a17-35d0bae91b03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48d52db7c1b64246a28edfdf7358cd49'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:42.317406 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-ddcf0bfd-cf4b-4bbf-9a17-35d0bae91b03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48d52db7c1b64246a28edfdf7358cd49'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:42.360793 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1116/2252] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:42 2022] DELETE /identity/v3/users/48d52db7c1b64246a28edfdf7358cd49 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:42.368447 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04c855-9bdc-4a00-87ff-dfb23c240cf7 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:42.369197 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04c855-9bdc-4a00-87ff-dfb23c240cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:42.369197 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04c855-9bdc-4a00-87ff-dfb23c240cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:42.409946 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-cd04c855-9bdc-4a00-87ff-dfb23c240cf7 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:42.410919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cd04c855-9bdc-4a00-87ff-dfb23c240cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:42.594236 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1137/2253] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:42.616790 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf0bfd-cf4b-4bbf-9a17-35d0bae91b03 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:42.619194 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-ddcf0bfd-cf4b-4bbf-9a17-35d0bae91b03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:42.659980 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:42.751621 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04c855-9bdc-4a00-87ff-dfb23c240cf7 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:42.754392 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cd04c855-9bdc-4a00-87ff-dfb23c240cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:42.793405 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf0bfd-cf4b-4bbf-9a17-35d0bae91b03 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:42.800079 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04c855-9bdc-4a00-87ff-dfb23c240cf7 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:42.801297 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fdba8-f86c-457c-9feb-66ec21662c24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:42.802622 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fdba8-f86c-457c-9feb-66ec21662c24 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:42.803050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fdba8-f86c-457c-9feb-66ec21662c24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:42.803557 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fdba8-f86c-457c-9feb-66ec21662c24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:42.822779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d47983-be42-4312-8c6f-0a84785be08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:42.823443 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d47983-be42-4312-8c6f-0a84785be08a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:42.823932 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d47983-be42-4312-8c6f-0a84785be08a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:42.824400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d47983-be42-4312-8c6f-0a84785be08a admin admin] PATH_INFO: `/v3/projects/ce1c51d1085145ea8d2aff4ef0bba5f0` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:42.826469 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d47983-be42-4312-8c6f-0a84785be08a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce1c51d1085145ea8d2aff4ef0bba5f0)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:42.829682 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d47983-be42-4312-8c6f-0a84785be08a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:42.844551 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fdba8-f86c-457c-9feb-66ec21662c24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:42.846914 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fdba8-f86c-457c-9feb-66ec21662c24 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:42.867254 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1117/2254] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:42.965814 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-45d47983-be42-4312-8c6f-0a84785be08a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce1c51d1085145ea8d2aff4ef0bba5f0', 'request_id': 'req-45d47983-be42-4312-8c6f-0a84785be08a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:42.974612 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-45d47983-be42-4312-8c6f-0a84785be08a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce1c51d1085145ea8d2aff4ef0bba5f0', 'request_id': 'req-45d47983-be42-4312-8c6f-0a84785be08a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:42.985127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-45d47983-be42-4312-8c6f-0a84785be08a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce1c51d1085145ea8d2aff4ef0bba5f0', 'request_id': 'req-45d47983-be42-4312-8c6f-0a84785be08a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:43.014330 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-45d47983-be42-4312-8c6f-0a84785be08a admin admin] The token cache is being invalidate because project ce1c51d1085145ea8d2aff4ef0bba5f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:43.014615 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-45d47983-be42-4312-8c6f-0a84785be08a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:43.016576 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-45d47983-be42-4312-8c6f-0a84785be08a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:43.019232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1138/2255] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:42 2022] DELETE /identity/v3/projects/ce1c51d1085145ea8d2aff4ef0bba5f0 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:41:43.025253 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fdba8-f86c-457c-9feb-66ec21662c24 service neutron] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:43.047136 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fdba8-f86c-457c-9feb-66ec21662c24 service neutron] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:43.227888 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4883ac-f73a-4f82-8f9f-d64a4e219b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:43.230663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4883ac-f73a-4f82-8f9f-d64a4e219b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:43.238558 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4883ac-f73a-4f82-8f9f-d64a4e219b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:43.238558 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4883ac-f73a-4f82-8f9f-d64a4e219b0f admin admin] PATH_INFO: `/v3/users/6faee4f676654db98140bfe6c1f3f698` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:43.240213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4883ac-f73a-4f82-8f9f-d64a4e219b0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6faee4f676654db98140bfe6c1f3f698)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:43.245671 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4883ac-f73a-4f82-8f9f-d64a4e219b0f admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:43.422951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-3a4883ac-f73a-4f82-8f9f-d64a4e219b0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6faee4f676654db98140bfe6c1f3f698'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:43.450490 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-3a4883ac-f73a-4f82-8f9f-d64a4e219b0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6faee4f676654db98140bfe6c1f3f698'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:43.512153 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-3a4883ac-f73a-4f82-8f9f-d64a4e219b0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6faee4f676654db98140bfe6c1f3f698'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:43.513801 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-3a4883ac-f73a-4f82-8f9f-d64a4e219b0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6faee4f676654db98140bfe6c1f3f698'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:43.514903 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-3a4883ac-f73a-4f82-8f9f-d64a4e219b0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6faee4f676654db98140bfe6c1f3f698'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:43.559668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1118/2256] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:43 2022] DELETE /identity/v3/users/6faee4f676654db98140bfe6c1f3f698 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:43.767516 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d47983-be42-4312-8c6f-0a84785be08a admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:43.771330 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-45d47983-be42-4312-8c6f-0a84785be08a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:43.865533 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d47983-be42-4312-8c6f-0a84785be08a admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:43.896947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:44.100422 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b2504-14f3-4fc5-97a7-2a4d3c3201e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:44.102575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b2504-14f3-4fc5-97a7-2a4d3c3201e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:44.103089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b2504-14f3-4fc5-97a7-2a4d3c3201e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:44.103578 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b2504-14f3-4fc5-97a7-2a4d3c3201e7 admin admin] PATH_INFO: `/v3/projects/d769b99269a848e0ae3740b131ee9aed` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:44.106073 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b2504-14f3-4fc5-97a7-2a4d3c3201e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d769b99269a848e0ae3740b131ee9aed)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:44.109887 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b2504-14f3-4fc5-97a7-2a4d3c3201e7 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:44.272092 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2a6b2504-14f3-4fc5-97a7-2a4d3c3201e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd769b99269a848e0ae3740b131ee9aed', 'request_id': 'req-2a6b2504-14f3-4fc5-97a7-2a4d3c3201e7'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:44.291537 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2a6b2504-14f3-4fc5-97a7-2a4d3c3201e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd769b99269a848e0ae3740b131ee9aed', 'request_id': 'req-2a6b2504-14f3-4fc5-97a7-2a4d3c3201e7'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:44.307031 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4883ac-f73a-4f82-8f9f-d64a4e219b0f admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:44.309095 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2a6b2504-14f3-4fc5-97a7-2a4d3c3201e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd769b99269a848e0ae3740b131ee9aed', 'request_id': 'req-2a6b2504-14f3-4fc5-97a7-2a4d3c3201e7'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:44.310317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-3a4883ac-f73a-4f82-8f9f-d64a4e219b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:44.349452 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2a6b2504-14f3-4fc5-97a7-2a4d3c3201e7 admin admin] The token cache is being invalidate because project d769b99269a848e0ae3740b131ee9aed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:44.350106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2a6b2504-14f3-4fc5-97a7-2a4d3c3201e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:44.351787 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-2a6b2504-14f3-4fc5-97a7-2a4d3c3201e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:44.370381 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1139/2257] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:43 2022] DELETE /identity/v3/projects/d769b99269a848e0ae3740b131ee9aed => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:44.378946 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a18b6-23eb-44c4-aef6-92f380734096 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:44.379930 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a18b6-23eb-44c4-aef6-92f380734096 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:44.380441 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a18b6-23eb-44c4-aef6-92f380734096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:44.414156 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4883ac-f73a-4f82-8f9f-d64a4e219b0f admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:44.505383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-569a18b6-23eb-44c4-aef6-92f380734096 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:44.509279 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-569a18b6-23eb-44c4-aef6-92f380734096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:44.576713 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:44.699171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f800d-8977-43f8-831f-29d63f499977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:44.699819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f800d-8977-43f8-831f-29d63f499977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:44.700102 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f800d-8977-43f8-831f-29d63f499977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:44.700429 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f800d-8977-43f8-831f-29d63f499977 admin admin] PATH_INFO: `/v3/projects/6276754d7f264d288b49b792fd0a60fc` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:44.702101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f800d-8977-43f8-831f-29d63f499977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6276754d7f264d288b49b792fd0a60fc)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:44.704169 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f800d-8977-43f8-831f-29d63f499977 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:44.748305 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1140/2258] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:44.761183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a42d3-b797-4cd1-94e3-ddde9c411681 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:44.761435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a42d3-b797-4cd1-94e3-ddde9c411681 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:44.761880 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a42d3-b797-4cd1-94e3-ddde9c411681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:44.837974 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-b13a42d3-b797-4cd1-94e3-ddde9c411681 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:44.839984 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b13a42d3-b797-4cd1-94e3-ddde9c411681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:44.873819 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1141/2259] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:41:44.884424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a42d3-b797-4cd1-94e3-ddde9c411681 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:44.902910 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a42d3-b797-4cd1-94e3-ddde9c411681 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:44.925398 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e67f800d-8977-43f8-831f-29d63f499977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6276754d7f264d288b49b792fd0a60fc', 'request_id': 'req-e67f800d-8977-43f8-831f-29d63f499977'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:44.939536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e67f800d-8977-43f8-831f-29d63f499977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6276754d7f264d288b49b792fd0a60fc', 'request_id': 'req-e67f800d-8977-43f8-831f-29d63f499977'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:44.951908 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e67f800d-8977-43f8-831f-29d63f499977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6276754d7f264d288b49b792fd0a60fc', 'request_id': 'req-e67f800d-8977-43f8-831f-29d63f499977'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:45.015368 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e67f800d-8977-43f8-831f-29d63f499977 admin admin] The token cache is being invalidate because project 6276754d7f264d288b49b792fd0a60fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:45.018326 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e67f800d-8977-43f8-831f-29d63f499977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:45.024774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e67f800d-8977-43f8-831f-29d63f499977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:45.035026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1119/2260] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:44 2022] DELETE /identity/v3/projects/6276754d7f264d288b49b792fd0a60fc => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:45.042517 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f800d-8977-43f8-831f-29d63f499977 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:45.046851 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-e67f800d-8977-43f8-831f-29d63f499977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:45.138998 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:45.251854 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f800d-8977-43f8-831f-29d63f499977 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:45.264059 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4e389-d508-42da-b40d-394e414e44d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:45.264686 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af00ecb-3bab-49ba-b907-971ca3c371d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:45.265939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af00ecb-3bab-49ba-b907-971ca3c371d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:45.266734 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4e389-d508-42da-b40d-394e414e44d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:45.267659 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4e389-d508-42da-b40d-394e414e44d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:45.268396 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af00ecb-3bab-49ba-b907-971ca3c371d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:45.268616 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4e389-d508-42da-b40d-394e414e44d4 admin admin] PATH_INFO: `/v3/users/b513811772c642eaa9f93187cdfda320` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:45.271410 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae4e389-d508-42da-b40d-394e414e44d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b513811772c642eaa9f93187cdfda320)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:45.271993 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af00ecb-3bab-49ba-b907-971ca3c371d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:45.276318 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af00ecb-3bab-49ba-b907-971ca3c371d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:41:45.276863 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae4e389-d508-42da-b40d-394e414e44d4 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:45.281984 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af00ecb-3bab-49ba-b907-971ca3c371d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:45.294377 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af00ecb-3bab-49ba-b907-971ca3c371d1 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:45.332762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1142/2261] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:41:45.342347 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af00ecb-3bab-49ba-b907-971ca3c371d1 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:45.345679 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4af00ecb-3bab-49ba-b907-971ca3c371d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:45.377829 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af00ecb-3bab-49ba-b907-971ca3c371d1 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:45.390594 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61b49c-0f86-4358-9c03-86bbe65348a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:45.392245 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61b49c-0f86-4358-9c03-86bbe65348a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:45.392717 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61b49c-0f86-4358-9c03-86bbe65348a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:45.393222 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61b49c-0f86-4358-9c03-86bbe65348a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:45.396115 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61b49c-0f86-4358-9c03-86bbe65348a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:45.401048 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61b49c-0f86-4358-9c03-86bbe65348a5 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:45.424460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-fae4e389-d508-42da-b40d-394e414e44d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b513811772c642eaa9f93187cdfda320'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:45.439605 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-fae4e389-d508-42da-b40d-394e414e44d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b513811772c642eaa9f93187cdfda320'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:45.449717 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:45.472955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-fae4e389-d508-42da-b40d-394e414e44d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b513811772c642eaa9f93187cdfda320'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:45.475089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-fae4e389-d508-42da-b40d-394e414e44d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b513811772c642eaa9f93187cdfda320'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:45.477662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-fae4e389-d508-42da-b40d-394e414e44d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b513811772c642eaa9f93187cdfda320'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:45.524027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1143/2262] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:45 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:45.525958 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1120/2263] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:45 2022] DELETE /identity/v3/users/b513811772c642eaa9f93187cdfda320 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:45.526204 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61b49c-0f86-4358-9c03-86bbe65348a5 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:45.528220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1d61b49c-0f86-4358-9c03-86bbe65348a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:45.751755 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61b49c-0f86-4358-9c03-86bbe65348a5 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:45.762996 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d799ea-2248-4633-af4a-e57d6d26c7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:45.769654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d799ea-2248-4633-af4a-e57d6d26c7d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:45.771478 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d799ea-2248-4633-af4a-e57d6d26c7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:45.771918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d799ea-2248-4633-af4a-e57d6d26c7d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:45.772863 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d799ea-2248-4633-af4a-e57d6d26c7d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:45.778619 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d799ea-2248-4633-af4a-e57d6d26c7d8 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:45.822461 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1144/2264] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:45 2022] POST /identity/v3/users => generated 288 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:41:45.827433 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4e389-d508-42da-b40d-394e414e44d4 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:46.063749 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4e389-d508-42da-b40d-394e414e44d4 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:46.088755 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b736281-c379-4bc1-ae63-d1bda0284a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:46.089485 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b736281-c379-4bc1-ae63-d1bda0284a74 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:46.089689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b736281-c379-4bc1-ae63-d1bda0284a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:46.089941 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b736281-c379-4bc1-ae63-d1bda0284a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:46.090612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b736281-c379-4bc1-ae63-d1bda0284a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:46.092429 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b736281-c379-4bc1-ae63-d1bda0284a74 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:46.116314 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1121/2265] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:46.120803 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d799ea-2248-4633-af4a-e57d6d26c7d8 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:46.142833 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d799ea-2248-4633-af4a-e57d6d26c7d8 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:46.185933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa4f34-dd4a-4996-ae94-9aa2f6e8e20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:46.187069 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa4f34-dd4a-4996-ae94-9aa2f6e8e20a admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:46.187562 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa4f34-dd4a-4996-ae94-9aa2f6e8e20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:46.188097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa4f34-dd4a-4996-ae94-9aa2f6e8e20a admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:46.189713 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa4f34-dd4a-4996-ae94-9aa2f6e8e20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:46.193953 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa4f34-dd4a-4996-ae94-9aa2f6e8e20a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:46.218949 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1145/2266] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:46.223928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b736281-c379-4bc1-ae63-d1bda0284a74 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:46.251111 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b736281-c379-4bc1-ae63-d1bda0284a74 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:46.258331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa4f34-dd4a-4996-ae94-9aa2f6e8e20a admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:46.261592 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f7fa4f34-dd4a-4996-ae94-9aa2f6e8e20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:46.263436 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb4d91-9df7-4451-8278-faa22c82d632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:46.264985 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb4d91-9df7-4451-8278-faa22c82d632 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:46.265909 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb4d91-9df7-4451-8278-faa22c82d632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:46.266772 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb4d91-9df7-4451-8278-faa22c82d632 admin admin] PATH_INFO: `/v3/projects/3161d3d0cdec4e89b8d4b42afa839ba6/users/01f6120731eb4e41b11af19da9c45c91/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:46.304855 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb4d91-9df7-4451-8278-faa22c82d632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3161d3d0cdec4e89b8d4b42afa839ba6, user_id=01f6120731eb4e41b11af19da9c45c91, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:46.312871 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb4d91-9df7-4451-8278-faa22c82d632 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:46.336536 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa4f34-dd4a-4996-ae94-9aa2f6e8e20a admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:46.360999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1122/2267] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:46 2022] PUT /identity/v3/projects/3161d3d0cdec4e89b8d4b42afa839ba6/users/01f6120731eb4e41b11af19da9c45c91/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:41:46.380951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37c6cf-fe16-4868-bc71-acf3345b068c None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:46.382635 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37c6cf-fe16-4868-bc71-acf3345b068c None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:46.383396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37c6cf-fe16-4868-bc71-acf3345b068c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:46.469732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-af37c6cf-fe16-4868-bc71-acf3345b068c None None] MFA Rules not processed for user `01f6120731eb4e41b11af19da9c45c91`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:46.469732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-af37c6cf-fe16-4868-bc71-acf3345b068c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:46.591768 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdbd88-de47-4e12-ad24-a25046ed9689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:46.593091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdbd88-de47-4e12-ad24-a25046ed9689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:46.593579 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdbd88-de47-4e12-ad24-a25046ed9689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:46.594074 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdbd88-de47-4e12-ad24-a25046ed9689 admin admin] PATH_INFO: `/v3/projects/3460cc2fd6464604a0d87a56f0eb581f` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:46.596382 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdbd88-de47-4e12-ad24-a25046ed9689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3460cc2fd6464604a0d87a56f0eb581f)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:46.600032 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdbd88-de47-4e12-ad24-a25046ed9689 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:46.646771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1123/2268] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:41:46.648650 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af37c6cf-fe16-4868-bc71-acf3345b068c None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:46.651196 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-af37c6cf-fe16-4868-bc71-acf3345b068c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:46.673152 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:46.677808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af37c6cf-fe16-4868-bc71-acf3345b068c None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:46.724734 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-66bdbd88-de47-4e12-ad24-a25046ed9689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3460cc2fd6464604a0d87a56f0eb581f', 'request_id': 'req-66bdbd88-de47-4e12-ad24-a25046ed9689'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:46.740225 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-66bdbd88-de47-4e12-ad24-a25046ed9689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3460cc2fd6464604a0d87a56f0eb581f', 'request_id': 'req-66bdbd88-de47-4e12-ad24-a25046ed9689'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:46.757322 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-66bdbd88-de47-4e12-ad24-a25046ed9689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3460cc2fd6464604a0d87a56f0eb581f', 'request_id': 'req-66bdbd88-de47-4e12-ad24-a25046ed9689'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:46.765642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:46.791798 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-66bdbd88-de47-4e12-ad24-a25046ed9689 admin admin] The token cache is being invalidate because project 3460cc2fd6464604a0d87a56f0eb581f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:46.792639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-66bdbd88-de47-4e12-ad24-a25046ed9689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:46.794236 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-66bdbd88-de47-4e12-ad24-a25046ed9689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:46.797760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1146/2269] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:46 2022] DELETE /identity/v3/projects/3460cc2fd6464604a0d87a56f0eb581f => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:41:46.800438 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdbd88-de47-4e12-ad24-a25046ed9689 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:46.803271 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-66bdbd88-de47-4e12-ad24-a25046ed9689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:46.823565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbaf73-bdc2-46e6-a981-fdb91ac65fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:46.825342 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbaf73-bdc2-46e6-a981-fdb91ac65fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:46.825895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbaf73-bdc2-46e6-a981-fdb91ac65fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:46.828064 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbaf73-bdc2-46e6-a981-fdb91ac65fc3 admin admin] PATH_INFO: `/v3/users/1c27ab036e7145b897c3387255b07e31` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:46.831106 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbaf73-bdc2-46e6-a981-fdb91ac65fc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c27ab036e7145b897c3387255b07e31)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:46.837287 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbaf73-bdc2-46e6-a981-fdb91ac65fc3 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:46.935389 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdbd88-de47-4e12-ad24-a25046ed9689 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:46.941579 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bdd35-ceea-4168-9b45-7f7b87ba9fc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:46.942674 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bdd35-ceea-4168-9b45-7f7b87ba9fc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:46.942901 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f5bbaf73-bdc2-46e6-a981-fdb91ac65fc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c27ab036e7145b897c3387255b07e31'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:46.943140 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bdd35-ceea-4168-9b45-7f7b87ba9fc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:46.943544 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bdd35-ceea-4168-9b45-7f7b87ba9fc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:46.946184 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d78bdd35-ceea-4168-9b45-7f7b87ba9fc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:46.956768 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f5bbaf73-bdc2-46e6-a981-fdb91ac65fc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c27ab036e7145b897c3387255b07e31'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:46.987869 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f5bbaf73-bdc2-46e6-a981-fdb91ac65fc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c27ab036e7145b897c3387255b07e31'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:46.990486 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f5bbaf73-bdc2-46e6-a981-fdb91ac65fc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c27ab036e7145b897c3387255b07e31'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:46.991553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f5bbaf73-bdc2-46e6-a981-fdb91ac65fc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c27ab036e7145b897c3387255b07e31'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:47.024153 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1124/2270] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:46 2022] DELETE /identity/v3/users/1c27ab036e7145b897c3387255b07e31 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:47.027722 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea08f3-df32-4941-8815-b53c86802710 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:47.028332 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea08f3-df32-4941-8815-b53c86802710 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:47.029290 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea08f3-df32-4941-8815-b53c86802710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:47.099807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78bdd35-ceea-4168-9b45-7f7b87ba9fc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:47.102017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78bdd35-ceea-4168-9b45-7f7b87ba9fc3 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:47.103224 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-7cea08f3-df32-4941-8815-b53c86802710 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:47.105040 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-7cea08f3-df32-4941-8815-b53c86802710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:47.125477 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1147/2271] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:47.127032 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aeeed5-1d4f-4abc-99c8-38ceeac15eaa None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:47.127352 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aeeed5-1d4f-4abc-99c8-38ceeac15eaa None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:47.127629 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aeeed5-1d4f-4abc-99c8-38ceeac15eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:47.167207 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-53aeeed5-1d4f-4abc-99c8-38ceeac15eaa None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:47.170028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-53aeeed5-1d4f-4abc-99c8-38ceeac15eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:47.296405 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1125/2272] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:47.334539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132dbf4-1edc-4dc7-a9be-703da48bbb50 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:47.336312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132dbf4-1edc-4dc7-a9be-703da48bbb50 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:47.336846 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132dbf4-1edc-4dc7-a9be-703da48bbb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:47.342363 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1148/2273] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:47.360109 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aeeed5-1d4f-4abc-99c8-38ceeac15eaa None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:47.362955 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-53aeeed5-1d4f-4abc-99c8-38ceeac15eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:47.403221 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:47.418897 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-5132dbf4-1edc-4dc7-a9be-703da48bbb50 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:47.420595 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-5132dbf4-1edc-4dc7-a9be-703da48bbb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:47.450868 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1126/2274] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:47.451856 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132dbf4-1edc-4dc7-a9be-703da48bbb50 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:47.463053 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132dbf4-1edc-4dc7-a9be-703da48bbb50 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:47.469078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24ee55-fe2b-4b50-bc4d-e61923ed70e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:47.469720 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24ee55-fe2b-4b50-bc4d-e61923ed70e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:47.469999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24ee55-fe2b-4b50-bc4d-e61923ed70e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:47.470574 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24ee55-fe2b-4b50-bc4d-e61923ed70e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:47.471070 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24ee55-fe2b-4b50-bc4d-e61923ed70e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:41:47.471403 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24ee55-fe2b-4b50-bc4d-e61923ed70e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:47.473453 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24ee55-fe2b-4b50-bc4d-e61923ed70e4 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:47.493738 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1127/2275] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:41:47.494865 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24ee55-fe2b-4b50-bc4d-e61923ed70e4 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:47.506510 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24ee55-fe2b-4b50-bc4d-e61923ed70e4 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:47.516630 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58419470-661e-480f-9858-a09a4e910452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:47.517642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58419470-661e-480f-9858-a09a4e910452 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:47.517954 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58419470-661e-480f-9858-a09a4e910452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:47.518211 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58419470-661e-480f-9858-a09a4e910452 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:47.518874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58419470-661e-480f-9858-a09a4e910452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:47.520947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58419470-661e-480f-9858-a09a4e910452 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:47.562996 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aeeed5-1d4f-4abc-99c8-38ceeac15eaa None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:47.594286 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1128/2276] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:47 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:47.595746 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58419470-661e-480f-9858-a09a4e910452 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:47.647076 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:47.769936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58419470-661e-480f-9858-a09a4e910452 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:47.791014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1106a-aa5c-4846-96f0-9b5650b81ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:47.791694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1106a-aa5c-4846-96f0-9b5650b81ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:47.792083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1106a-aa5c-4846-96f0-9b5650b81ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:47.792401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1106a-aa5c-4846-96f0-9b5650b81ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:47.793084 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1106a-aa5c-4846-96f0-9b5650b81ea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:47.795445 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1106a-aa5c-4846-96f0-9b5650b81ea6 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:47.857477 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1129/2277] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:47 2022] POST /identity/v3/users => generated 293 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:41:47.860400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99da018-8603-4f4d-8800-d47855904ff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:47.862828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99da018-8603-4f4d-8800-d47855904ff0 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:47.863388 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99da018-8603-4f4d-8800-d47855904ff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:47.863868 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1106a-aa5c-4846-96f0-9b5650b81ea6 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:47.864065 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99da018-8603-4f4d-8800-d47855904ff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:47.889257 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1106a-aa5c-4846-96f0-9b5650b81ea6 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:47.897359 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c7b3f-66e9-4ab3-bfc2-6d5de65ffa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:47.898610 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c7b3f-66e9-4ab3-bfc2-6d5de65ffa73 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:47.898894 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c7b3f-66e9-4ab3-bfc2-6d5de65ffa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:47.899515 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c7b3f-66e9-4ab3-bfc2-6d5de65ffa73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:47.900263 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c7b3f-66e9-4ab3-bfc2-6d5de65ffa73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:47.901921 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c7b3f-66e9-4ab3-bfc2-6d5de65ffa73 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:47.903952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99da018-8603-4f4d-8800-d47855904ff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:47.907156 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99da018-8603-4f4d-8800-d47855904ff0 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:47.922390 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1149/2278] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:41:47.933190 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1130/2279] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:47.939976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99da018-8603-4f4d-8800-d47855904ff0 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:47.956654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99da018-8603-4f4d-8800-d47855904ff0 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:47.967160 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88b677-c7a5-4a07-acd3-9155f226960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:47.968547 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88b677-c7a5-4a07-acd3-9155f226960a admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:47.969156 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88b677-c7a5-4a07-acd3-9155f226960a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:47.969715 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88b677-c7a5-4a07-acd3-9155f226960a admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:47.971414 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88b677-c7a5-4a07-acd3-9155f226960a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:47.980794 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88b677-c7a5-4a07-acd3-9155f226960a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:48.033918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1150/2280] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:48.040304 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c7b3f-66e9-4ab3-bfc2-6d5de65ffa73 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:48.056067 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c7b3f-66e9-4ab3-bfc2-6d5de65ffa73 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:48.076398 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8a910-c1b3-4d60-a63c-be1783fd8f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:48.078890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8a910-c1b3-4d60-a63c-be1783fd8f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:48.079372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8a910-c1b3-4d60-a63c-be1783fd8f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:48.079796 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8a910-c1b3-4d60-a63c-be1783fd8f32 admin admin] PATH_INFO: `/v3/projects/97a41bb49c8844a0967a2af5146fb0dc/users/b730e6b4c9084070970333cf748c5a50/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:48.108474 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8a910-c1b3-4d60-a63c-be1783fd8f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a41bb49c8844a0967a2af5146fb0dc, user_id=b730e6b4c9084070970333cf748c5a50, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:48.115566 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8a910-c1b3-4d60-a63c-be1783fd8f32 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:48.161480 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1131/2281] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:48 2022] PUT /identity/v3/projects/97a41bb49c8844a0967a2af5146fb0dc/users/b730e6b4c9084070970333cf748c5a50/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:41:48.189269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ae5b3-9b70-456f-b41d-27631adc4747 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:48.190056 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ae5b3-9b70-456f-b41d-27631adc4747 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:48.190429 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ae5b3-9b70-456f-b41d-27631adc4747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:48.285528 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-7b1ae5b3-9b70-456f-b41d-27631adc4747 None None] MFA Rules not processed for user `b730e6b4c9084070970333cf748c5a50`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:48.307357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-7b1ae5b3-9b70-456f-b41d-27631adc4747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:48.527636 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1151/2282] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:48.534770 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8a910-c1b3-4d60-a63c-be1783fd8f32 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:48.671363 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ae5b3-9b70-456f-b41d-27631adc4747 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:48.674312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-7b1ae5b3-9b70-456f-b41d-27631adc4747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:48.695354 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8a910-c1b3-4d60-a63c-be1783fd8f32 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:48.709497 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5966cbc-a695-4c79-b978-20b7fafa8a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:48.712557 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5966cbc-a695-4c79-b978-20b7fafa8a5e admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:48.713334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5966cbc-a695-4c79-b978-20b7fafa8a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:48.713827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5966cbc-a695-4c79-b978-20b7fafa8a5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:48.715044 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5966cbc-a695-4c79-b978-20b7fafa8a5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:48.719218 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5966cbc-a695-4c79-b978-20b7fafa8a5e admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:48.721866 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ae5b3-9b70-456f-b41d-27631adc4747 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:48.744045 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbd0a4-fee6-4a3f-9516-6cb8108571de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:48.746032 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbd0a4-fee6-4a3f-9516-6cb8108571de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:48.750777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbd0a4-fee6-4a3f-9516-6cb8108571de admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:48.751460 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbd0a4-fee6-4a3f-9516-6cb8108571de admin admin] PATH_INFO: `/v3/projects/69895086e7ec427bbc28ac8239dd7e3e` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:48.754154 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbd0a4-fee6-4a3f-9516-6cb8108571de admin admin] RBAC: Authorizing `identity:delete_project(project_id=69895086e7ec427bbc28ac8239dd7e3e)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:48.758478 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbd0a4-fee6-4a3f-9516-6cb8108571de admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:48.771543 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1132/2283] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:48 2022] POST /identity/v3/projects => generated 387 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:48.777588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5966cbc-a695-4c79-b978-20b7fafa8a5e admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:48.913056 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:48.932474 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a8fbd0a4-fee6-4a3f-9516-6cb8108571de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69895086e7ec427bbc28ac8239dd7e3e', 'request_id': 'req-a8fbd0a4-fee6-4a3f-9516-6cb8108571de'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:48.955214 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:48.972104 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a8fbd0a4-fee6-4a3f-9516-6cb8108571de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69895086e7ec427bbc28ac8239dd7e3e', 'request_id': 'req-a8fbd0a4-fee6-4a3f-9516-6cb8108571de'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:48.974393 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5966cbc-a695-4c79-b978-20b7fafa8a5e admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:48.994226 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a8fbd0a4-fee6-4a3f-9516-6cb8108571de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69895086e7ec427bbc28ac8239dd7e3e', 'request_id': 'req-a8fbd0a4-fee6-4a3f-9516-6cb8108571de'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:49.059226 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a8fbd0a4-fee6-4a3f-9516-6cb8108571de admin admin] The token cache is being invalidate because project 69895086e7ec427bbc28ac8239dd7e3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:49.059724 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a8fbd0a4-fee6-4a3f-9516-6cb8108571de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:49.062758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a8fbd0a4-fee6-4a3f-9516-6cb8108571de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:49.069283 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1152/2284] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:48 2022] DELETE /identity/v3/projects/69895086e7ec427bbc28ac8239dd7e3e => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:41:49.200572 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc3a0f-87d0-4db3-ae58-27d48664a6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:49.201307 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc3a0f-87d0-4db3-ae58-27d48664a6ea admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:49.201876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc3a0f-87d0-4db3-ae58-27d48664a6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:49.206737 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc3a0f-87d0-4db3-ae58-27d48664a6ea admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:49.206737 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc3a0f-87d0-4db3-ae58-27d48664a6ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:49.214393 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc3a0f-87d0-4db3-ae58-27d48664a6ea admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:49.294560 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1133/2285] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:48 2022] POST /identity/v3/users => generated 300 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:49.296921 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbd0a4-fee6-4a3f-9516-6cb8108571de admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:49.300339 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a8fbd0a4-fee6-4a3f-9516-6cb8108571de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:49.366453 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbd0a4-fee6-4a3f-9516-6cb8108571de admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:49.373978 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db1ccb-5b1d-4d92-a90e-c1e78aee0119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:49.375704 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db1ccb-5b1d-4d92-a90e-c1e78aee0119 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:49.375704 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db1ccb-5b1d-4d92-a90e-c1e78aee0119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:49.375961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db1ccb-5b1d-4d92-a90e-c1e78aee0119 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:49.376859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db1ccb-5b1d-4d92-a90e-c1e78aee0119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:49.379223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db1ccb-5b1d-4d92-a90e-c1e78aee0119 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:49.404255 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1153/2286] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:49.409928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc3a0f-87d0-4db3-ae58-27d48664a6ea admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:49.435051 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc3a0f-87d0-4db3-ae58-27d48664a6ea admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:49.458493 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c966ffa-6301-449a-b212-3fde48f836ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:49.459929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c966ffa-6301-449a-b212-3fde48f836ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:49.461945 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c966ffa-6301-449a-b212-3fde48f836ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:49.461945 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c966ffa-6301-449a-b212-3fde48f836ed admin admin] PATH_INFO: `/v3/projects/282f7729489744e4b3a574e9fe51a9bd/users/304015a892464dd8a3f3e98c8874d628/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:49.540084 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c966ffa-6301-449a-b212-3fde48f836ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=282f7729489744e4b3a574e9fe51a9bd, user_id=304015a892464dd8a3f3e98c8874d628, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:49.552994 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c966ffa-6301-449a-b212-3fde48f836ed admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:49.596173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1134/2287] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:49 2022] PUT /identity/v3/projects/282f7729489744e4b3a574e9fe51a9bd/users/304015a892464dd8a3f3e98c8874d628/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:49.602502 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db1ccb-5b1d-4d92-a90e-c1e78aee0119 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:49.626395 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db1ccb-5b1d-4d92-a90e-c1e78aee0119 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:49.853362 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcd67b-5a03-40a3-ab14-7f7bd0cec360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:49.854519 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcd67b-5a03-40a3-ab14-7f7bd0cec360 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:49.855097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcd67b-5a03-40a3-ab14-7f7bd0cec360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:49.855898 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcd67b-5a03-40a3-ab14-7f7bd0cec360 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:49.857291 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcd67b-5a03-40a3-ab14-7f7bd0cec360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:49.862088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcd67b-5a03-40a3-ab14-7f7bd0cec360 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:49.889292 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1154/2288] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:49.891131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c966ffa-6301-449a-b212-3fde48f836ed admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:49.905178 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c966ffa-6301-449a-b212-3fde48f836ed admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:49.914005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bd069-2c48-427d-9b54-24a8411ab787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:49.914934 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bd069-2c48-427d-9b54-24a8411ab787 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:49.915406 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bd069-2c48-427d-9b54-24a8411ab787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:49.916366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bd069-2c48-427d-9b54-24a8411ab787 admin admin] PATH_INFO: `/v3/projects/282f7729489744e4b3a574e9fe51a9bd/users/304015a892464dd8a3f3e98c8874d628/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:49.919160 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011bd069-2c48-427d-9b54-24a8411ab787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=282f7729489744e4b3a574e9fe51a9bd, user_id=304015a892464dd8a3f3e98c8874d628, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:49.923049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011bd069-2c48-427d-9b54-24a8411ab787 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:49.948415 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1135/2289] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:49 2022] PUT /identity/v3/projects/282f7729489744e4b3a574e9fe51a9bd/users/304015a892464dd8a3f3e98c8874d628/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:41:49.950427 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b464be-a412-4ce2-9cf4-ba33f93cd9ba None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:49.951198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b464be-a412-4ce2-9cf4-ba33f93cd9ba None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:49.951651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b464be-a412-4ce2-9cf4-ba33f93cd9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:50.002206 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-08b464be-a412-4ce2-9cf4-ba33f93cd9ba None None] MFA Rules not processed for user `304015a892464dd8a3f3e98c8874d628`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:50.004913 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-08b464be-a412-4ce2-9cf4-ba33f93cd9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:50.231272 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1155/2290] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:49 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:50.245768 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2064a-c0fb-449d-b93e-1803c2e419ea None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:50.246499 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2064a-c0fb-449d-b93e-1803c2e419ea None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:50.247166 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2064a-c0fb-449d-b93e-1803c2e419ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:50.263238 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b464be-a412-4ce2-9cf4-ba33f93cd9ba None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:50.266634 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-08b464be-a412-4ce2-9cf4-ba33f93cd9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:50.298273 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-a0f2064a-c0fb-449d-b93e-1803c2e419ea None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:50.300577 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a0f2064a-c0fb-449d-b93e-1803c2e419ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:50.385106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:50.426536 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b464be-a412-4ce2-9cf4-ba33f93cd9ba None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:50.434273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb05fde-d044-49fc-864c-061148f81ec3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:50.435802 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb05fde-d044-49fc-864c-061148f81ec3 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:50.436345 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb05fde-d044-49fc-864c-061148f81ec3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:50.436802 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb05fde-d044-49fc-864c-061148f81ec3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:50.460979 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1136/2291] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Aug 29 21:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:50.462561 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb05fde-d044-49fc-864c-061148f81ec3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:50.464697 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb05fde-d044-49fc-864c-061148f81ec3 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:50.479661 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1156/2292] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:50 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:50.509617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2064a-c0fb-449d-b93e-1803c2e419ea None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:50.512876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a0f2064a-c0fb-449d-b93e-1803c2e419ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:50.617007 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:50.650720 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2064a-c0fb-449d-b93e-1803c2e419ea None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:50.657976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55bcf5-141e-429c-91b7-f40863375221 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:50.658732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55bcf5-141e-429c-91b7-f40863375221 service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:50.659022 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55bcf5-141e-429c-91b7-f40863375221 service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:50.659350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55bcf5-141e-429c-91b7-f40863375221 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:50.672550 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55bcf5-141e-429c-91b7-f40863375221 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:50.674464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55bcf5-141e-429c-91b7-f40863375221 service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:50.693137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1137/2293] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:41:50.980154 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a081e-7c83-4c89-9a11-b8a6712beecd None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:50.980959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a081e-7c83-4c89-9a11-b8a6712beecd None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:50.981530 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a081e-7c83-4c89-9a11-b8a6712beecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:51.017260 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-b17a081e-7c83-4c89-9a11-b8a6712beecd None None] MFA Rules not processed for user `fd2d58e660a940dd8fd31903ee5a6968`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:51.019107 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b17a081e-7c83-4c89-9a11-b8a6712beecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:51.136344 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1157/2294] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:51.556234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55bcf5-141e-429c-91b7-f40863375221 service nova] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:51.574074 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55bcf5-141e-429c-91b7-f40863375221 service nova] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:51.580717 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcf9dc-56cf-42bf-9f93-5d8aba01622d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:51.581731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcf9dc-56cf-42bf-9f93-5d8aba01622d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:51.582218 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcf9dc-56cf-42bf-9f93-5d8aba01622d admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:51.582784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcf9dc-56cf-42bf-9f93-5d8aba01622d admin admin] PATH_INFO: `/v3/users/b730e6b4c9084070970333cf748c5a50` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:51.584675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcf9dc-56cf-42bf-9f93-5d8aba01622d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b730e6b4c9084070970333cf748c5a50)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:51.588598 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcf9dc-56cf-42bf-9f93-5d8aba01622d admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:51.693800 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e5dcf9dc-56cf-42bf-9f93-5d8aba01622d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b730e6b4c9084070970333cf748c5a50'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:51.709370 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e5dcf9dc-56cf-42bf-9f93-5d8aba01622d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b730e6b4c9084070970333cf748c5a50'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:51.735344 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e5dcf9dc-56cf-42bf-9f93-5d8aba01622d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b730e6b4c9084070970333cf748c5a50'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:51.737103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e5dcf9dc-56cf-42bf-9f93-5d8aba01622d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b730e6b4c9084070970333cf748c5a50'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:51.737921 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e5dcf9dc-56cf-42bf-9f93-5d8aba01622d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b730e6b4c9084070970333cf748c5a50'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:51.766552 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1138/2295] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:51 2022] DELETE /identity/v3/users/b730e6b4c9084070970333cf748c5a50 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:51.771701 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb866f9c-544f-46f4-8257-5b0bdcf22a76 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:51.772620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb866f9c-544f-46f4-8257-5b0bdcf22a76 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:51.772620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb866f9c-544f-46f4-8257-5b0bdcf22a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:51.806445 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-eb866f9c-544f-46f4-8257-5b0bdcf22a76 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:51.807724 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-eb866f9c-544f-46f4-8257-5b0bdcf22a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:51.939046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1158/2296] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:51.949637 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcf9dc-56cf-42bf-9f93-5d8aba01622d admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:51.954307 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-e5dcf9dc-56cf-42bf-9f93-5d8aba01622d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:52.130323 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcf9dc-56cf-42bf-9f93-5d8aba01622d admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:52.137094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa33730-09c2-45a3-97fe-1e5a960d5c3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:52.138103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa33730-09c2-45a3-97fe-1e5a960d5c3f service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:52.138684 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa33730-09c2-45a3-97fe-1e5a960d5c3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:52.139042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa33730-09c2-45a3-97fe-1e5a960d5c3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:52.162570 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa33730-09c2-45a3-97fe-1e5a960d5c3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:52.166533 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa33730-09c2-45a3-97fe-1e5a960d5c3f service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:52.190269 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1139/2297] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:52.973815 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb866f9c-544f-46f4-8257-5b0bdcf22a76 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:52.976803 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-eb866f9c-544f-46f4-8257-5b0bdcf22a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:53.015307 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb866f9c-544f-46f4-8257-5b0bdcf22a76 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:53.024710 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de92940-0a3a-4612-a580-46990535481a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:53.025727 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de92940-0a3a-4612-a580-46990535481a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:53.026243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de92940-0a3a-4612-a580-46990535481a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:53.026715 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de92940-0a3a-4612-a580-46990535481a admin admin] PATH_INFO: `/v3/projects/97a41bb49c8844a0967a2af5146fb0dc` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:53.028891 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de92940-0a3a-4612-a580-46990535481a admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a41bb49c8844a0967a2af5146fb0dc)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:53.032677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de92940-0a3a-4612-a580-46990535481a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:53.155380 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0de92940-0a3a-4612-a580-46990535481a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a41bb49c8844a0967a2af5146fb0dc', 'request_id': 'req-0de92940-0a3a-4612-a580-46990535481a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:53.168284 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0de92940-0a3a-4612-a580-46990535481a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a41bb49c8844a0967a2af5146fb0dc', 'request_id': 'req-0de92940-0a3a-4612-a580-46990535481a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:53.184491 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0de92940-0a3a-4612-a580-46990535481a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a41bb49c8844a0967a2af5146fb0dc', 'request_id': 'req-0de92940-0a3a-4612-a580-46990535481a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:53.223618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0de92940-0a3a-4612-a580-46990535481a admin admin] The token cache is being invalidate because project 97a41bb49c8844a0967a2af5146fb0dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:53.224537 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0de92940-0a3a-4612-a580-46990535481a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:53.226498 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0de92940-0a3a-4612-a580-46990535481a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:53.229698 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1159/2298] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:52 2022] DELETE /identity/v3/projects/97a41bb49c8844a0967a2af5146fb0dc => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:53.235897 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa33730-09c2-45a3-97fe-1e5a960d5c3f service neutron] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:53.248293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa33730-09c2-45a3-97fe-1e5a960d5c3f service neutron] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:53.349283 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:53.362604 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f52fd3-c9de-48bc-9a54-f35e39bb35c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:53.364001 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f52fd3-c9de-48bc-9a54-f35e39bb35c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:53.364450 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f52fd3-c9de-48bc-9a54-f35e39bb35c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:53.369158 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f52fd3-c9de-48bc-9a54-f35e39bb35c0 admin admin] PATH_INFO: `/v3/users/304015a892464dd8a3f3e98c8874d628` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:53.369158 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f52fd3-c9de-48bc-9a54-f35e39bb35c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=304015a892464dd8a3f3e98c8874d628)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:53.370514 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f52fd3-c9de-48bc-9a54-f35e39bb35c0 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:53.461839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a8f52fd3-c9de-48bc-9a54-f35e39bb35c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '304015a892464dd8a3f3e98c8874d628'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:53.472297 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a8f52fd3-c9de-48bc-9a54-f35e39bb35c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '304015a892464dd8a3f3e98c8874d628'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:53.500046 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a8f52fd3-c9de-48bc-9a54-f35e39bb35c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '304015a892464dd8a3f3e98c8874d628'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:53.501353 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a8f52fd3-c9de-48bc-9a54-f35e39bb35c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '304015a892464dd8a3f3e98c8874d628'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:53.502479 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a8f52fd3-c9de-48bc-9a54-f35e39bb35c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '304015a892464dd8a3f3e98c8874d628'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:53.537161 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1140/2299] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:41:53 2022] DELETE /identity/v3/users/304015a892464dd8a3f3e98c8874d628 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:54.449074 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de92940-0a3a-4612-a580-46990535481a admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:54.453210 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0de92940-0a3a-4612-a580-46990535481a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:54.487429 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de92940-0a3a-4612-a580-46990535481a admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:54.515302 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:54.601520 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e059b9-f5c0-45c9-a246-3aec62650a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:54.602940 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e059b9-f5c0-45c9-a246-3aec62650a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:54.603677 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e059b9-f5c0-45c9-a246-3aec62650a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:54.603891 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e059b9-f5c0-45c9-a246-3aec62650a2b admin admin] PATH_INFO: `/v3/projects/282f7729489744e4b3a574e9fe51a9bd` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:54.606412 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e059b9-f5c0-45c9-a246-3aec62650a2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=282f7729489744e4b3a574e9fe51a9bd)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:54.611472 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e059b9-f5c0-45c9-a246-3aec62650a2b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:54.716731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-06e059b9-f5c0-45c9-a246-3aec62650a2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '282f7729489744e4b3a574e9fe51a9bd', 'request_id': 'req-06e059b9-f5c0-45c9-a246-3aec62650a2b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:54.733849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-06e059b9-f5c0-45c9-a246-3aec62650a2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '282f7729489744e4b3a574e9fe51a9bd', 'request_id': 'req-06e059b9-f5c0-45c9-a246-3aec62650a2b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:54.778474 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-06e059b9-f5c0-45c9-a246-3aec62650a2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '282f7729489744e4b3a574e9fe51a9bd', 'request_id': 'req-06e059b9-f5c0-45c9-a246-3aec62650a2b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:54.811133 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-06e059b9-f5c0-45c9-a246-3aec62650a2b admin admin] The token cache is being invalidate because project 282f7729489744e4b3a574e9fe51a9bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:41:54.811960 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-06e059b9-f5c0-45c9-a246-3aec62650a2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:54.814137 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-06e059b9-f5c0-45c9-a246-3aec62650a2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:41:54.816933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1160/2300] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:41:54 2022] DELETE /identity/v3/projects/282f7729489744e4b3a574e9fe51a9bd => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:41:54.827832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13e435-44f0-4037-8801-7651f9d8fef6 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:54.828392 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13e435-44f0-4037-8801-7651f9d8fef6 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:54.828853 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13e435-44f0-4037-8801-7651f9d8fef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:54.869077 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-6e13e435-44f0-4037-8801-7651f9d8fef6 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:54.874397 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-6e13e435-44f0-4037-8801-7651f9d8fef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:55.012439 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1141/2301] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:55.031500 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ccf8f-2e53-4aca-8b1f-2f70a0c2f5e5 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:55.031929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ccf8f-2e53-4aca-8b1f-2f70a0c2f5e5 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:55.032357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ccf8f-2e53-4aca-8b1f-2f70a0c2f5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:55.090660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-751ccf8f-2e53-4aca-8b1f-2f70a0c2f5e5 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:55.090660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-751ccf8f-2e53-4aca-8b1f-2f70a0c2f5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:55.101036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1161/2302] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:55.110129 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13e435-44f0-4037-8801-7651f9d8fef6 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:55.129375 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13e435-44f0-4037-8801-7651f9d8fef6 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:55.139505 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e0d27-be34-4d48-ae6f-a66f7839bf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:55.141003 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e0d27-be34-4d48-ae6f-a66f7839bf81 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:55.141649 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e0d27-be34-4d48-ae6f-a66f7839bf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:55.142116 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e0d27-be34-4d48-ae6f-a66f7839bf81 admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:55.143480 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e0d27-be34-4d48-ae6f-a66f7839bf81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:41:55.143997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e0d27-be34-4d48-ae6f-a66f7839bf81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:55.147549 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e0d27-be34-4d48-ae6f-a66f7839bf81 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:55.170849 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1142/2303] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:41:55.181089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ccf8f-2e53-4aca-8b1f-2f70a0c2f5e5 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:55.199334 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ccf8f-2e53-4aca-8b1f-2f70a0c2f5e5 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:55.222422 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924dbbb-5d03-400b-a64c-ffc41eb4287d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:55.223519 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924dbbb-5d03-400b-a64c-ffc41eb4287d admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:55.233082 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924dbbb-5d03-400b-a64c-ffc41eb4287d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:55.233669 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924dbbb-5d03-400b-a64c-ffc41eb4287d admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:55.234587 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924dbbb-5d03-400b-a64c-ffc41eb4287d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:55.236712 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924dbbb-5d03-400b-a64c-ffc41eb4287d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:55.310059 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1162/2304] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:41:55 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:55.316864 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e0d27-be34-4d48-ae6f-a66f7839bf81 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:55.363908 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e0d27-be34-4d48-ae6f-a66f7839bf81 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:55.547146 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8bc60-86f8-4d0d-8652-c461833b0df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:55.548309 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8bc60-86f8-4d0d-8652-c461833b0df4 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:55.548811 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8bc60-86f8-4d0d-8652-c461833b0df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:55.549364 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8bc60-86f8-4d0d-8652-c461833b0df4 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:55.551192 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8bc60-86f8-4d0d-8652-c461833b0df4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:55.558413 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8bc60-86f8-4d0d-8652-c461833b0df4 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:55.586661 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:55.615419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1143/2305] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:41:55 2022] POST /identity/v3/users => generated 289 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:41:55.620779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924dbbb-5d03-400b-a64c-ffc41eb4287d admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:55.637097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924dbbb-5d03-400b-a64c-ffc41eb4287d admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:55.643565 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcdd7c-855f-4829-8ce8-9a35d1db0e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:55.644392 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcdd7c-855f-4829-8ce8-9a35d1db0e1a admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:55.645236 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcdd7c-855f-4829-8ce8-9a35d1db0e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:55.648748 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcdd7c-855f-4829-8ce8-9a35d1db0e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:55.650073 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fcdd7c-855f-4829-8ce8-9a35d1db0e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:55.652397 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fcdd7c-855f-4829-8ce8-9a35d1db0e1a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:55.671425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8bc60-86f8-4d0d-8652-c461833b0df4 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:55.683988 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1163/2306] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:41:55.688844 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8bc60-86f8-4d0d-8652-c461833b0df4 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:55.700704 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7639ab-90ee-4af0-a4d2-918d58ce5305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:55.701722 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7639ab-90ee-4af0-a4d2-918d58ce5305 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:55.702271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7639ab-90ee-4af0-a4d2-918d58ce5305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:55.704417 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7639ab-90ee-4af0-a4d2-918d58ce5305 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:55.705244 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7639ab-90ee-4af0-a4d2-918d58ce5305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:55.709062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7639ab-90ee-4af0-a4d2-918d58ce5305 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:55.733323 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1144/2307] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:41:55.738312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcdd7c-855f-4829-8ce8-9a35d1db0e1a admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:55.754196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcdd7c-855f-4829-8ce8-9a35d1db0e1a admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:55.767027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b151c65-5167-4191-8098-30657592dbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:55.767027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b151c65-5167-4191-8098-30657592dbb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:55.767027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b151c65-5167-4191-8098-30657592dbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:55.767027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b151c65-5167-4191-8098-30657592dbb3 admin admin] PATH_INFO: `/v3/projects/a0b8e1674ef44c2890168067129f9d42/users/aa2921a09592482a9c09dd7eef259bd4/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:55.836725 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b151c65-5167-4191-8098-30657592dbb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b8e1674ef44c2890168067129f9d42, user_id=aa2921a09592482a9c09dd7eef259bd4, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:55.849113 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b151c65-5167-4191-8098-30657592dbb3 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:55.885210 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1164/2308] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:41:55 2022] PUT /identity/v3/projects/a0b8e1674ef44c2890168067129f9d42/users/aa2921a09592482a9c09dd7eef259bd4/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:41:55.893390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fbc0e-d6ee-43d1-af7f-684c5a3d1c5c None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:55.894404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fbc0e-d6ee-43d1-af7f-684c5a3d1c5c None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:55.894869 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fbc0e-d6ee-43d1-af7f-684c5a3d1c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:55.935086 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-2c0fbc0e-d6ee-43d1-af7f-684c5a3d1c5c None None] MFA Rules not processed for user `aa2921a09592482a9c09dd7eef259bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:55.937704 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-2c0fbc0e-d6ee-43d1-af7f-684c5a3d1c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:56.042384 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1145/2309] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:41:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:56.059992 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b151c65-5167-4191-8098-30657592dbb3 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:56.063103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9b151c65-5167-4191-8098-30657592dbb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:56.147611 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:56.233394 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b151c65-5167-4191-8098-30657592dbb3 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:56.242875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cb9af-27da-47b1-987f-9c17870e48ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df18e704834948c4bb480691fa8d0824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:56.243938 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cb9af-27da-47b1-987f-9c17870e48ae service glance] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:56.244463 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cb9af-27da-47b1-987f-9c17870e48ae service glance] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:56.244934 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cb9af-27da-47b1-987f-9c17870e48ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:56.262743 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280cb9af-27da-47b1-987f-9c17870e48ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:56.265635 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280cb9af-27da-47b1-987f-9c17870e48ae service glance] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:56.282383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1165/2310] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:41:56.485615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907235c-e6f2-4c27-93e3-d6a1f79372d4 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:56.486285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907235c-e6f2-4c27-93e3-d6a1f79372d4 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:56.486522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907235c-e6f2-4c27-93e3-d6a1f79372d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:56.529296 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-6907235c-e6f2-4c27-93e3-d6a1f79372d4 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:56.532795 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-6907235c-e6f2-4c27-93e3-d6a1f79372d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:56.705820 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1146/2311] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Aug 29 21:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:56.751441 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cb9af-27da-47b1-987f-9c17870e48ae service glance] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:56.754159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-280cb9af-27da-47b1-987f-9c17870e48ae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:56.942097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cb9af-27da-47b1-987f-9c17870e48ae service glance] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:56.953291 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7e208-fe4a-44ed-a482-bc2c79e99826 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:56.960229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7e208-fe4a-44ed-a482-bc2c79e99826 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:56.960229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7e208-fe4a-44ed-a482-bc2c79e99826 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:56.960229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7e208-fe4a-44ed-a482-bc2c79e99826 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:56.977812 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7e208-fe4a-44ed-a482-bc2c79e99826 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:56.979936 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7e208-fe4a-44ed-a482-bc2c79e99826 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:57.000656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1166/2312] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:01.665367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907235c-e6f2-4c27-93e3-d6a1f79372d4 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:01.666906 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-6907235c-e6f2-4c27-93e3-d6a1f79372d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:01.679905 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907235c-e6f2-4c27-93e3-d6a1f79372d4 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:01.685232 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd55194-e8dd-4eda-9d83-6da486927692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:01.685886 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd55194-e8dd-4eda-9d83-6da486927692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:01.686166 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd55194-e8dd-4eda-9d83-6da486927692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:01.686476 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd55194-e8dd-4eda-9d83-6da486927692 admin admin] PATH_INFO: `/v3/users/01f6120731eb4e41b11af19da9c45c91` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:01.688218 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd55194-e8dd-4eda-9d83-6da486927692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01f6120731eb4e41b11af19da9c45c91)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:01.690713 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd55194-e8dd-4eda-9d83-6da486927692 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:01.758164 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9fd55194-e8dd-4eda-9d83-6da486927692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01f6120731eb4e41b11af19da9c45c91'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:01.769616 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9fd55194-e8dd-4eda-9d83-6da486927692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01f6120731eb4e41b11af19da9c45c91'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:01.780475 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:INSERT=1,keystone:SELECT=91,keystone:DELETE=8 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:01.788506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9fd55194-e8dd-4eda-9d83-6da486927692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01f6120731eb4e41b11af19da9c45c91'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:01.790582 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9fd55194-e8dd-4eda-9d83-6da486927692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01f6120731eb4e41b11af19da9c45c91'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:01.792025 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9fd55194-e8dd-4eda-9d83-6da486927692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01f6120731eb4e41b11af19da9c45c91'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:01.818217 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1147/2313] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:42:01 2022] DELETE /identity/v3/users/01f6120731eb4e41b11af19da9c45c91 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:42:01.823932 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0f9da-7b61-4231-be62-82ece785d069 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:01.824739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0f9da-7b61-4231-be62-82ece785d069 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:01.824739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0f9da-7b61-4231-be62-82ece785d069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:01.848086 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-80d0f9da-7b61-4231-be62-82ece785d069 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:01.850091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-80d0f9da-7b61-4231-be62-82ece785d069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:01.948914 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1167/2314] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:42:01.959951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd55194-e8dd-4eda-9d83-6da486927692 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:01.961707 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-9fd55194-e8dd-4eda-9d83-6da486927692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:02.039964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd55194-e8dd-4eda-9d83-6da486927692 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:02.044683 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08254b8e-d492-487c-b43f-011c90152f3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:02.045750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08254b8e-d492-487c-b43f-011c90152f3e service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:02.046258 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08254b8e-d492-487c-b43f-011c90152f3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:02.046897 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08254b8e-d492-487c-b43f-011c90152f3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:02.059899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08254b8e-d492-487c-b43f-011c90152f3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:02.061947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08254b8e-d492-487c-b43f-011c90152f3e service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:02.074911 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1148/2315] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:02.602370 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0f9da-7b61-4231-be62-82ece785d069 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:02.604969 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-80d0f9da-7b61-4231-be62-82ece785d069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:02.634903 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0f9da-7b61-4231-be62-82ece785d069 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:02.653768 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d0503-c6f3-4904-a707-b84282d882fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:02.654980 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d0503-c6f3-4904-a707-b84282d882fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:02.655709 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d0503-c6f3-4904-a707-b84282d882fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:02.656242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d0503-c6f3-4904-a707-b84282d882fc admin admin] PATH_INFO: `/v3/projects/3161d3d0cdec4e89b8d4b42afa839ba6` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:02.658017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d0503-c6f3-4904-a707-b84282d882fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3161d3d0cdec4e89b8d4b42afa839ba6)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:02.661047 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d0503-c6f3-4904-a707-b84282d882fc admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:02.749760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:02.755399 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-851d0503-c6f3-4904-a707-b84282d882fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3161d3d0cdec4e89b8d4b42afa839ba6', 'request_id': 'req-851d0503-c6f3-4904-a707-b84282d882fc'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:02.764719 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-851d0503-c6f3-4904-a707-b84282d882fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3161d3d0cdec4e89b8d4b42afa839ba6', 'request_id': 'req-851d0503-c6f3-4904-a707-b84282d882fc'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:02.774158 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-851d0503-c6f3-4904-a707-b84282d882fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3161d3d0cdec4e89b8d4b42afa839ba6', 'request_id': 'req-851d0503-c6f3-4904-a707-b84282d882fc'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:02.795197 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-851d0503-c6f3-4904-a707-b84282d882fc admin admin] The token cache is being invalidate because project 3161d3d0cdec4e89b8d4b42afa839ba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:42:02.795544 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-851d0503-c6f3-4904-a707-b84282d882fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:02.796363 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-851d0503-c6f3-4904-a707-b84282d882fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:02.798150 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1168/2316] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:42:02 2022] DELETE /identity/v3/projects/3161d3d0cdec4e89b8d4b42afa839ba6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:42:02.804464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ea4a3-8bee-46c2-80c7-625c7a3580b1 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:02.805554 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ea4a3-8bee-46c2-80c7-625c7a3580b1 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:02.805960 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ea4a3-8bee-46c2-80c7-625c7a3580b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:02.841007 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-3a7ea4a3-8bee-46c2-80c7-625c7a3580b1 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:02.843213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-3a7ea4a3-8bee-46c2-80c7-625c7a3580b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:02.958497 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1149/2317] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:02.966742 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7004d-56e2-4aad-a423-d78c24eb4102 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:02.967303 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7004d-56e2-4aad-a423-d78c24eb4102 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:02.967685 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7004d-56e2-4aad-a423-d78c24eb4102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:03.002533 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f7d7004d-56e2-4aad-a423-d78c24eb4102 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:03.004906 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f7d7004d-56e2-4aad-a423-d78c24eb4102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:03.016713 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1169/2318] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:03.022050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ea4a3-8bee-46c2-80c7-625c7a3580b1 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:03.040981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ea4a3-8bee-46c2-80c7-625c7a3580b1 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:03.048219 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d98f0-1a9a-4bf1-ba78-c13b9e861ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:03.048966 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d98f0-1a9a-4bf1-ba78-c13b9e861ade admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:03.049338 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d98f0-1a9a-4bf1-ba78-c13b9e861ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:03.049713 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d98f0-1a9a-4bf1-ba78-c13b9e861ade admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:03.050559 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d98f0-1a9a-4bf1-ba78-c13b9e861ade admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:42:03.050974 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d98f0-1a9a-4bf1-ba78-c13b9e861ade admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:03.052985 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d98f0-1a9a-4bf1-ba78-c13b9e861ade admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:03.069667 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1150/2319] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:42:03.074962 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7004d-56e2-4aad-a423-d78c24eb4102 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:03.090152 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7004d-56e2-4aad-a423-d78c24eb4102 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:03.096146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafc639-d7e2-4e9b-bbfe-75b189e095d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:03.096920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafc639-d7e2-4e9b-bbfe-75b189e095d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:03.097322 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafc639-d7e2-4e9b-bbfe-75b189e095d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:03.097693 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafc639-d7e2-4e9b-bbfe-75b189e095d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:03.098454 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dafc639-d7e2-4e9b-bbfe-75b189e095d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:03.100719 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dafc639-d7e2-4e9b-bbfe-75b189e095d1 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:03.134696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1170/2320] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:42:03 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:42:03.142008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d98f0-1a9a-4bf1-ba78-c13b9e861ade admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:03.152846 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d98f0-1a9a-4bf1-ba78-c13b9e861ade admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:03.266078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad110635-083d-47a8-9eb1-4d9c8bad1e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:03.266906 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad110635-083d-47a8-9eb1-4d9c8bad1e17 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:03.267198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad110635-083d-47a8-9eb1-4d9c8bad1e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:03.267511 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad110635-083d-47a8-9eb1-4d9c8bad1e17 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:03.268631 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad110635-083d-47a8-9eb1-4d9c8bad1e17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:03.271771 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad110635-083d-47a8-9eb1-4d9c8bad1e17 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:03.306321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1151/2321] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:42:03 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:42:03.311501 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafc639-d7e2-4e9b-bbfe-75b189e095d1 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:03.331436 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafc639-d7e2-4e9b-bbfe-75b189e095d1 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:03.341177 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd7359-ec28-45a2-97a9-e14abbd4197d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:03.342145 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd7359-ec28-45a2-97a9-e14abbd4197d admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:03.342633 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd7359-ec28-45a2-97a9-e14abbd4197d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:03.343041 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd7359-ec28-45a2-97a9-e14abbd4197d admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:03.344088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd7359-ec28-45a2-97a9-e14abbd4197d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:03.351004 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd7359-ec28-45a2-97a9-e14abbd4197d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:03.368932 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1171/2322] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:42:03.373876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad110635-083d-47a8-9eb1-4d9c8bad1e17 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:03.385138 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:03.389949 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad110635-083d-47a8-9eb1-4d9c8bad1e17 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:03.398966 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4cffe-0376-448a-ba64-ee64341a61d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:03.399650 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4cffe-0376-448a-ba64-ee64341a61d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:03.400111 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4cffe-0376-448a-ba64-ee64341a61d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:03.400478 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4cffe-0376-448a-ba64-ee64341a61d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:03.401176 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4cffe-0376-448a-ba64-ee64341a61d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:03.402985 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4cffe-0376-448a-ba64-ee64341a61d7 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:03.415505 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1152/2323] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:42:03.421230 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd7359-ec28-45a2-97a9-e14abbd4197d admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:03.439657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd7359-ec28-45a2-97a9-e14abbd4197d admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:03.444966 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd764b-f7a9-4a82-b9f2-7d6a93a5a951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:03.446756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd764b-f7a9-4a82-b9f2-7d6a93a5a951 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:03.447264 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd764b-f7a9-4a82-b9f2-7d6a93a5a951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:03.447565 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd764b-f7a9-4a82-b9f2-7d6a93a5a951 admin admin] PATH_INFO: `/v3/projects/1eb005583e694aac90ec9f4d5fcb1aa6/users/1492ee44490f4372aa15ff391da1a8da/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:03.467116 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd764b-f7a9-4a82-b9f2-7d6a93a5a951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb005583e694aac90ec9f4d5fcb1aa6, user_id=1492ee44490f4372aa15ff391da1a8da, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:03.470179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd764b-f7a9-4a82-b9f2-7d6a93a5a951 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:03.496528 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1172/2324] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:42:03 2022] PUT /identity/v3/projects/1eb005583e694aac90ec9f4d5fcb1aa6/users/1492ee44490f4372aa15ff391da1a8da/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:42:03.503037 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a827fc0-a37a-47fd-8873-f203c32b4969 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:03.503371 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a827fc0-a37a-47fd-8873-f203c32b4969 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:03.503724 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a827fc0-a37a-47fd-8873-f203c32b4969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:03.539333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-8a827fc0-a37a-47fd-8873-f203c32b4969 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:03.541549 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-8a827fc0-a37a-47fd-8873-f203c32b4969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:03.638464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1153/2325] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:03.650707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd764b-f7a9-4a82-b9f2-7d6a93a5a951 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:03.652595 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a0dd764b-f7a9-4a82-b9f2-7d6a93a5a951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:03.731196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd764b-f7a9-4a82-b9f2-7d6a93a5a951 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:03.736595 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0d697-266c-4603-9a60-074dcfe1e8cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:03.737392 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0d697-266c-4603-9a60-074dcfe1e8cb service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:03.737719 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0d697-266c-4603-9a60-074dcfe1e8cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:03.738038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0d697-266c-4603-9a60-074dcfe1e8cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:03.750583 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0d697-266c-4603-9a60-074dcfe1e8cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:03.752145 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0d697-266c-4603-9a60-074dcfe1e8cb service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:03.770655 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1173/2326] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:10.818653 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4311511-ce2e-4085-b33c-2ca4a71b1d42 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:10.819474 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4311511-ce2e-4085-b33c-2ca4a71b1d42 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:10.819474 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4311511-ce2e-4085-b33c-2ca4a71b1d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:10.889477 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-b4311511-ce2e-4085-b33c-2ca4a71b1d42 None None] MFA Rules not processed for user `1492ee44490f4372aa15ff391da1a8da`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:10.890792 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-b4311511-ce2e-4085-b33c-2ca4a71b1d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:11.095175 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1154/2327] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:42:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:11.097975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0d697-266c-4603-9a60-074dcfe1e8cb service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:11.114329 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0d697-266c-4603-9a60-074dcfe1e8cb service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:11.120686 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7cf94e-e68a-43a0-bc92-890e90814290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:11.121645 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cf94e-e68a-43a0-bc92-890e90814290 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:11.122273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cf94e-e68a-43a0-bc92-890e90814290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:11.122924 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cf94e-e68a-43a0-bc92-890e90814290 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:11.124460 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7cf94e-e68a-43a0-bc92-890e90814290 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:11.154447 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7cf94e-e68a-43a0-bc92-890e90814290 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:11.250761 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1174/2328] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:42:11 2022] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:42:11.256808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4311511-ce2e-4085-b33c-2ca4a71b1d42 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:11.288595 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4311511-ce2e-4085-b33c-2ca4a71b1d42 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:11.430761 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc9742-5a02-4830-b19b-e3c0adfd453b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:11.431947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc9742-5a02-4830-b19b-e3c0adfd453b admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:11.432495 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc9742-5a02-4830-b19b-e3c0adfd453b admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:11.442178 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc9742-5a02-4830-b19b-e3c0adfd453b admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:11.442949 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc9742-5a02-4830-b19b-e3c0adfd453b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:11.446259 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc9742-5a02-4830-b19b-e3c0adfd453b admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:11.495562 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1155/2329] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:42:11 2022] POST /identity/v3/users => generated 292 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:42:11.501671 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7cf94e-e68a-43a0-bc92-890e90814290 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:11.520466 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7cf94e-e68a-43a0-bc92-890e90814290 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:11.528545 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df84775-e222-4d44-b5ef-371505625401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:11.529311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df84775-e222-4d44-b5ef-371505625401 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:11.529666 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df84775-e222-4d44-b5ef-371505625401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:11.530178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df84775-e222-4d44-b5ef-371505625401 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:11.530962 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df84775-e222-4d44-b5ef-371505625401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:11.533821 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df84775-e222-4d44-b5ef-371505625401 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:11.551335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1175/2330] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:42:11.556577 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc9742-5a02-4830-b19b-e3c0adfd453b admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:11.572208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc9742-5a02-4830-b19b-e3c0adfd453b admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:11.582061 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b71bf-33b5-4e07-b3cf-090a4b1036fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:11.582061 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b71bf-33b5-4e07-b3cf-090a4b1036fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:11.582061 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b71bf-33b5-4e07-b3cf-090a4b1036fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:11.582585 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b71bf-33b5-4e07-b3cf-090a4b1036fe admin admin] PATH_INFO: `/v3/projects/19328c25dd7c4ef5bbaec76b6bbbcd46/users/6985ba3846564a0a8f6c3f56fc0a9437/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:11.605538 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:11.618675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b71bf-33b5-4e07-b3cf-090a4b1036fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=19328c25dd7c4ef5bbaec76b6bbbcd46, user_id=6985ba3846564a0a8f6c3f56fc0a9437, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:11.624522 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b71bf-33b5-4e07-b3cf-090a4b1036fe admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:11.672137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1156/2331] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:42:11 2022] PUT /identity/v3/projects/19328c25dd7c4ef5bbaec76b6bbbcd46/users/6985ba3846564a0a8f6c3f56fc0a9437/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:42:11.677634 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df84775-e222-4d44-b5ef-371505625401 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:11.704213 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df84775-e222-4d44-b5ef-371505625401 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:11.882338 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:11.988998 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf61ac-2ed9-4762-b552-4aab91029759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:11.992205 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf61ac-2ed9-4762-b552-4aab91029759 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:11.993257 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf61ac-2ed9-4762-b552-4aab91029759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:11.993928 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf61ac-2ed9-4762-b552-4aab91029759 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:12.004516 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf61ac-2ed9-4762-b552-4aab91029759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:12.004516 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf61ac-2ed9-4762-b552-4aab91029759 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:12.045865 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1176/2332] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:42:12.046470 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b71bf-33b5-4e07-b3cf-090a4b1036fe admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:12.075517 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b71bf-33b5-4e07-b3cf-090a4b1036fe admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:12.100952 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8ef9c-8ae3-476c-9d11-9f27187a4089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:12.104275 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8ef9c-8ae3-476c-9d11-9f27187a4089 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:12.105542 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8ef9c-8ae3-476c-9d11-9f27187a4089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:12.106027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8ef9c-8ae3-476c-9d11-9f27187a4089 admin admin] PATH_INFO: `/v3/projects/19328c25dd7c4ef5bbaec76b6bbbcd46/users/6985ba3846564a0a8f6c3f56fc0a9437/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:12.115313 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8ef9c-8ae3-476c-9d11-9f27187a4089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19328c25dd7c4ef5bbaec76b6bbbcd46, user_id=6985ba3846564a0a8f6c3f56fc0a9437, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:12.124099 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8ef9c-8ae3-476c-9d11-9f27187a4089 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:12.163349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1157/2333] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:42:12 2022] PUT /identity/v3/projects/19328c25dd7c4ef5bbaec76b6bbbcd46/users/6985ba3846564a0a8f6c3f56fc0a9437/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:42:12.611666 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631ea94-91ba-47dc-9175-767d983d4c63 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:12.612585 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631ea94-91ba-47dc-9175-767d983d4c63 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:12.612749 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631ea94-91ba-47dc-9175-767d983d4c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:12.673179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d631ea94-91ba-47dc-9175-767d983d4c63 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:12.675555 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d631ea94-91ba-47dc-9175-767d983d4c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:12.882061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1177/2334] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Aug 29 21:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:13.175272 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8ef9c-8ae3-476c-9d11-9f27187a4089 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:13.180068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-aaf8ef9c-8ae3-476c-9d11-9f27187a4089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:13.378536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8ef9c-8ae3-476c-9d11-9f27187a4089 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:13.395750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47aecc-2e81-4f53-ba6b-27dd71c2c76b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:13.397069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47aecc-2e81-4f53-ba6b-27dd71c2c76b service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:13.397761 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47aecc-2e81-4f53-ba6b-27dd71c2c76b service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:13.398969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47aecc-2e81-4f53-ba6b-27dd71c2c76b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:13.414743 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47aecc-2e81-4f53-ba6b-27dd71c2c76b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:13.418568 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47aecc-2e81-4f53-ba6b-27dd71c2c76b service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:13.489146 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1158/2335] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:19.276397 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11328c36-5b86-4c30-bd9e-0e12dc9b0639 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:19.277077 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11328c36-5b86-4c30-bd9e-0e12dc9b0639 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:19.277666 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11328c36-5b86-4c30-bd9e-0e12dc9b0639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:19.367539 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-11328c36-5b86-4c30-bd9e-0e12dc9b0639 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:19.372546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-11328c36-5b86-4c30-bd9e-0e12dc9b0639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:19.414042 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1178/2336] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Aug 29 21:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:19.465279 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47aecc-2e81-4f53-ba6b-27dd71c2c76b service nova] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:19.467632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-9b47aecc-2e81-4f53-ba6b-27dd71c2c76b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:19.513854 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47aecc-2e81-4f53-ba6b-27dd71c2c76b service nova] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:19.532780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc072b4c-6fed-4044-97ef-6e7307a9e8fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:19.534416 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc072b4c-6fed-4044-97ef-6e7307a9e8fd service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:19.535592 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc072b4c-6fed-4044-97ef-6e7307a9e8fd service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:19.536405 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc072b4c-6fed-4044-97ef-6e7307a9e8fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:19.556518 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc072b4c-6fed-4044-97ef-6e7307a9e8fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:19.562635 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc072b4c-6fed-4044-97ef-6e7307a9e8fd service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:19.587316 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1159/2337] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:22.124275 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74096f99-aedd-4481-9088-bd19c67b32e9 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:22.125286 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74096f99-aedd-4481-9088-bd19c67b32e9 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:22.125700 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74096f99-aedd-4481-9088-bd19c67b32e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:22.217150 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-74096f99-aedd-4481-9088-bd19c67b32e9 None None] MFA Rules not processed for user `6985ba3846564a0a8f6c3f56fc0a9437`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:22.221618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-74096f99-aedd-4481-9088-bd19c67b32e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:22.447831 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1179/2338] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:42:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:22.478058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc072b4c-6fed-4044-97ef-6e7307a9e8fd service nova] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:22.506995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc072b4c-6fed-4044-97ef-6e7307a9e8fd service nova] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:22.523123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f82b5-ee26-4423-af7a-bc237b6bcca1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:22.526414 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f82b5-ee26-4423-af7a-bc237b6bcca1 service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:22.526613 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f82b5-ee26-4423-af7a-bc237b6bcca1 service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:22.526879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f82b5-ee26-4423-af7a-bc237b6bcca1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:22.693908 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f82b5-ee26-4423-af7a-bc237b6bcca1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:22.701038 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f82b5-ee26-4423-af7a-bc237b6bcca1 service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:22.718942 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1160/2339] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:24.813724 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03beb6e3-d03f-4958-9bad-18584ed97eff None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:24.814807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03beb6e3-d03f-4958-9bad-18584ed97eff None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:24.814807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03beb6e3-d03f-4958-9bad-18584ed97eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:24.905474 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-03beb6e3-d03f-4958-9bad-18584ed97eff None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:24.907436 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-03beb6e3-d03f-4958-9bad-18584ed97eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:24.924142 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1180/2340] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Aug 29 21:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:42:24.973488 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f82b5-ee26-4423-af7a-bc237b6bcca1 service nova] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:24.995716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f82b5-ee26-4423-af7a-bc237b6bcca1 service nova] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:25.019514 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ecc80-c409-4a95-925c-acc238ca1a0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:25.021592 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ecc80-c409-4a95-925c-acc238ca1a0b service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:25.023742 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ecc80-c409-4a95-925c-acc238ca1a0b service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:25.025088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ecc80-c409-4a95-925c-acc238ca1a0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:25.057393 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ecc80-c409-4a95-925c-acc238ca1a0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:25.061617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ecc80-c409-4a95-925c-acc238ca1a0b service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:25.112859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a932a-6ebc-4b5d-9bfb-6d6a67cefc29 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:25.113600 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a932a-6ebc-4b5d-9bfb-6d6a67cefc29 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:25.113838 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1161/2341] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:42:25.114503 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a932a-6ebc-4b5d-9bfb-6d6a67cefc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:25.157602 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-489a932a-6ebc-4b5d-9bfb-6d6a67cefc29 None None] MFA Rules not processed for user `1492ee44490f4372aa15ff391da1a8da`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:25.160406 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-489a932a-6ebc-4b5d-9bfb-6d6a67cefc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:25.177715 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1181/2342] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:42:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:26.663848 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ecc80-c409-4a95-925c-acc238ca1a0b service nova] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:26.665517 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-d53ecc80-c409-4a95-925c-acc238ca1a0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:26.696350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ecc80-c409-4a95-925c-acc238ca1a0b service nova] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:26.706631 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4873cd6-8dbd-4f54-a964-26e444f54708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:26.713592 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4873cd6-8dbd-4f54-a964-26e444f54708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:26.714051 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4873cd6-8dbd-4f54-a964-26e444f54708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:26.714711 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4873cd6-8dbd-4f54-a964-26e444f54708 admin admin] PATH_INFO: `/v3/users/ba3740be7eba4f8f9f29d53b89824d5d` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:26.716923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4873cd6-8dbd-4f54-a964-26e444f54708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba3740be7eba4f8f9f29d53b89824d5d)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:26.722433 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4873cd6-8dbd-4f54-a964-26e444f54708 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:26.794620 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:26.846801 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-c4873cd6-8dbd-4f54-a964-26e444f54708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba3740be7eba4f8f9f29d53b89824d5d'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:26.865163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-c4873cd6-8dbd-4f54-a964-26e444f54708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba3740be7eba4f8f9f29d53b89824d5d'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:26.907373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-c4873cd6-8dbd-4f54-a964-26e444f54708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba3740be7eba4f8f9f29d53b89824d5d'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:26.908945 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-c4873cd6-8dbd-4f54-a964-26e444f54708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba3740be7eba4f8f9f29d53b89824d5d'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:26.910333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-c4873cd6-8dbd-4f54-a964-26e444f54708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba3740be7eba4f8f9f29d53b89824d5d'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:26.940418 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1162/2343] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:42:26 2022] DELETE /identity/v3/users/ba3740be7eba4f8f9f29d53b89824d5d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:42:26.948837 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094182f3-c156-46e5-8c91-38b6b637ed78 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:26.949640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094182f3-c156-46e5-8c91-38b6b637ed78 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:26.949943 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094182f3-c156-46e5-8c91-38b6b637ed78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:26.985415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-094182f3-c156-46e5-8c91-38b6b637ed78 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:26.987719 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-094182f3-c156-46e5-8c91-38b6b637ed78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:27.080903 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:27.128035 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1182/2344] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:27.140687 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4873cd6-8dbd-4f54-a964-26e444f54708 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:27.143223 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-c4873cd6-8dbd-4f54-a964-26e444f54708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:27.305487 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4873cd6-8dbd-4f54-a964-26e444f54708 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:27.312344 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbc47f-5ef1-4b20-81b5-53a7a72be32e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:27.313421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbc47f-5ef1-4b20-81b5-53a7a72be32e service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:27.314445 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbc47f-5ef1-4b20-81b5-53a7a72be32e service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:27.314445 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbc47f-5ef1-4b20-81b5-53a7a72be32e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:27.334016 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbc47f-5ef1-4b20-81b5-53a7a72be32e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:27.337561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbc47f-5ef1-4b20-81b5-53a7a72be32e service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:27.366117 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1163/2345] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:27.911939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094182f3-c156-46e5-8c91-38b6b637ed78 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:27.915086 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-094182f3-c156-46e5-8c91-38b6b637ed78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:27.965170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094182f3-c156-46e5-8c91-38b6b637ed78 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:27.975585 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf58d52-2840-46a1-98e7-ab4f3f257061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:27.976925 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf58d52-2840-46a1-98e7-ab4f3f257061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:27.977232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf58d52-2840-46a1-98e7-ab4f3f257061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:27.979715 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf58d52-2840-46a1-98e7-ab4f3f257061 admin admin] PATH_INFO: `/v3/projects/dc2972f169774afab421a27c67c4e371` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:27.982228 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf58d52-2840-46a1-98e7-ab4f3f257061 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc2972f169774afab421a27c67c4e371)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:27.986556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf58d52-2840-46a1-98e7-ab4f3f257061 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:28.116577 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-eaf58d52-2840-46a1-98e7-ab4f3f257061 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc2972f169774afab421a27c67c4e371', 'request_id': 'req-eaf58d52-2840-46a1-98e7-ab4f3f257061'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:28.133875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-eaf58d52-2840-46a1-98e7-ab4f3f257061 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc2972f169774afab421a27c67c4e371', 'request_id': 'req-eaf58d52-2840-46a1-98e7-ab4f3f257061'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:28.148574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-eaf58d52-2840-46a1-98e7-ab4f3f257061 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc2972f169774afab421a27c67c4e371', 'request_id': 'req-eaf58d52-2840-46a1-98e7-ab4f3f257061'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:28.186612 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-eaf58d52-2840-46a1-98e7-ab4f3f257061 admin admin] The token cache is being invalidate because project dc2972f169774afab421a27c67c4e371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:42:28.187641 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-eaf58d52-2840-46a1-98e7-ab4f3f257061 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:28.189117 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-eaf58d52-2840-46a1-98e7-ab4f3f257061 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:28.192038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1183/2346] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:42:27 2022] DELETE /identity/v3/projects/dc2972f169774afab421a27c67c4e371 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:42:28.201372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbcdc7-0796-4790-b69a-716907eaacc7 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:28.203135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbcdc7-0796-4790-b69a-716907eaacc7 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:28.203934 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbcdc7-0796-4790-b69a-716907eaacc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:28.255846 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-dabbcdc7-0796-4790-b69a-716907eaacc7 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:28.264816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-dabbcdc7-0796-4790-b69a-716907eaacc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:28.452235 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1164/2347] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:28.462733 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a2045-f6c8-4cfd-833b-dac491c9e4a4 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:28.463466 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a2045-f6c8-4cfd-833b-dac491c9e4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:28.464084 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a2045-f6c8-4cfd-833b-dac491c9e4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:28.517813 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-942a2045-f6c8-4cfd-833b-dac491c9e4a4 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:28.520419 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-942a2045-f6c8-4cfd-833b-dac491c9e4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:28.545625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1184/2348] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:28.552672 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbcdc7-0796-4790-b69a-716907eaacc7 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:28.595119 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbcdc7-0796-4790-b69a-716907eaacc7 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:28.613144 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ca181-50a3-4cbb-b21f-d0b88c9c1cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:28.613925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ca181-50a3-4cbb-b21f-d0b88c9c1cdf admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:28.614200 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ca181-50a3-4cbb-b21f-d0b88c9c1cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:28.614606 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ca181-50a3-4cbb-b21f-d0b88c9c1cdf admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:28.615611 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ca181-50a3-4cbb-b21f-d0b88c9c1cdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:42:28.616088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ca181-50a3-4cbb-b21f-d0b88c9c1cdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:28.618813 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ca181-50a3-4cbb-b21f-d0b88c9c1cdf admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:28.641105 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1165/2349] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:42:28.644328 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a2045-f6c8-4cfd-833b-dac491c9e4a4 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:28.661837 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a2045-f6c8-4cfd-833b-dac491c9e4a4 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:28.680884 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65092c-649f-4342-b9f2-0e410183d3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:28.681194 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65092c-649f-4342-b9f2-0e410183d3fb admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:28.681801 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65092c-649f-4342-b9f2-0e410183d3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:28.682151 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65092c-649f-4342-b9f2-0e410183d3fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:28.684298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65092c-649f-4342-b9f2-0e410183d3fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:28.688555 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65092c-649f-4342-b9f2-0e410183d3fb admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:28.766392 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1185/2350] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:42:28 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:42:28.778962 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ca181-50a3-4cbb-b21f-d0b88c9c1cdf admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:28.802432 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ca181-50a3-4cbb-b21f-d0b88c9c1cdf admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:28.901827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:28.973733 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f1379-d516-409b-ad97-b0052b08ed37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:28.975009 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f1379-d516-409b-ad97-b0052b08ed37 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:28.975745 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f1379-d516-409b-ad97-b0052b08ed37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:28.976538 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f1379-d516-409b-ad97-b0052b08ed37 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:28.978531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f1379-d516-409b-ad97-b0052b08ed37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:28.985747 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f1379-d516-409b-ad97-b0052b08ed37 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:29.045702 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1166/2351] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:42:28 2022] POST /identity/v3/users => generated 288 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:42:29.047537 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65092c-649f-4342-b9f2-0e410183d3fb admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:29.072282 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65092c-649f-4342-b9f2-0e410183d3fb admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:29.080938 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec18de-85d4-4001-bdc4-fc80526bb240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:29.081780 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec18de-85d4-4001-bdc4-fc80526bb240 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:29.082633 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec18de-85d4-4001-bdc4-fc80526bb240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:29.082633 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec18de-85d4-4001-bdc4-fc80526bb240 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:29.083769 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec18de-85d4-4001-bdc4-fc80526bb240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:29.087113 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec18de-85d4-4001-bdc4-fc80526bb240 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:29.108624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1186/2352] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:42:29.115901 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f1379-d516-409b-ad97-b0052b08ed37 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:29.137971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f1379-d516-409b-ad97-b0052b08ed37 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:29.147729 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68ad4f-53ad-4969-8cfd-cd5bda983937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:29.149122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68ad4f-53ad-4969-8cfd-cd5bda983937 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:29.149682 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68ad4f-53ad-4969-8cfd-cd5bda983937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:29.150213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68ad4f-53ad-4969-8cfd-cd5bda983937 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:29.151598 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68ad4f-53ad-4969-8cfd-cd5bda983937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:29.155126 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68ad4f-53ad-4969-8cfd-cd5bda983937 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:29.186946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1167/2353] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:42:29.194162 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec18de-85d4-4001-bdc4-fc80526bb240 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:29.210902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec18de-85d4-4001-bdc4-fc80526bb240 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:29.219723 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e60f1-f87b-4892-855b-1795d325c969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:29.221133 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e60f1-f87b-4892-855b-1795d325c969 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:29.221788 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e60f1-f87b-4892-855b-1795d325c969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:29.222501 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e60f1-f87b-4892-855b-1795d325c969 admin admin] PATH_INFO: `/v3/projects/baf69d276eaa415bac9b8d9420009157/users/f28a5fec2b644619aa63f1fe1a8c83eb/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:29.270685 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e60f1-f87b-4892-855b-1795d325c969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baf69d276eaa415bac9b8d9420009157, user_id=f28a5fec2b644619aa63f1fe1a8c83eb, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:29.274797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e60f1-f87b-4892-855b-1795d325c969 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:29.302280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1187/2354] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:42:29 2022] PUT /identity/v3/projects/baf69d276eaa415bac9b8d9420009157/users/f28a5fec2b644619aa63f1fe1a8c83eb/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:42:29.324525 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e70678-e7e7-4226-8619-4b64cd01b9f5 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:29.326158 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e70678-e7e7-4226-8619-4b64cd01b9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:29.326895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e70678-e7e7-4226-8619-4b64cd01b9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:29.404762 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-69e70678-e7e7-4226-8619-4b64cd01b9f5 None None] MFA Rules not processed for user `f28a5fec2b644619aa63f1fe1a8c83eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:29.406445 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-69e70678-e7e7-4226-8619-4b64cd01b9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:29.576112 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1168/2355] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:42:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:29.597731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e60f1-f87b-4892-855b-1795d325c969 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:29.598066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d62e60f1-f87b-4892-855b-1795d325c969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:29.730584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e60f1-f87b-4892-855b-1795d325c969 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:29.737703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e6d54-1509-4829-abf0-d94fe4b5472f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:29.738823 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e6d54-1509-4829-abf0-d94fe4b5472f service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:29.739337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e6d54-1509-4829-abf0-d94fe4b5472f service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:29.739833 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e6d54-1509-4829-abf0-d94fe4b5472f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:29.758535 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e6d54-1509-4829-abf0-d94fe4b5472f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:29.761629 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e6d54-1509-4829-abf0-d94fe4b5472f service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:29.782327 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1188/2356] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:30.192742 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e9203-05bf-45cf-87f4-b339c5526659 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:30.193359 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e9203-05bf-45cf-87f4-b339c5526659 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:30.193672 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e9203-05bf-45cf-87f4-b339c5526659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:30.239253 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-1c4e9203-05bf-45cf-87f4-b339c5526659 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:30.241871 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-1c4e9203-05bf-45cf-87f4-b339c5526659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:30.422121 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1169/2357] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Aug 29 21:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:30.458017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e6d54-1509-4829-abf0-d94fe4b5472f service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:30.461091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-722e6d54-1509-4829-abf0-d94fe4b5472f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:30.496984 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:30.678541 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e6d54-1509-4829-abf0-d94fe4b5472f service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:30.689234 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08fe2a2-bf42-4a20-a4f7-f2f101879907 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:30.690278 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fe2a2-bf42-4a20-a4f7-f2f101879907 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:30.690582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fe2a2-bf42-4a20-a4f7-f2f101879907 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:30.690965 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fe2a2-bf42-4a20-a4f7-f2f101879907 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:30.705533 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08fe2a2-bf42-4a20-a4f7-f2f101879907 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:30.709197 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08fe2a2-bf42-4a20-a4f7-f2f101879907 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:30.734076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1189/2358] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:31.513200 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fb9b7-87e4-4045-bf1a-c90a1d3d845f None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:31.514058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fb9b7-87e4-4045-bf1a-c90a1d3d845f None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:31.514518 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fb9b7-87e4-4045-bf1a-c90a1d3d845f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:31.547516 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-9e1fb9b7-87e4-4045-bf1a-c90a1d3d845f None None] MFA Rules not processed for user `f28a5fec2b644619aa63f1fe1a8c83eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:31.548996 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-9e1fb9b7-87e4-4045-bf1a-c90a1d3d845f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:31.557389 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1170/2359] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:42:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:34.446614 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08fe2a2-bf42-4a20-a4f7-f2f101879907 service nova] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:34.448984 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d08fe2a2-bf42-4a20-a4f7-f2f101879907 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:34.465587 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08fe2a2-bf42-4a20-a4f7-f2f101879907 service nova] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:34.475350 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a564ce4-4acb-4e8e-9254-e32b6da076db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:34.477248 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a564ce4-4acb-4e8e-9254-e32b6da076db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:34.478069 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a564ce4-4acb-4e8e-9254-e32b6da076db admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:34.478827 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a564ce4-4acb-4e8e-9254-e32b6da076db admin admin] PATH_INFO: `/v3/users/aa2921a09592482a9c09dd7eef259bd4` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:34.484550 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a564ce4-4acb-4e8e-9254-e32b6da076db admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa2921a09592482a9c09dd7eef259bd4)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:34.490349 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a564ce4-4acb-4e8e-9254-e32b6da076db admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:34.595980 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9a564ce4-4acb-4e8e-9254-e32b6da076db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa2921a09592482a9c09dd7eef259bd4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:34.605242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9a564ce4-4acb-4e8e-9254-e32b6da076db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa2921a09592482a9c09dd7eef259bd4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:34.616114 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9a564ce4-4acb-4e8e-9254-e32b6da076db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa2921a09592482a9c09dd7eef259bd4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:34.617368 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9a564ce4-4acb-4e8e-9254-e32b6da076db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa2921a09592482a9c09dd7eef259bd4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:34.618833 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9a564ce4-4acb-4e8e-9254-e32b6da076db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa2921a09592482a9c09dd7eef259bd4'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:34.646411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1190/2360] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:42:34 2022] DELETE /identity/v3/users/aa2921a09592482a9c09dd7eef259bd4 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:42:34.656404 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64247d58-14c3-4442-a0af-97463c309bf4 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:34.657125 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64247d58-14c3-4442-a0af-97463c309bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:34.657563 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64247d58-14c3-4442-a0af-97463c309bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:34.710124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-64247d58-14c3-4442-a0af-97463c309bf4 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:34.713248 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-64247d58-14c3-4442-a0af-97463c309bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:34.824537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:34.885608 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1171/2361] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:34.901373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a564ce4-4acb-4e8e-9254-e32b6da076db admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:34.906458 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9a564ce4-4acb-4e8e-9254-e32b6da076db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:35.040557 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a564ce4-4acb-4e8e-9254-e32b6da076db admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:35.047400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da792b09-64a7-476d-9cd5-2789c067db5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:35.048530 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da792b09-64a7-476d-9cd5-2789c067db5e service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:35.048988 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da792b09-64a7-476d-9cd5-2789c067db5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:35.049312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da792b09-64a7-476d-9cd5-2789c067db5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:35.061409 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da792b09-64a7-476d-9cd5-2789c067db5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:35.062791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da792b09-64a7-476d-9cd5-2789c067db5e service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:35.080220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1191/2362] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:42:35.773098 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64247d58-14c3-4442-a0af-97463c309bf4 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:35.776000 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-64247d58-14c3-4442-a0af-97463c309bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:35.809566 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64247d58-14c3-4442-a0af-97463c309bf4 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:35.841053 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671f808-2069-453d-926e-528ab828b294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:35.842488 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671f808-2069-453d-926e-528ab828b294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:35.843189 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671f808-2069-453d-926e-528ab828b294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:35.843636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671f808-2069-453d-926e-528ab828b294 admin admin] PATH_INFO: `/v3/projects/a0b8e1674ef44c2890168067129f9d42` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:35.847233 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671f808-2069-453d-926e-528ab828b294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0b8e1674ef44c2890168067129f9d42)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:35.853899 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671f808-2069-453d-926e-528ab828b294 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:35.963688 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b671f808-2069-453d-926e-528ab828b294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0b8e1674ef44c2890168067129f9d42', 'request_id': 'req-b671f808-2069-453d-926e-528ab828b294'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:35.981358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b671f808-2069-453d-926e-528ab828b294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0b8e1674ef44c2890168067129f9d42', 'request_id': 'req-b671f808-2069-453d-926e-528ab828b294'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:35.997459 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b671f808-2069-453d-926e-528ab828b294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0b8e1674ef44c2890168067129f9d42', 'request_id': 'req-b671f808-2069-453d-926e-528ab828b294'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:36.022128 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b671f808-2069-453d-926e-528ab828b294 admin admin] The token cache is being invalidate because project a0b8e1674ef44c2890168067129f9d42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:42:36.022405 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b671f808-2069-453d-926e-528ab828b294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:36.023190 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b671f808-2069-453d-926e-528ab828b294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:36.024877 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1172/2363] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:42:35 2022] DELETE /identity/v3/projects/a0b8e1674ef44c2890168067129f9d42 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:42:36.033059 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e7ef9-2f1f-4e64-962e-bf75bae52fbc None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:36.033934 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e7ef9-2f1f-4e64-962e-bf75bae52fbc None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:36.034550 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e7ef9-2f1f-4e64-962e-bf75bae52fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:36.051886 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:36.071104 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-b09e7ef9-2f1f-4e64-962e-bf75bae52fbc None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:36.075020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b09e7ef9-2f1f-4e64-962e-bf75bae52fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:36.205924 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1192/2364] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:36.219647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24f34b-63ad-468e-a5a9-99ec0fec70d2 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:36.220163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24f34b-63ad-468e-a5a9-99ec0fec70d2 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:36.220685 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24f34b-63ad-468e-a5a9-99ec0fec70d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:36.252090 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-db24f34b-63ad-468e-a5a9-99ec0fec70d2 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:36.254347 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-db24f34b-63ad-468e-a5a9-99ec0fec70d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:36.267258 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1173/2365] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:36.273077 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e7ef9-2f1f-4e64-962e-bf75bae52fbc None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:36.293329 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e7ef9-2f1f-4e64-962e-bf75bae52fbc None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:36.301812 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c1209-61be-4532-b450-7ff422f1f477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:36.302836 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c1209-61be-4532-b450-7ff422f1f477 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:36.303280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c1209-61be-4532-b450-7ff422f1f477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:36.303756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c1209-61be-4532-b450-7ff422f1f477 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:36.305112 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c1209-61be-4532-b450-7ff422f1f477 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:42:36.305575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c1209-61be-4532-b450-7ff422f1f477 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:36.307962 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c1209-61be-4532-b450-7ff422f1f477 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:36.335787 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1193/2366] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:42:36.338117 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24f34b-63ad-468e-a5a9-99ec0fec70d2 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:36.350472 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24f34b-63ad-468e-a5a9-99ec0fec70d2 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:36.357661 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a4e9e-7965-4163-ba85-99fd436f39c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:36.358753 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a4e9e-7965-4163-ba85-99fd436f39c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:36.359262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a4e9e-7965-4163-ba85-99fd436f39c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:36.359781 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a4e9e-7965-4163-ba85-99fd436f39c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:36.360960 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a4e9e-7965-4163-ba85-99fd436f39c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:36.364669 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a4e9e-7965-4163-ba85-99fd436f39c7 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:36.427021 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1174/2367] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:42:36 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:42:36.436751 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c1209-61be-4532-b450-7ff422f1f477 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:36.456302 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c1209-61be-4532-b450-7ff422f1f477 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:36.608379 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ef9c3-e949-4b9c-9d6d-faea48d37df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:36.609609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ef9c3-e949-4b9c-9d6d-faea48d37df8 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:36.609959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ef9c3-e949-4b9c-9d6d-faea48d37df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:36.610408 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ef9c3-e949-4b9c-9d6d-faea48d37df8 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:36.611891 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ef9c3-e949-4b9c-9d6d-faea48d37df8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:36.616013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ef9c3-e949-4b9c-9d6d-faea48d37df8 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:36.650290 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1194/2368] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:42:36 2022] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:42:36.657689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a4e9e-7965-4163-ba85-99fd436f39c7 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:36.677170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a4e9e-7965-4163-ba85-99fd436f39c7 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:36.686017 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23921f6b-090e-4d64-a647-33f0b4bfa923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:36.687100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23921f6b-090e-4d64-a647-33f0b4bfa923 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:36.687994 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23921f6b-090e-4d64-a647-33f0b4bfa923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:36.688497 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23921f6b-090e-4d64-a647-33f0b4bfa923 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:36.689561 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23921f6b-090e-4d64-a647-33f0b4bfa923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:36.692597 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23921f6b-090e-4d64-a647-33f0b4bfa923 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:36.717334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1175/2369] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:42:36.722391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ef9c3-e949-4b9c-9d6d-faea48d37df8 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:36.750923 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ef9c3-e949-4b9c-9d6d-faea48d37df8 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:36.757537 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df833c-1a9b-43cc-9045-a71a60b5ecf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:36.758426 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df833c-1a9b-43cc-9045-a71a60b5ecf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:36.758814 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df833c-1a9b-43cc-9045-a71a60b5ecf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:36.759223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df833c-1a9b-43cc-9045-a71a60b5ecf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:36.760039 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df833c-1a9b-43cc-9045-a71a60b5ecf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:36.761976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df833c-1a9b-43cc-9045-a71a60b5ecf2 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:36.778971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1195/2370] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:42:36.782195 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23921f6b-090e-4d64-a647-33f0b4bfa923 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:36.798337 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23921f6b-090e-4d64-a647-33f0b4bfa923 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:36.806919 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bab59-1715-43af-b7af-c7442aa385d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:36.807639 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bab59-1715-43af-b7af-c7442aa385d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:36.807998 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bab59-1715-43af-b7af-c7442aa385d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:36.808383 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bab59-1715-43af-b7af-c7442aa385d3 admin admin] PATH_INFO: `/v3/projects/845b97c4ceb740e79670eb2d5404c724/users/fe7848b1850249c0bec07b166f50c8e5/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:36.833546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277bab59-1715-43af-b7af-c7442aa385d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=845b97c4ceb740e79670eb2d5404c724, user_id=fe7848b1850249c0bec07b166f50c8e5, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:36.837137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277bab59-1715-43af-b7af-c7442aa385d3 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:36.861797 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1176/2371] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:42:36 2022] PUT /identity/v3/projects/845b97c4ceb740e79670eb2d5404c724/users/fe7848b1850249c0bec07b166f50c8e5/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:42:36.879449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c16206-c4d3-4db9-95d4-f2663ef30d52 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:36.879745 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c16206-c4d3-4db9-95d4-f2663ef30d52 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:36.880107 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c16206-c4d3-4db9-95d4-f2663ef30d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:36.935119 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-54c16206-c4d3-4db9-95d4-f2663ef30d52 None None] MFA Rules not processed for user `fe7848b1850249c0bec07b166f50c8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:36.936507 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-54c16206-c4d3-4db9-95d4-f2663ef30d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:37.042456 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:37.062211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1196/2372] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:42:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:37.091839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bab59-1715-43af-b7af-c7442aa385d3 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:37.108812 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-277bab59-1715-43af-b7af-c7442aa385d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:37.284314 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bab59-1715-43af-b7af-c7442aa385d3 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:37.297174 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947390f-db62-4621-adbf-58f99766ef4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:37.298328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947390f-db62-4621-adbf-58f99766ef4f service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:37.298898 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947390f-db62-4621-adbf-58f99766ef4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:37.299389 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947390f-db62-4621-adbf-58f99766ef4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:37.337827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947390f-db62-4621-adbf-58f99766ef4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:37.343670 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947390f-db62-4621-adbf-58f99766ef4f service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:37.352007 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:37.362633 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1177/2373] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:43.987957 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c16206-c4d3-4db9-95d4-f2663ef30d52 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:44.086583 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c16206-c4d3-4db9-95d4-f2663ef30d52 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:44.095209 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b848b4-2664-404e-b387-b0fd1bed3137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:44.096389 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b848b4-2664-404e-b387-b0fd1bed3137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:44.096896 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b848b4-2664-404e-b387-b0fd1bed3137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:44.097403 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b848b4-2664-404e-b387-b0fd1bed3137 admin admin] PATH_INFO: `/v3/users/fe7848b1850249c0bec07b166f50c8e5` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:44.099560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b848b4-2664-404e-b387-b0fd1bed3137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe7848b1850249c0bec07b166f50c8e5)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:44.104076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b848b4-2664-404e-b387-b0fd1bed3137 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:44.183573 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-54b848b4-2664-404e-b387-b0fd1bed3137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe7848b1850249c0bec07b166f50c8e5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:44.193824 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-54b848b4-2664-404e-b387-b0fd1bed3137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe7848b1850249c0bec07b166f50c8e5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:44.203615 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-54b848b4-2664-404e-b387-b0fd1bed3137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe7848b1850249c0bec07b166f50c8e5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:44.204425 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-54b848b4-2664-404e-b387-b0fd1bed3137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe7848b1850249c0bec07b166f50c8e5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:44.205239 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-54b848b4-2664-404e-b387-b0fd1bed3137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe7848b1850249c0bec07b166f50c8e5'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:44.231192 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1197/2374] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:42:43 2022] DELETE /identity/v3/users/fe7848b1850249c0bec07b166f50c8e5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:42:44.236442 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ba0d7-71e4-4d64-828a-9d802de78050 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:44.237151 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ba0d7-71e4-4d64-828a-9d802de78050 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:44.237151 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ba0d7-71e4-4d64-828a-9d802de78050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:44.265033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-352ba0d7-71e4-4d64-828a-9d802de78050 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:44.267189 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-352ba0d7-71e4-4d64-828a-9d802de78050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:44.374524 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1178/2375] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:44.387985 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b848b4-2664-404e-b387-b0fd1bed3137 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:44.389841 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-54b848b4-2664-404e-b387-b0fd1bed3137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:44.484010 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b848b4-2664-404e-b387-b0fd1bed3137 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:44.488875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd728f88-4f85-4e1e-8778-5757a42dbeb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:44.489691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd728f88-4f85-4e1e-8778-5757a42dbeb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:44.489984 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd728f88-4f85-4e1e-8778-5757a42dbeb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:44.490264 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd728f88-4f85-4e1e-8778-5757a42dbeb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:44.503252 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd728f88-4f85-4e1e-8778-5757a42dbeb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:44.504799 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd728f88-4f85-4e1e-8778-5757a42dbeb8 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:44.516984 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1198/2376] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:45.022619 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ba0d7-71e4-4d64-828a-9d802de78050 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:45.026127 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-352ba0d7-71e4-4d64-828a-9d802de78050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:45.060513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ba0d7-71e4-4d64-828a-9d802de78050 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:45.077170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d062d-9061-4ba1-ac8d-aea7653d963c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:45.078070 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d062d-9061-4ba1-ac8d-aea7653d963c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:45.078529 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d062d-9061-4ba1-ac8d-aea7653d963c admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:45.078943 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d062d-9061-4ba1-ac8d-aea7653d963c admin admin] PATH_INFO: `/v3/projects/845b97c4ceb740e79670eb2d5404c724` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:45.081558 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d062d-9061-4ba1-ac8d-aea7653d963c admin admin] RBAC: Authorizing `identity:delete_project(project_id=845b97c4ceb740e79670eb2d5404c724)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:45.086063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d062d-9061-4ba1-ac8d-aea7653d963c admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:45.165376 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a16d062d-9061-4ba1-ac8d-aea7653d963c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '845b97c4ceb740e79670eb2d5404c724', 'request_id': 'req-a16d062d-9061-4ba1-ac8d-aea7653d963c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:45.176685 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a16d062d-9061-4ba1-ac8d-aea7653d963c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '845b97c4ceb740e79670eb2d5404c724', 'request_id': 'req-a16d062d-9061-4ba1-ac8d-aea7653d963c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:45.185424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a16d062d-9061-4ba1-ac8d-aea7653d963c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '845b97c4ceb740e79670eb2d5404c724', 'request_id': 'req-a16d062d-9061-4ba1-ac8d-aea7653d963c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:45.208082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a16d062d-9061-4ba1-ac8d-aea7653d963c admin admin] The token cache is being invalidate because project 845b97c4ceb740e79670eb2d5404c724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:42:45.208497 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a16d062d-9061-4ba1-ac8d-aea7653d963c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:45.209443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a16d062d-9061-4ba1-ac8d-aea7653d963c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:45.211153 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1179/2377] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:42:45 2022] DELETE /identity/v3/projects/845b97c4ceb740e79670eb2d5404c724 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:42:45.217405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd422e0b-fb0e-43d5-a3ae-f0cfc5debbbc None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:45.218317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd422e0b-fb0e-43d5-a3ae-f0cfc5debbbc None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:45.218496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd422e0b-fb0e-43d5-a3ae-f0cfc5debbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:45.240349 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-fd422e0b-fb0e-43d5-a3ae-f0cfc5debbbc None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:45.241940 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fd422e0b-fb0e-43d5-a3ae-f0cfc5debbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:45.269418 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:45.333136 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1199/2378] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:45.341977 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c54b9c-b0dd-4f29-9fec-39277951deae None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:45.342622 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c54b9c-b0dd-4f29-9fec-39277951deae None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:45.342622 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c54b9c-b0dd-4f29-9fec-39277951deae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:45.365259 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-f2c54b9c-b0dd-4f29-9fec-39277951deae None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:45.366580 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f2c54b9c-b0dd-4f29-9fec-39277951deae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:45.375679 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1180/2379] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:42:45.380480 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd422e0b-fb0e-43d5-a3ae-f0cfc5debbbc None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:45.390856 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd422e0b-fb0e-43d5-a3ae-f0cfc5debbbc None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:45.396756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69291741-c2cd-4769-8213-37935c625769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:45.397708 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69291741-c2cd-4769-8213-37935c625769 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:45.398190 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69291741-c2cd-4769-8213-37935c625769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:45.398693 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69291741-c2cd-4769-8213-37935c625769 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:45.400602 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69291741-c2cd-4769-8213-37935c625769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:42:45.401176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69291741-c2cd-4769-8213-37935c625769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:45.403204 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69291741-c2cd-4769-8213-37935c625769 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:45.418437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1200/2380] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:42:45.423079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c54b9c-b0dd-4f29-9fec-39277951deae None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:45.435466 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c54b9c-b0dd-4f29-9fec-39277951deae None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:45.441723 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc73b66-b02b-41c2-ba48-c3e3459b31be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:45.442380 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc73b66-b02b-41c2-ba48-c3e3459b31be admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:45.442755 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc73b66-b02b-41c2-ba48-c3e3459b31be admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:45.443128 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc73b66-b02b-41c2-ba48-c3e3459b31be admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:45.444110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc73b66-b02b-41c2-ba48-c3e3459b31be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:45.446487 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc73b66-b02b-41c2-ba48-c3e3459b31be admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:45.484015 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1181/2381] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:42:45 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:42:45.491470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69291741-c2cd-4769-8213-37935c625769 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:45.509925 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69291741-c2cd-4769-8213-37935c625769 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:45.580530 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8de24-3655-4f55-aa84-7ed65c2fbe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:45.581372 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8de24-3655-4f55-aa84-7ed65c2fbe33 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:45.581650 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8de24-3655-4f55-aa84-7ed65c2fbe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:45.582098 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8de24-3655-4f55-aa84-7ed65c2fbe33 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:45.585086 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8de24-3655-4f55-aa84-7ed65c2fbe33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:45.587995 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8de24-3655-4f55-aa84-7ed65c2fbe33 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:45.614584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1201/2382] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:42:45 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:42:45.618380 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc73b66-b02b-41c2-ba48-c3e3459b31be admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:45.630211 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc73b66-b02b-41c2-ba48-c3e3459b31be admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:45.640000 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dcd54-087d-46f4-8a9a-3e6b86a569cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:45.640967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dcd54-087d-46f4-8a9a-3e6b86a569cc admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:45.641248 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dcd54-087d-46f4-8a9a-3e6b86a569cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:45.641516 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dcd54-087d-46f4-8a9a-3e6b86a569cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:45.642371 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5dcd54-087d-46f4-8a9a-3e6b86a569cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:45.644429 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5dcd54-087d-46f4-8a9a-3e6b86a569cc admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:45.656856 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1182/2383] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:42:45.661542 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8de24-3655-4f55-aa84-7ed65c2fbe33 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:45.673238 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8de24-3655-4f55-aa84-7ed65c2fbe33 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:45.678805 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11fc35-90d4-46ec-a50f-ffdc37b6433b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:45.679451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11fc35-90d4-46ec-a50f-ffdc37b6433b admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:45.679732 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11fc35-90d4-46ec-a50f-ffdc37b6433b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:45.680001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11fc35-90d4-46ec-a50f-ffdc37b6433b admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:45.680733 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11fc35-90d4-46ec-a50f-ffdc37b6433b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:45.682340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11fc35-90d4-46ec-a50f-ffdc37b6433b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:45.694947 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1202/2384] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:42:45.700107 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dcd54-087d-46f4-8a9a-3e6b86a569cc admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:45.714763 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dcd54-087d-46f4-8a9a-3e6b86a569cc admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:45.721150 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac679935-361e-4033-8524-45fe5e88b8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:45.721974 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac679935-361e-4033-8524-45fe5e88b8d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:45.722293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac679935-361e-4033-8524-45fe5e88b8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:45.722634 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac679935-361e-4033-8524-45fe5e88b8d5 admin admin] PATH_INFO: `/v3/projects/98ff435588e74c1fa96219a3be42c6ad/users/01ac32a81e024b2289743dc138b20b0b/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:45.743390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac679935-361e-4033-8524-45fe5e88b8d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98ff435588e74c1fa96219a3be42c6ad, user_id=01ac32a81e024b2289743dc138b20b0b, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:45.748648 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac679935-361e-4033-8524-45fe5e88b8d5 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:45.767204 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1183/2385] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:42:45 2022] PUT /identity/v3/projects/98ff435588e74c1fa96219a3be42c6ad/users/01ac32a81e024b2289743dc138b20b0b/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:42:45.843569 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588042f0-5fbe-4ca2-9207-7109c8ceadce None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:45.844095 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588042f0-5fbe-4ca2-9207-7109c8ceadce None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:45.844617 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588042f0-5fbe-4ca2-9207-7109c8ceadce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:45.894046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-588042f0-5fbe-4ca2-9207-7109c8ceadce None None] MFA Rules not processed for user `01ac32a81e024b2289743dc138b20b0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:45.895324 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-588042f0-5fbe-4ca2-9207-7109c8ceadce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:45.996635 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1203/2386] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:42:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:46.002451 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac679935-361e-4033-8524-45fe5e88b8d5 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:46.034928 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:46.103399 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac679935-361e-4033-8524-45fe5e88b8d5 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:46.109257 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb2dfa-077a-467b-9a8e-57114a0cdce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:46.109886 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb2dfa-077a-467b-9a8e-57114a0cdce3 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:46.110166 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb2dfa-077a-467b-9a8e-57114a0cdce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:46.110436 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb2dfa-077a-467b-9a8e-57114a0cdce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:46.111137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb2dfa-077a-467b-9a8e-57114a0cdce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:46.113161 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb2dfa-077a-467b-9a8e-57114a0cdce3 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:46.153093 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1184/2387] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:42:46 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:42:46.171079 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588042f0-5fbe-4ca2-9207-7109c8ceadce None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:46.192261 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588042f0-5fbe-4ca2-9207-7109c8ceadce None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:46.221017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:46.305031 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd10a82-17c1-4335-8829-70a11796ebd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:46.306063 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd10a82-17c1-4335-8829-70a11796ebd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:46.306581 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd10a82-17c1-4335-8829-70a11796ebd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:46.307075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd10a82-17c1-4335-8829-70a11796ebd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:46.308332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd10a82-17c1-4335-8829-70a11796ebd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:46.312247 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd10a82-17c1-4335-8829-70a11796ebd7 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:46.349748 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1204/2388] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:42:46 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:42:46.353448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb2dfa-077a-467b-9a8e-57114a0cdce3 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:46.366437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb2dfa-077a-467b-9a8e-57114a0cdce3 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:46.372421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7524696-5d64-4d41-9c74-6bced367d002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:46.373077 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7524696-5d64-4d41-9c74-6bced367d002 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:46.373376 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7524696-5d64-4d41-9c74-6bced367d002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:46.373729 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7524696-5d64-4d41-9c74-6bced367d002 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:46.374292 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7524696-5d64-4d41-9c74-6bced367d002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:46.376236 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7524696-5d64-4d41-9c74-6bced367d002 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:46.390672 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1185/2389] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:42:46.395695 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd10a82-17c1-4335-8829-70a11796ebd7 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:46.412365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd10a82-17c1-4335-8829-70a11796ebd7 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:46.420656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176be397-65ae-43d5-90d6-b350b48bf23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:46.421654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176be397-65ae-43d5-90d6-b350b48bf23e admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:46.422120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176be397-65ae-43d5-90d6-b350b48bf23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:46.422585 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176be397-65ae-43d5-90d6-b350b48bf23e admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:46.423691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176be397-65ae-43d5-90d6-b350b48bf23e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:46.427042 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176be397-65ae-43d5-90d6-b350b48bf23e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:46.450460 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1205/2390] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:42:46.457023 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7524696-5d64-4d41-9c74-6bced367d002 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:46.469774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7524696-5d64-4d41-9c74-6bced367d002 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:46.479448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b4f07-964e-40f1-938d-e633360034e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:46.479448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b4f07-964e-40f1-938d-e633360034e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:46.479448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b4f07-964e-40f1-938d-e633360034e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:46.479448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b4f07-964e-40f1-938d-e633360034e2 admin admin] PATH_INFO: `/v3/projects/087fe75b57ca4de293c5cca8a03013ad/users/84095a0d702b4508a67cb54cc6039433/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:46.500873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b4f07-964e-40f1-938d-e633360034e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=087fe75b57ca4de293c5cca8a03013ad, user_id=84095a0d702b4508a67cb54cc6039433, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:46.504152 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b4f07-964e-40f1-938d-e633360034e2 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:46.523635 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1186/2391] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:42:46 2022] PUT /identity/v3/projects/087fe75b57ca4de293c5cca8a03013ad/users/84095a0d702b4508a67cb54cc6039433/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:42:46.534944 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224ed8d-6bc5-4aeb-bcc2-741b94743b84 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:46.535394 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224ed8d-6bc5-4aeb-bcc2-741b94743b84 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:46.535844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224ed8d-6bc5-4aeb-bcc2-741b94743b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:46.576606 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d224ed8d-6bc5-4aeb-bcc2-741b94743b84 None None] MFA Rules not processed for user `84095a0d702b4508a67cb54cc6039433`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:46.577841 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d224ed8d-6bc5-4aeb-bcc2-741b94743b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:46.665476 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1206/2392] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:42:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:42:46.670991 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b4f07-964e-40f1-938d-e633360034e2 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:46.789334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b4f07-964e-40f1-938d-e633360034e2 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:46.798918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b9c87-f341-450c-afe3-6ad59bceef7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:46.800001 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b9c87-f341-450c-afe3-6ad59bceef7a admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:46.800556 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b9c87-f341-450c-afe3-6ad59bceef7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:46.801059 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b9c87-f341-450c-afe3-6ad59bceef7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:46.802276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b9c87-f341-450c-afe3-6ad59bceef7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:46.806540 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b9c87-f341-450c-afe3-6ad59bceef7a admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:46.857865 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1187/2393] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:42:46 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:42:46.862813 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224ed8d-6bc5-4aeb-bcc2-741b94743b84 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:46.875399 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224ed8d-6bc5-4aeb-bcc2-741b94743b84 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:46.950702 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f3bf4-24e9-4dff-887a-e353a4fd1544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:46.951326 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f3bf4-24e9-4dff-887a-e353a4fd1544 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:46.951707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f3bf4-24e9-4dff-887a-e353a4fd1544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:46.951895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f3bf4-24e9-4dff-887a-e353a4fd1544 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:46.952549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f3bf4-24e9-4dff-887a-e353a4fd1544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:46.954794 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f3bf4-24e9-4dff-887a-e353a4fd1544 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:46.982024 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1207/2394] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:42:46 2022] POST /identity/v3/users => generated 295 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:42:46.986301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b9c87-f341-450c-afe3-6ad59bceef7a admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:47.002315 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b9c87-f341-450c-afe3-6ad59bceef7a admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:47.010822 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449ef35-4f89-42f7-a12c-40ca27cefd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:47.011727 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449ef35-4f89-42f7-a12c-40ca27cefd44 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:47.012135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449ef35-4f89-42f7-a12c-40ca27cefd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:47.012411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449ef35-4f89-42f7-a12c-40ca27cefd44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:47.013247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449ef35-4f89-42f7-a12c-40ca27cefd44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:47.015113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449ef35-4f89-42f7-a12c-40ca27cefd44 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:47.032536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1188/2395] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:42:47.036165 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f3bf4-24e9-4dff-887a-e353a4fd1544 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:47.050462 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f3bf4-24e9-4dff-887a-e353a4fd1544 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:47.057182 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf787fe-f117-4888-9cb6-3b628334c2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:47.058011 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf787fe-f117-4888-9cb6-3b628334c2c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:47.058384 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf787fe-f117-4888-9cb6-3b628334c2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:47.058750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf787fe-f117-4888-9cb6-3b628334c2c8 admin admin] PATH_INFO: `/v3/projects/673951ad25684d6894f4138a3fc88784/users/d5202f4345df4386a2b574e25784a057/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:47.076523 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:47.084868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf787fe-f117-4888-9cb6-3b628334c2c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=673951ad25684d6894f4138a3fc88784, user_id=d5202f4345df4386a2b574e25784a057, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:47.090077 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf787fe-f117-4888-9cb6-3b628334c2c8 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:47.109444 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1208/2396] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:42:47 2022] PUT /identity/v3/projects/673951ad25684d6894f4138a3fc88784/users/d5202f4345df4386a2b574e25784a057/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:42:47.115690 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449ef35-4f89-42f7-a12c-40ca27cefd44 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:47.133105 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449ef35-4f89-42f7-a12c-40ca27cefd44 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:47.215367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:47.232076 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eebdb7-7c94-402a-ba03-d6da84605c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:47.232731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eebdb7-7c94-402a-ba03-d6da84605c64 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:47.233011 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eebdb7-7c94-402a-ba03-d6da84605c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:47.233316 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eebdb7-7c94-402a-ba03-d6da84605c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:47.233952 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eebdb7-7c94-402a-ba03-d6da84605c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:47.236123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eebdb7-7c94-402a-ba03-d6da84605c64 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:47.259325 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1189/2397] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:42:47.264135 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf787fe-f117-4888-9cb6-3b628334c2c8 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:47.282754 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf787fe-f117-4888-9cb6-3b628334c2c8 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:47.293959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da1dce-d209-4b59-a952-968d9469399c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:47.295323 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da1dce-d209-4b59-a952-968d9469399c admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:47.295850 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da1dce-d209-4b59-a952-968d9469399c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:47.296393 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da1dce-d209-4b59-a952-968d9469399c admin admin] PATH_INFO: `/v3/projects/673951ad25684d6894f4138a3fc88784/users/d5202f4345df4386a2b574e25784a057/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:47.301733 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da1dce-d209-4b59-a952-968d9469399c admin admin] RBAC: Authorizing `identity:create_grant(project_id=673951ad25684d6894f4138a3fc88784, user_id=d5202f4345df4386a2b574e25784a057, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:47.308625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da1dce-d209-4b59-a952-968d9469399c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:47.330635 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1209/2398] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:42:47 2022] PUT /identity/v3/projects/673951ad25684d6894f4138a3fc88784/users/d5202f4345df4386a2b574e25784a057/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:42:47.349430 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbfeed-5199-49db-9eed-262a2970c517 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:47.349904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbfeed-5199-49db-9eed-262a2970c517 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:47.350363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbfeed-5199-49db-9eed-262a2970c517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:47.402913 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-69cbfeed-5199-49db-9eed-262a2970c517 None None] MFA Rules not processed for user `d5202f4345df4386a2b574e25784a057`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:47.405185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-69cbfeed-5199-49db-9eed-262a2970c517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:47.533966 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1190/2399] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:42:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:47.547963 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da1dce-d209-4b59-a952-968d9469399c admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:47.550324 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f9da1dce-d209-4b59-a952-968d9469399c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:47.640163 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da1dce-d209-4b59-a952-968d9469399c admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:47.647933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ac422-0dd1-4dd1-a988-bde768fa9077 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:47.647933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ac422-0dd1-4dd1-a988-bde768fa9077 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:47.647933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ac422-0dd1-4dd1-a988-bde768fa9077 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:47.647933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ac422-0dd1-4dd1-a988-bde768fa9077 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:47.745403 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ac422-0dd1-4dd1-a988-bde768fa9077 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:47.747575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ac422-0dd1-4dd1-a988-bde768fa9077 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:47.760275 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1210/2400] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:49.523969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbfeed-5199-49db-9eed-262a2970c517 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:49.545960 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbfeed-5199-49db-9eed-262a2970c517 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:49.553093 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1ec19-8895-4c7e-a45b-212337faa587 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:49.554311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1ec19-8895-4c7e-a45b-212337faa587 service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:49.554822 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1ec19-8895-4c7e-a45b-212337faa587 service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:49.555571 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1ec19-8895-4c7e-a45b-212337faa587 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:49.688265 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1ec19-8895-4c7e-a45b-212337faa587 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:49.691598 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1ec19-8895-4c7e-a45b-212337faa587 service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:49.732911 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1191/2401] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:42:50.832328 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ac422-0dd1-4dd1-a988-bde768fa9077 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:50.845324 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ac422-0dd1-4dd1-a988-bde768fa9077 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:50.849824 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d938fe-dd75-4c78-ba4e-738f661a56ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:50.850468 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d938fe-dd75-4c78-ba4e-738f661a56ae service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:50.850748 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d938fe-dd75-4c78-ba4e-738f661a56ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:50.851021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d938fe-dd75-4c78-ba4e-738f661a56ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:50.864693 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d938fe-dd75-4c78-ba4e-738f661a56ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:50.866221 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d938fe-dd75-4c78-ba4e-738f661a56ae service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:50.886960 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1211/2402] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:53.109417 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1ec19-8895-4c7e-a45b-212337faa587 service cinder] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:53.114172 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-fcb1ec19-8895-4c7e-a45b-212337faa587 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:53.280366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1ec19-8895-4c7e-a45b-212337faa587 service cinder] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:53.287079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a9fa2-3fc6-439a-adc3-e5937111ff3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7911672bb2a471daf4f69ba940ef41d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:53.288052 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a9fa2-3fc6-439a-adc3-e5937111ff3f service placement] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:53.288555 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a9fa2-3fc6-439a-adc3-e5937111ff3f service placement] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:53.289721 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a9fa2-3fc6-439a-adc3-e5937111ff3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:53.291465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-106a9fa2-3fc6-439a-adc3-e5937111ff3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:53.302075 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:53.309568 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a9fa2-3fc6-439a-adc3-e5937111ff3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:53.312970 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a9fa2-3fc6-439a-adc3-e5937111ff3f service placement] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:53.334372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1192/2403] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:55.354225 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d938fe-dd75-4c78-ba4e-738f661a56ae service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:55.463246 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d938fe-dd75-4c78-ba4e-738f661a56ae service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:55.471159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22608d06-a24a-4fd5-894f-0fd5a8d30385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:55.472465 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22608d06-a24a-4fd5-894f-0fd5a8d30385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:55.473092 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22608d06-a24a-4fd5-894f-0fd5a8d30385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:55.473655 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22608d06-a24a-4fd5-894f-0fd5a8d30385 admin admin] PATH_INFO: `/v3/users/01ac32a81e024b2289743dc138b20b0b` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:55.476167 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22608d06-a24a-4fd5-894f-0fd5a8d30385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01ac32a81e024b2289743dc138b20b0b)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:55.480556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22608d06-a24a-4fd5-894f-0fd5a8d30385 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:55.528257 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:55.585820 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-22608d06-a24a-4fd5-894f-0fd5a8d30385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01ac32a81e024b2289743dc138b20b0b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:55.601055 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-22608d06-a24a-4fd5-894f-0fd5a8d30385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01ac32a81e024b2289743dc138b20b0b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:55.614842 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-22608d06-a24a-4fd5-894f-0fd5a8d30385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01ac32a81e024b2289743dc138b20b0b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:55.615686 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-22608d06-a24a-4fd5-894f-0fd5a8d30385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01ac32a81e024b2289743dc138b20b0b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:55.616549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-22608d06-a24a-4fd5-894f-0fd5a8d30385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01ac32a81e024b2289743dc138b20b0b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:55.647067 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1212/2404] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:42:55 2022] DELETE /identity/v3/users/01ac32a81e024b2289743dc138b20b0b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:42:55.654984 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c3764-90aa-4f4a-ab19-758bbdb41b03 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:55.655759 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c3764-90aa-4f4a-ab19-758bbdb41b03 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:55.655955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c3764-90aa-4f4a-ab19-758bbdb41b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:55.696924 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-149c3764-90aa-4f4a-ab19-758bbdb41b03 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:55.700689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-149c3764-90aa-4f4a-ab19-758bbdb41b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:55.939882 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1193/2405] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:55.954120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22608d06-a24a-4fd5-894f-0fd5a8d30385 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:55.957663 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-22608d06-a24a-4fd5-894f-0fd5a8d30385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:56.067510 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22608d06-a24a-4fd5-894f-0fd5a8d30385 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:56.075069 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbfe9a-2804-49fe-aa10-14b54ca8268c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:56.075979 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbfe9a-2804-49fe-aa10-14b54ca8268c service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:56.076465 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbfe9a-2804-49fe-aa10-14b54ca8268c service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:56.076940 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbfe9a-2804-49fe-aa10-14b54ca8268c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:56.091535 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbfe9a-2804-49fe-aa10-14b54ca8268c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:56.094307 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbfe9a-2804-49fe-aa10-14b54ca8268c service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:56.110269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1213/2406] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:56.897804 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c3764-90aa-4f4a-ab19-758bbdb41b03 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:56.900855 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-149c3764-90aa-4f4a-ab19-758bbdb41b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:56.936228 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c3764-90aa-4f4a-ab19-758bbdb41b03 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:56.955559 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8569331-3121-4e6c-9d8a-6cd6e45e3ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:56.956232 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8569331-3121-4e6c-9d8a-6cd6e45e3ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:56.956503 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8569331-3121-4e6c-9d8a-6cd6e45e3ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:56.957022 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8569331-3121-4e6c-9d8a-6cd6e45e3ce0 admin admin] PATH_INFO: `/v3/projects/98ff435588e74c1fa96219a3be42c6ad` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:56.962049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8569331-3121-4e6c-9d8a-6cd6e45e3ce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98ff435588e74c1fa96219a3be42c6ad)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:56.964124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8569331-3121-4e6c-9d8a-6cd6e45e3ce0 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:57.050358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f8569331-3121-4e6c-9d8a-6cd6e45e3ce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98ff435588e74c1fa96219a3be42c6ad', 'request_id': 'req-f8569331-3121-4e6c-9d8a-6cd6e45e3ce0'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:57.083958 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f8569331-3121-4e6c-9d8a-6cd6e45e3ce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98ff435588e74c1fa96219a3be42c6ad', 'request_id': 'req-f8569331-3121-4e6c-9d8a-6cd6e45e3ce0'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:57.105339 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f8569331-3121-4e6c-9d8a-6cd6e45e3ce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98ff435588e74c1fa96219a3be42c6ad', 'request_id': 'req-f8569331-3121-4e6c-9d8a-6cd6e45e3ce0'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:57.132239 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f8569331-3121-4e6c-9d8a-6cd6e45e3ce0 admin admin] The token cache is being invalidate because project 98ff435588e74c1fa96219a3be42c6ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:42:57.132672 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f8569331-3121-4e6c-9d8a-6cd6e45e3ce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:57.133203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f8569331-3121-4e6c-9d8a-6cd6e45e3ce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:57.135169 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1194/2407] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:42:56 2022] DELETE /identity/v3/projects/98ff435588e74c1fa96219a3be42c6ad => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:42:57.145796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbfe9a-2804-49fe-aa10-14b54ca8268c service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:57.183022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbfe9a-2804-49fe-aa10-14b54ca8268c service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:57.325353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14bb36-471e-45fe-b3c4-a16ace7196f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:57.326286 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14bb36-471e-45fe-b3c4-a16ace7196f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:57.326583 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14bb36-471e-45fe-b3c4-a16ace7196f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:57.327103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14bb36-471e-45fe-b3c4-a16ace7196f3 admin admin] PATH_INFO: `/v3/users/84095a0d702b4508a67cb54cc6039433` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:57.334416 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14bb36-471e-45fe-b3c4-a16ace7196f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84095a0d702b4508a67cb54cc6039433)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:57.334416 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14bb36-471e-45fe-b3c4-a16ace7196f3 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:57.409926 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:57.418745 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6d14bb36-471e-45fe-b3c4-a16ace7196f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84095a0d702b4508a67cb54cc6039433'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:57.433613 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6d14bb36-471e-45fe-b3c4-a16ace7196f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84095a0d702b4508a67cb54cc6039433'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:57.447358 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6d14bb36-471e-45fe-b3c4-a16ace7196f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84095a0d702b4508a67cb54cc6039433'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:57.453090 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6d14bb36-471e-45fe-b3c4-a16ace7196f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84095a0d702b4508a67cb54cc6039433'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:57.454271 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6d14bb36-471e-45fe-b3c4-a16ace7196f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84095a0d702b4508a67cb54cc6039433'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:57.503410 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1214/2408] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:42:57 2022] DELETE /identity/v3/users/84095a0d702b4508a67cb54cc6039433 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:42:58.370724 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8569331-3121-4e6c-9d8a-6cd6e45e3ce0 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:58.372435 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f8569331-3121-4e6c-9d8a-6cd6e45e3ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:58.410665 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8569331-3121-4e6c-9d8a-6cd6e45e3ce0 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:58.569005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e06bb7-4843-40a0-b822-2c75424dd79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:58.572270 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e06bb7-4843-40a0-b822-2c75424dd79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:58.574439 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e06bb7-4843-40a0-b822-2c75424dd79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:58.575629 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e06bb7-4843-40a0-b822-2c75424dd79e admin admin] PATH_INFO: `/v3/projects/087fe75b57ca4de293c5cca8a03013ad` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:58.578573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e06bb7-4843-40a0-b822-2c75424dd79e admin admin] RBAC: Authorizing `identity:delete_project(project_id=087fe75b57ca4de293c5cca8a03013ad)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:58.585002 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e06bb7-4843-40a0-b822-2c75424dd79e admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:58.648353 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:58.711199 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-34e06bb7-4843-40a0-b822-2c75424dd79e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '087fe75b57ca4de293c5cca8a03013ad', 'request_id': 'req-34e06bb7-4843-40a0-b822-2c75424dd79e'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:58.731381 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-34e06bb7-4843-40a0-b822-2c75424dd79e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '087fe75b57ca4de293c5cca8a03013ad', 'request_id': 'req-34e06bb7-4843-40a0-b822-2c75424dd79e'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:58.742946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-34e06bb7-4843-40a0-b822-2c75424dd79e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '087fe75b57ca4de293c5cca8a03013ad', 'request_id': 'req-34e06bb7-4843-40a0-b822-2c75424dd79e'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:58.779868 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-34e06bb7-4843-40a0-b822-2c75424dd79e admin admin] The token cache is being invalidate because project 087fe75b57ca4de293c5cca8a03013ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:42:58.780741 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-34e06bb7-4843-40a0-b822-2c75424dd79e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:58.782357 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-34e06bb7-4843-40a0-b822-2c75424dd79e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:58.785305 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1195/2409] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:42:58 2022] DELETE /identity/v3/projects/087fe75b57ca4de293c5cca8a03013ad => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:42:58.792061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14bb36-471e-45fe-b3c4-a16ace7196f3 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:58.794823 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-6d14bb36-471e-45fe-b3c4-a16ace7196f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:58.822184 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14bb36-471e-45fe-b3c4-a16ace7196f3 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:58.951773 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba19386-8733-467c-82d2-0fcb3a9f84b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:58.952757 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba19386-8733-467c-82d2-0fcb3a9f84b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:58.953167 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba19386-8733-467c-82d2-0fcb3a9f84b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:58.953625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba19386-8733-467c-82d2-0fcb3a9f84b1 admin admin] PATH_INFO: `/v3/users/d5202f4345df4386a2b574e25784a057` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:58.955419 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba19386-8733-467c-82d2-0fcb3a9f84b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5202f4345df4386a2b574e25784a057)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:58.957634 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba19386-8733-467c-82d2-0fcb3a9f84b1 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:59.052972 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-dba19386-8733-467c-82d2-0fcb3a9f84b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5202f4345df4386a2b574e25784a057'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:59.068255 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-dba19386-8733-467c-82d2-0fcb3a9f84b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5202f4345df4386a2b574e25784a057'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:59.085995 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-dba19386-8733-467c-82d2-0fcb3a9f84b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5202f4345df4386a2b574e25784a057'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:59.089614 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-dba19386-8733-467c-82d2-0fcb3a9f84b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5202f4345df4386a2b574e25784a057'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:59.090740 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-dba19386-8733-467c-82d2-0fcb3a9f84b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5202f4345df4386a2b574e25784a057'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:42:59.135445 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1215/2410] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:42:58 2022] DELETE /identity/v3/users/d5202f4345df4386a2b574e25784a057 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:42:59.856577 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f472b-48b3-4ebb-8c5d-84c85bfc7bf0 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:59.857618 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f472b-48b3-4ebb-8c5d-84c85bfc7bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:59.857907 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f472b-48b3-4ebb-8c5d-84c85bfc7bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:59.879842 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-9c8f472b-48b3-4ebb-8c5d-84c85bfc7bf0 None None] MFA Rules not processed for user `80ddaebaf27649ceaa6fb13e0c6b1e20`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:59.881494 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-9c8f472b-48b3-4ebb-8c5d-84c85bfc7bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:59.942473 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f0512-dad7-45f2-9b60-c4734df6498b None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:59.943057 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f0512-dad7-45f2-9b60-c4734df6498b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:59.943219 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f0512-dad7-45f2-9b60-c4734df6498b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:59.973512 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-248f0512-dad7-45f2-9b60-c4734df6498b None None] MFA Rules not processed for user `540e06e694524c4a9e84ebebd45956d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:59.976062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-248f0512-dad7-45f2-9b60-c4734df6498b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:00.009904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1196/2411] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:42:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:00.064876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:00.145342 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1216/2412] 10.222.0.69 () {58 vars in 1009 bytes} [Mon Aug 29 21:42:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:00.146592 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f472b-48b3-4ebb-8c5d-84c85bfc7bf0 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:00.148218 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-9c8f472b-48b3-4ebb-8c5d-84c85bfc7bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:00.222728 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f0512-dad7-45f2-9b60-c4734df6498b None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:00.224220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-248f0512-dad7-45f2-9b60-c4734df6498b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:00.277861 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f472b-48b3-4ebb-8c5d-84c85bfc7bf0 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:00.284564 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770bf0f-c0c4-45db-ae87-76bce8e61966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:00.285508 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770bf0f-c0c4-45db-ae87-76bce8e61966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:00.285687 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770bf0f-c0c4-45db-ae87-76bce8e61966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:00.286069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770bf0f-c0c4-45db-ae87-76bce8e61966 admin admin] PATH_INFO: `/v3/projects/673951ad25684d6894f4138a3fc88784` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:00.287395 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770bf0f-c0c4-45db-ae87-76bce8e61966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=673951ad25684d6894f4138a3fc88784)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:00.289831 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770bf0f-c0c4-45db-ae87-76bce8e61966 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:00.329043 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f0512-dad7-45f2-9b60-c4734df6498b None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:00.338271 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e512b-6a97-4529-985c-b7fd890ccb25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '714a2ba019144211931dbe853f1960aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:00.340341 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e512b-6a97-4529-985c-b7fd890ccb25 service swift] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:00.340598 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e512b-6a97-4529-985c-b7fd890ccb25 service swift] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:00.341042 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e512b-6a97-4529-985c-b7fd890ccb25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:00.359839 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e512b-6a97-4529-985c-b7fd890ccb25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:00.363365 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-7770bf0f-c0c4-45db-ae87-76bce8e61966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '673951ad25684d6894f4138a3fc88784', 'request_id': 'req-7770bf0f-c0c4-45db-ae87-76bce8e61966'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:00.363585 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e512b-6a97-4529-985c-b7fd890ccb25 service swift] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:00.370758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-7770bf0f-c0c4-45db-ae87-76bce8e61966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '673951ad25684d6894f4138a3fc88784', 'request_id': 'req-7770bf0f-c0c4-45db-ae87-76bce8e61966'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:00.372355 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:00.379141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1217/2413] 10.222.0.69 () {60 vars in 1384 bytes} [Mon Aug 29 21:43:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:43:00.390538 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-7770bf0f-c0c4-45db-ae87-76bce8e61966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '673951ad25684d6894f4138a3fc88784', 'request_id': 'req-7770bf0f-c0c4-45db-ae87-76bce8e61966'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:00.434007 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-7770bf0f-c0c4-45db-ae87-76bce8e61966 admin admin] The token cache is being invalidate because project 673951ad25684d6894f4138a3fc88784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:43:00.434504 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-7770bf0f-c0c4-45db-ae87-76bce8e61966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:00.435734 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-7770bf0f-c0c4-45db-ae87-76bce8e61966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:00.438155 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1197/2414] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:43:00 2022] DELETE /identity/v3/projects/673951ad25684d6894f4138a3fc88784 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:43:09.399126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f475c-040d-4f8a-8fb3-98593d6c1af2 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:09.399873 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f475c-040d-4f8a-8fb3-98593d6c1af2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:09.401169 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f475c-040d-4f8a-8fb3-98593d6c1af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:09.445492 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-096f475c-040d-4f8a-8fb3-98593d6c1af2 None None] MFA Rules not processed for user `540e06e694524c4a9e84ebebd45956d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:09.447006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-096f475c-040d-4f8a-8fb3-98593d6c1af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:09.552170 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1218/2415] 10.222.0.69 () {58 vars in 1009 bytes} [Mon Aug 29 21:43:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:09.756350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770bf0f-c0c4-45db-ae87-76bce8e61966 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:09.758896 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-7770bf0f-c0c4-45db-ae87-76bce8e61966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:09.903719 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770bf0f-c0c4-45db-ae87-76bce8e61966 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:09.922054 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87885587-30b2-49a0-8543-66871b3fb65b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '714a2ba019144211931dbe853f1960aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:09.923069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87885587-30b2-49a0-8543-66871b3fb65b service swift] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:09.923570 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87885587-30b2-49a0-8543-66871b3fb65b service swift] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:09.924209 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87885587-30b2-49a0-8543-66871b3fb65b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:09.936046 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87885587-30b2-49a0-8543-66871b3fb65b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:09.939675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87885587-30b2-49a0-8543-66871b3fb65b service swift] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:09.951970 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1198/2416] 10.222.0.69 () {60 vars in 1384 bytes} [Mon Aug 29 21:43:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 21:43:11.314519 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79721f0-9950-44ed-a75b-130f82f99c92 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:11.315550 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79721f0-9950-44ed-a75b-130f82f99c92 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:11.316074 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79721f0-9950-44ed-a75b-130f82f99c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:11.340166 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-e79721f0-9950-44ed-a75b-130f82f99c92 None None] MFA Rules not processed for user `540e06e694524c4a9e84ebebd45956d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:11.341996 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e79721f0-9950-44ed-a75b-130f82f99c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:11.351581 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1219/2417] 10.222.0.69 () {58 vars in 967 bytes} [Mon Aug 29 21:43:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:11.378551 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87885587-30b2-49a0-8543-66871b3fb65b service swift] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:11.391043 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87885587-30b2-49a0-8543-66871b3fb65b service swift] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:11.400794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ee034-3990-4d25-a653-e019e8f0e65a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '714a2ba019144211931dbe853f1960aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:11.401945 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ee034-3990-4d25-a653-e019e8f0e65a service swift] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:11.402230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ee034-3990-4d25-a653-e019e8f0e65a service swift] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:11.402505 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ee034-3990-4d25-a653-e019e8f0e65a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:11.423687 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ee034-3990-4d25-a653-e019e8f0e65a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:11.427423 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ee034-3990-4d25-a653-e019e8f0e65a service swift] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:11.451795 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1199/2418] 10.222.0.69 () {60 vars in 1384 bytes} [Mon Aug 29 21:43:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:43:11.911451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd41ce-cab6-41fd-b0e4-b2000a1ee6bd None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:11.912232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd41ce-cab6-41fd-b0e4-b2000a1ee6bd None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:11.912738 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd41ce-cab6-41fd-b0e4-b2000a1ee6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:11.962159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d1dd41ce-cab6-41fd-b0e4-b2000a1ee6bd None None] MFA Rules not processed for user `540e06e694524c4a9e84ebebd45956d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:11.964538 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d1dd41ce-cab6-41fd-b0e4-b2000a1ee6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:11.985728 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1220/2419] 10.222.0.69 () {58 vars in 1009 bytes} [Mon Aug 29 21:43:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:43:12.003907 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ee034-3990-4d25-a653-e019e8f0e65a service swift] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:12.020269 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ee034-3990-4d25-a653-e019e8f0e65a service swift] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:12.036027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69ec99-1c2e-4255-aa89-7bc026484250 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '714a2ba019144211931dbe853f1960aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:12.036993 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69ec99-1c2e-4255-aa89-7bc026484250 service swift] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:12.039302 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69ec99-1c2e-4255-aa89-7bc026484250 service swift] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:12.039845 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69ec99-1c2e-4255-aa89-7bc026484250 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:12.058356 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69ec99-1c2e-4255-aa89-7bc026484250 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:12.060341 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69ec99-1c2e-4255-aa89-7bc026484250 service swift] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:12.071468 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1200/2420] 10.222.0.69 () {60 vars in 1384 bytes} [Mon Aug 29 21:43:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:43:12.852527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795883b7-8894-46bc-a69d-816c863d0bb6 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:12.853475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795883b7-8894-46bc-a69d-816c863d0bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:12.853770 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795883b7-8894-46bc-a69d-816c863d0bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:12.918218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-795883b7-8894-46bc-a69d-816c863d0bb6 None None] MFA Rules not processed for user `540e06e694524c4a9e84ebebd45956d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:12.921545 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-795883b7-8894-46bc-a69d-816c863d0bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:12.957921 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1221/2421] 10.222.0.69 () {58 vars in 967 bytes} [Mon Aug 29 21:43:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:13.006616 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69ec99-1c2e-4255-aa89-7bc026484250 service swift] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:13.036012 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69ec99-1c2e-4255-aa89-7bc026484250 service swift] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:13.054589 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66727cf5-0e15-446e-af8a-1e563c274d1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '714a2ba019144211931dbe853f1960aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:13.055240 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66727cf5-0e15-446e-af8a-1e563c274d1f service swift] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:13.055524 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66727cf5-0e15-446e-af8a-1e563c274d1f service swift] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:13.055800 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66727cf5-0e15-446e-af8a-1e563c274d1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:13.082103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66727cf5-0e15-446e-af8a-1e563c274d1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:13.086008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66727cf5-0e15-446e-af8a-1e563c274d1f service swift] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:13.123416 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1201/2422] 10.222.0.69 () {60 vars in 1384 bytes} [Mon Aug 29 21:43:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:43:15.333118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795883b7-8894-46bc-a69d-816c863d0bb6 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:15.335383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-795883b7-8894-46bc-a69d-816c863d0bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:15.406522 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795883b7-8894-46bc-a69d-816c863d0bb6 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:15.413490 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa2890-a9cc-4a19-a54a-d2da318eafc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:15.414306 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa2890-a9cc-4a19-a54a-d2da318eafc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:15.414590 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa2890-a9cc-4a19-a54a-d2da318eafc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:15.414865 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa2890-a9cc-4a19-a54a-d2da318eafc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:15.418271 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-36aa2890-a9cc-4a19-a54a-d2da318eafc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:15.433006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:15.501047 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa2890-a9cc-4a19-a54a-d2da318eafc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:15.502519 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa2890-a9cc-4a19-a54a-d2da318eafc6 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:15.515331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1222/2423] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:16.213176 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66727cf5-0e15-446e-af8a-1e563c274d1f service swift] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:16.215550 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-66727cf5-0e15-446e-af8a-1e563c274d1f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:16.332464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66727cf5-0e15-446e-af8a-1e563c274d1f service swift] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:16.337775 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecb43c-335f-4df5-a809-7aac0807fe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:16.338953 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecb43c-335f-4df5-a809-7aac0807fe44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:16.339235 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecb43c-335f-4df5-a809-7aac0807fe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:16.339511 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecb43c-335f-4df5-a809-7aac0807fe44 admin admin] PATH_INFO: `/v3/users/f28a5fec2b644619aa63f1fe1a8c83eb` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:16.340809 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aecb43c-335f-4df5-a809-7aac0807fe44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f28a5fec2b644619aa63f1fe1a8c83eb)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:16.342844 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aecb43c-335f-4df5-a809-7aac0807fe44 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:16.419311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:16.441136 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9aecb43c-335f-4df5-a809-7aac0807fe44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f28a5fec2b644619aa63f1fe1a8c83eb'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:16.454008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9aecb43c-335f-4df5-a809-7aac0807fe44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f28a5fec2b644619aa63f1fe1a8c83eb'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:16.484846 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9aecb43c-335f-4df5-a809-7aac0807fe44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f28a5fec2b644619aa63f1fe1a8c83eb'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:16.486102 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9aecb43c-335f-4df5-a809-7aac0807fe44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f28a5fec2b644619aa63f1fe1a8c83eb'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:16.486905 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9aecb43c-335f-4df5-a809-7aac0807fe44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f28a5fec2b644619aa63f1fe1a8c83eb'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:16.509303 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1202/2424] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:43:16 2022] DELETE /identity/v3/users/f28a5fec2b644619aa63f1fe1a8c83eb => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:43:16.519377 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee9d1f-e1b8-4187-aac5-1c36550335f4 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:16.521735 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee9d1f-e1b8-4187-aac5-1c36550335f4 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:16.521735 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee9d1f-e1b8-4187-aac5-1c36550335f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:16.561896 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-cfee9d1f-e1b8-4187-aac5-1c36550335f4 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:16.564358 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cfee9d1f-e1b8-4187-aac5-1c36550335f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:16.697294 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1223/2425] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:16.713500 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecb43c-335f-4df5-a809-7aac0807fe44 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:16.716484 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-9aecb43c-335f-4df5-a809-7aac0807fe44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:16.888306 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecb43c-335f-4df5-a809-7aac0807fe44 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:16.897433 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0b368-c5ce-44f4-a50f-d95f4208324e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:16.898676 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0b368-c5ce-44f4-a50f-d95f4208324e service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:16.899180 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0b368-c5ce-44f4-a50f-d95f4208324e service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:16.899679 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0b368-c5ce-44f4-a50f-d95f4208324e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:16.925564 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0b368-c5ce-44f4-a50f-d95f4208324e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:16.929202 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0b368-c5ce-44f4-a50f-d95f4208324e service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:16.953482 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1203/2426] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:18.028641 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee9d1f-e1b8-4187-aac5-1c36550335f4 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:18.030519 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cfee9d1f-e1b8-4187-aac5-1c36550335f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:18.048864 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee9d1f-e1b8-4187-aac5-1c36550335f4 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:18.056282 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef3941-f80c-4212-b056-6766aa49c93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:18.057581 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef3941-f80c-4212-b056-6766aa49c93a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:18.058057 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef3941-f80c-4212-b056-6766aa49c93a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:18.058535 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef3941-f80c-4212-b056-6766aa49c93a admin admin] PATH_INFO: `/v3/projects/baf69d276eaa415bac9b8d9420009157` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:18.060692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef3941-f80c-4212-b056-6766aa49c93a admin admin] RBAC: Authorizing `identity:delete_project(project_id=baf69d276eaa415bac9b8d9420009157)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:18.069537 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef3941-f80c-4212-b056-6766aa49c93a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:18.138905 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-19ef3941-f80c-4212-b056-6766aa49c93a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baf69d276eaa415bac9b8d9420009157', 'request_id': 'req-19ef3941-f80c-4212-b056-6766aa49c93a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:18.148542 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-19ef3941-f80c-4212-b056-6766aa49c93a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baf69d276eaa415bac9b8d9420009157', 'request_id': 'req-19ef3941-f80c-4212-b056-6766aa49c93a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:18.157158 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-19ef3941-f80c-4212-b056-6766aa49c93a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baf69d276eaa415bac9b8d9420009157', 'request_id': 'req-19ef3941-f80c-4212-b056-6766aa49c93a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:18.178428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-19ef3941-f80c-4212-b056-6766aa49c93a admin admin] The token cache is being invalidate because project baf69d276eaa415bac9b8d9420009157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:43:18.178733 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-19ef3941-f80c-4212-b056-6766aa49c93a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:18.179523 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-19ef3941-f80c-4212-b056-6766aa49c93a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:18.181414 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1224/2427] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:43:18 2022] DELETE /identity/v3/projects/baf69d276eaa415bac9b8d9420009157 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:43:18.188739 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1833c-d695-4ed8-8698-ebe4aafe8c77 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:18.189593 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1833c-d695-4ed8-8698-ebe4aafe8c77 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:18.189593 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1833c-d695-4ed8-8698-ebe4aafe8c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:18.220859 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-30b1833c-d695-4ed8-8698-ebe4aafe8c77 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:18.222352 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-30b1833c-d695-4ed8-8698-ebe4aafe8c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:18.310920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1204/2428] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:43:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:18.385420 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbb988-6780-4800-bfe6-d25890e153a7 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:18.386020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbb988-6780-4800-bfe6-d25890e153a7 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:18.386456 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbb988-6780-4800-bfe6-d25890e153a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:18.410771 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-4fcbb988-6780-4800-bfe6-d25890e153a7 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:18.412036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4fcbb988-6780-4800-bfe6-d25890e153a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:18.428007 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1225/2429] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:43:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:43:18.432523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1833c-d695-4ed8-8698-ebe4aafe8c77 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:18.444248 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1833c-d695-4ed8-8698-ebe4aafe8c77 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:18.449739 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899290c-8748-4bc8-af89-f2f95f8fe4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:18.450413 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899290c-8748-4bc8-af89-f2f95f8fe4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:18.450709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899290c-8748-4bc8-af89-f2f95f8fe4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:18.450940 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899290c-8748-4bc8-af89-f2f95f8fe4d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:18.451632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899290c-8748-4bc8-af89-f2f95f8fe4d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:43:18.451939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899290c-8748-4bc8-af89-f2f95f8fe4d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:18.453669 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899290c-8748-4bc8-af89-f2f95f8fe4d7 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:18.469265 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1205/2430] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:43:18.475250 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbb988-6780-4800-bfe6-d25890e153a7 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:18.489365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbb988-6780-4800-bfe6-d25890e153a7 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:18.496040 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77fe93-398f-4efb-9f71-2255c4f43066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:18.496921 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77fe93-398f-4efb-9f71-2255c4f43066 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:18.497288 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77fe93-398f-4efb-9f71-2255c4f43066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:18.497710 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77fe93-398f-4efb-9f71-2255c4f43066 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:18.498618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77fe93-398f-4efb-9f71-2255c4f43066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:18.501204 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77fe93-398f-4efb-9f71-2255c4f43066 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:18.550363 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1226/2431] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:43:18 2022] POST /identity/v3/projects => generated 391 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:43:18.551874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899290c-8748-4bc8-af89-f2f95f8fe4d7 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:18.566285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899290c-8748-4bc8-af89-f2f95f8fe4d7 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:18.641226 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:18.676833 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24990f14-5aee-447a-84f8-e913e655d206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:18.677577 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24990f14-5aee-447a-84f8-e913e655d206 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:18.677784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24990f14-5aee-447a-84f8-e913e655d206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:18.678429 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24990f14-5aee-447a-84f8-e913e655d206 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:18.679545 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24990f14-5aee-447a-84f8-e913e655d206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:18.683201 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24990f14-5aee-447a-84f8-e913e655d206 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:18.723741 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1206/2432] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:43:18 2022] POST /identity/v3/users => generated 296 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:43:18.730231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77fe93-398f-4efb-9f71-2255c4f43066 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:18.736853 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:18.743919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77fe93-398f-4efb-9f71-2255c4f43066 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:18.752690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f077a31-cfb0-47be-8203-911e0c3f9a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:18.753902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f077a31-cfb0-47be-8203-911e0c3f9a5d admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:18.754190 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f077a31-cfb0-47be-8203-911e0c3f9a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:18.755001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f077a31-cfb0-47be-8203-911e0c3f9a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:18.755710 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f077a31-cfb0-47be-8203-911e0c3f9a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:18.760218 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f077a31-cfb0-47be-8203-911e0c3f9a5d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:18.773666 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1227/2433] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:43:18.780459 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24990f14-5aee-447a-84f8-e913e655d206 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:18.801565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24990f14-5aee-447a-84f8-e913e655d206 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:18.812101 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f1210-d19e-4052-9bf3-5fd91e5f86cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:18.812680 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f1210-d19e-4052-9bf3-5fd91e5f86cf admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:18.813300 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f1210-d19e-4052-9bf3-5fd91e5f86cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:18.813925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f1210-d19e-4052-9bf3-5fd91e5f86cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:18.815232 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f1210-d19e-4052-9bf3-5fd91e5f86cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:18.820392 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f1210-d19e-4052-9bf3-5fd91e5f86cf admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:18.844257 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1207/2434] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:43:18.851416 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f077a31-cfb0-47be-8203-911e0c3f9a5d admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:18.885510 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f077a31-cfb0-47be-8203-911e0c3f9a5d admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:18.898950 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b732b-4389-4207-8d36-872cf7d02c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:18.901129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b732b-4389-4207-8d36-872cf7d02c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:18.901748 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b732b-4389-4207-8d36-872cf7d02c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:18.902429 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b732b-4389-4207-8d36-872cf7d02c0b admin admin] PATH_INFO: `/v3/projects/058e4257cdfe429f868fd9041ecc175b/users/a79d9cf356c64545986065cc4993dba2/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:18.949106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b732b-4389-4207-8d36-872cf7d02c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=058e4257cdfe429f868fd9041ecc175b, user_id=a79d9cf356c64545986065cc4993dba2, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:18.955208 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b732b-4389-4207-8d36-872cf7d02c0b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:18.983748 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1228/2435] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:43:18 2022] PUT /identity/v3/projects/058e4257cdfe429f868fd9041ecc175b/users/a79d9cf356c64545986065cc4993dba2/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:43:19.001596 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc869f04-1e52-43d6-b070-60b46e51f7c4 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:19.002096 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc869f04-1e52-43d6-b070-60b46e51f7c4 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:19.002610 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc869f04-1e52-43d6-b070-60b46e51f7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:19.086513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-bc869f04-1e52-43d6-b070-60b46e51f7c4 None None] MFA Rules not processed for user `a79d9cf356c64545986065cc4993dba2`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:19.088673 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-bc869f04-1e52-43d6-b070-60b46e51f7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:19.189789 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1208/2436] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:43:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:19.202975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b732b-4389-4207-8d36-872cf7d02c0b admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:19.211859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-af6b732b-4389-4207-8d36-872cf7d02c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:19.317933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b732b-4389-4207-8d36-872cf7d02c0b admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:19.324851 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff62d1-af7c-4051-9429-3523a7782844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:19.325734 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff62d1-af7c-4051-9429-3523a7782844 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:19.326139 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff62d1-af7c-4051-9429-3523a7782844 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:19.326629 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff62d1-af7c-4051-9429-3523a7782844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:19.345031 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff62d1-af7c-4051-9429-3523a7782844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:19.346569 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff62d1-af7c-4051-9429-3523a7782844 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:19.359908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1229/2437] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:19 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:43:22.813871 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e12044-d9e8-4852-a5c2-a10b18cef72d None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:22.814532 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e12044-d9e8-4852-a5c2-a10b18cef72d None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:22.814532 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e12044-d9e8-4852-a5c2-a10b18cef72d None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:22.815851 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1209/2438] 10.222.0.69 () {54 vars in 921 bytes} [Mon Aug 29 21:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:43:22.834156 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ec3ae-5442-441d-8f0b-7f83bb34b411 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:22.835537 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ec3ae-5442-441d-8f0b-7f83bb34b411 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:22.836112 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ec3ae-5442-441d-8f0b-7f83bb34b411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:22.879735 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-308ec3ae-5442-441d-8f0b-7f83bb34b411 None None] MFA Rules not processed for user `96c35c544cae4ad187f1a1be723e0d21`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:22.881371 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-308ec3ae-5442-441d-8f0b-7f83bb34b411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:23.005852 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1230/2439] 10.222.0.69 () {58 vars in 1018 bytes} [Mon Aug 29 21:43:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:23.020347 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e12044-d9e8-4852-a5c2-a10b18cef72d None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:23.024582 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-b9e12044-d9e8-4852-a5c2-a10b18cef72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:23.131259 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e12044-d9e8-4852-a5c2-a10b18cef72d None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:23.137239 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1277d-8413-4573-b692-67a423f3993c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df18e704834948c4bb480691fa8d0824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:23.138080 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1277d-8413-4573-b692-67a423f3993c service glance] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:23.138512 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1277d-8413-4573-b692-67a423f3993c service glance] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:23.138867 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1277d-8413-4573-b692-67a423f3993c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:23.153437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1277d-8413-4573-b692-67a423f3993c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:23.155596 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1277d-8413-4573-b692-67a423f3993c service glance] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:23.173255 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1210/2440] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:23.300790 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36238613-7300-4d98-9ab7-da5356e6104e None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:23.301385 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36238613-7300-4d98-9ab7-da5356e6104e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:23.301774 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36238613-7300-4d98-9ab7-da5356e6104e None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:23.304405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1231/2441] 10.222.0.69 () {54 vars in 921 bytes} [Mon Aug 29 21:43:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:43:23.313064 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7b1b9-8e2c-4d1c-9d77-ae1e5da923d1 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:23.314134 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7b1b9-8e2c-4d1c-9d77-ae1e5da923d1 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:23.314917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7b1b9-8e2c-4d1c-9d77-ae1e5da923d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:23.360436 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-dbf7b1b9-8e2c-4d1c-9d77-ae1e5da923d1 None None] MFA Rules not processed for user `dfa16ba58c0040f8bdfa5e46f2681395`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:23.362049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-dbf7b1b9-8e2c-4d1c-9d77-ae1e5da923d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:23.441821 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1211/2442] 10.222.0.69 () {58 vars in 1018 bytes} [Mon Aug 29 21:43:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:23.459485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36238613-7300-4d98-9ab7-da5356e6104e None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:23.462240 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-36238613-7300-4d98-9ab7-da5356e6104e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:23.488964 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36238613-7300-4d98-9ab7-da5356e6104e None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:23.493484 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24da9e-1b66-4d29-8ae1-9f7f351af64f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:23.494159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24da9e-1b66-4d29-8ae1-9f7f351af64f service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:23.494445 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24da9e-1b66-4d29-8ae1-9f7f351af64f service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:23.494723 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24da9e-1b66-4d29-8ae1-9f7f351af64f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:23.503897 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24da9e-1b66-4d29-8ae1-9f7f351af64f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:23.505579 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24da9e-1b66-4d29-8ae1-9f7f351af64f service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:23.516160 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1232/2443] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:23.645998 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12515cd4-6fbd-4353-b515-a3d710b9f8c9 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:23.646553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12515cd4-6fbd-4353-b515-a3d710b9f8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:23.646963 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12515cd4-6fbd-4353-b515-a3d710b9f8c9 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:23.648679 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1212/2444] 10.222.0.69 () {54 vars in 921 bytes} [Mon Aug 29 21:43:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:43:23.655868 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817b657-61bb-4344-a0b2-7c483661eefb None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:23.656201 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817b657-61bb-4344-a0b2-7c483661eefb None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:23.656453 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817b657-61bb-4344-a0b2-7c483661eefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:23.679166 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-7817b657-61bb-4344-a0b2-7c483661eefb None None] MFA Rules not processed for user `96c35c544cae4ad187f1a1be723e0d21`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:23.680459 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-7817b657-61bb-4344-a0b2-7c483661eefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:23.692454 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1233/2445] 10.222.0.69 () {58 vars in 1018 bytes} [Mon Aug 29 21:43:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:23.704726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12515cd4-6fbd-4353-b515-a3d710b9f8c9 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:23.707230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-12515cd4-6fbd-4353-b515-a3d710b9f8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:23.717309 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:23.727398 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12515cd4-6fbd-4353-b515-a3d710b9f8c9 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:23.734248 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac98382-b41e-4405-93eb-5d440d3ca388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:23.735290 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac98382-b41e-4405-93eb-5d440d3ca388 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:23.735818 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac98382-b41e-4405-93eb-5d440d3ca388 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:23.736354 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac98382-b41e-4405-93eb-5d440d3ca388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:23.754512 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac98382-b41e-4405-93eb-5d440d3ca388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:23.757673 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac98382-b41e-4405-93eb-5d440d3ca388 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:23.780395 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1213/2446] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:25.665870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e91e79-3ef4-456e-92d0-5a88e03650e7 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:25.667016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e91e79-3ef4-456e-92d0-5a88e03650e7 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:25.667167 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e91e79-3ef4-456e-92d0-5a88e03650e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:25.705027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-e6e91e79-3ef4-456e-92d0-5a88e03650e7 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:25.707340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e6e91e79-3ef4-456e-92d0-5a88e03650e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:25.780959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:25.827115 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1234/2447] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Aug 29 21:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:25.867646 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac98382-b41e-4405-93eb-5d440d3ca388 service neutron] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:25.869733 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-5ac98382-b41e-4405-93eb-5d440d3ca388 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:25.889300 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac98382-b41e-4405-93eb-5d440d3ca388 service neutron] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:25.896605 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04fceb-d4b2-4f04-b6e4-37ff02272376 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:25.897594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04fceb-d4b2-4f04-b6e4-37ff02272376 service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:25.898081 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04fceb-d4b2-4f04-b6e4-37ff02272376 service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:25.898543 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04fceb-d4b2-4f04-b6e4-37ff02272376 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:25.910426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04fceb-d4b2-4f04-b6e4-37ff02272376 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:25.912375 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04fceb-d4b2-4f04-b6e4-37ff02272376 service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:25.930026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1214/2448] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:30.943684 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e91e79-3ef4-456e-92d0-5a88e03650e7 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:30.956039 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e91e79-3ef4-456e-92d0-5a88e03650e7 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:30.962208 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec30f65-41ac-44b8-9812-7da3b3c8aa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:30.963806 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec30f65-41ac-44b8-9812-7da3b3c8aa91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:30.964342 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec30f65-41ac-44b8-9812-7da3b3c8aa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:30.964865 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec30f65-41ac-44b8-9812-7da3b3c8aa91 admin admin] PATH_INFO: `/v3/users/a79d9cf356c64545986065cc4993dba2` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:30.966290 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec30f65-41ac-44b8-9812-7da3b3c8aa91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a79d9cf356c64545986065cc4993dba2)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:30.968745 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec30f65-41ac-44b8-9812-7da3b3c8aa91 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:31.045324 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9ec30f65-41ac-44b8-9812-7da3b3c8aa91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a79d9cf356c64545986065cc4993dba2'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:31.057033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9ec30f65-41ac-44b8-9812-7da3b3c8aa91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a79d9cf356c64545986065cc4993dba2'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:31.067802 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9ec30f65-41ac-44b8-9812-7da3b3c8aa91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a79d9cf356c64545986065cc4993dba2'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:31.069232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9ec30f65-41ac-44b8-9812-7da3b3c8aa91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a79d9cf356c64545986065cc4993dba2'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:31.069971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9ec30f65-41ac-44b8-9812-7da3b3c8aa91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a79d9cf356c64545986065cc4993dba2'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:31.097329 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1235/2449] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:43:30 2022] DELETE /identity/v3/users/a79d9cf356c64545986065cc4993dba2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:43:31.102546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3ef34-fa4a-4403-b1a5-acbecf8dc4bd None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:31.103272 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3ef34-fa4a-4403-b1a5-acbecf8dc4bd None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:31.103272 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3ef34-fa4a-4403-b1a5-acbecf8dc4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:31.134917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-8ef3ef34-fa4a-4403-b1a5-acbecf8dc4bd None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:31.136619 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-8ef3ef34-fa4a-4403-b1a5-acbecf8dc4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:31.199840 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764963e2-9fde-4824-9069-25877a7e1e4c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:31.200124 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764963e2-9fde-4824-9069-25877a7e1e4c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:31.200417 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764963e2-9fde-4824-9069-25877a7e1e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:31.236246 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1215/2450] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:31.241193 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-764963e2-9fde-4824-9069-25877a7e1e4c None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:31.242826 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-764963e2-9fde-4824-9069-25877a7e1e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:31.247305 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3ef34-fa4a-4403-b1a5-acbecf8dc4bd None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:31.248923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-8ef3ef34-fa4a-4403-b1a5-acbecf8dc4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:31.252632 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1236/2451] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Aug 29 21:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:31.300000 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764963e2-9fde-4824-9069-25877a7e1e4c None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:31.302046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-764963e2-9fde-4824-9069-25877a7e1e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:31.339008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3ef34-fa4a-4403-b1a5-acbecf8dc4bd None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:31.344463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389a415-31c6-4188-a6bc-3f0000687ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:31.345413 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389a415-31c6-4188-a6bc-3f0000687ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:31.345868 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389a415-31c6-4188-a6bc-3f0000687ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:31.346317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389a415-31c6-4188-a6bc-3f0000687ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:31.358128 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389a415-31c6-4188-a6bc-3f0000687ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:31.362615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389a415-31c6-4188-a6bc-3f0000687ac3 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:31.381264 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1216/2452] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:43:31.409385 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764963e2-9fde-4824-9069-25877a7e1e4c None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:31.422272 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c95db-50f7-4823-92ac-6a95e1512a78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:31.423377 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c95db-50f7-4823-92ac-6a95e1512a78 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:31.423876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c95db-50f7-4823-92ac-6a95e1512a78 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:31.424414 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c95db-50f7-4823-92ac-6a95e1512a78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:31.442485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c95db-50f7-4823-92ac-6a95e1512a78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:31.445851 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c95db-50f7-4823-92ac-6a95e1512a78 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:31.467968 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1237/2453] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:43:31.470897 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7025b1-402b-4528-b1dc-4db948b99c2a None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:31.471749 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7025b1-402b-4528-b1dc-4db948b99c2a None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:31.472278 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7025b1-402b-4528-b1dc-4db948b99c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:31.497629 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-5e7025b1-402b-4528-b1dc-4db948b99c2a None None] MFA Rules not processed for user `540e06e694524c4a9e84ebebd45956d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:31.499215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-5e7025b1-402b-4528-b1dc-4db948b99c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:31.583806 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1217/2454] 10.222.0.69 () {58 vars in 1009 bytes} [Mon Aug 29 21:43:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:31.603475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c95db-50f7-4823-92ac-6a95e1512a78 service nova] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:31.607665 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c44c95db-50f7-4823-92ac-6a95e1512a78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:31.673287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:31.725736 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c95db-50f7-4823-92ac-6a95e1512a78 service nova] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:31.733500 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee4a7c-83e8-41ec-a617-d926e4ee6aab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '714a2ba019144211931dbe853f1960aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:31.734230 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee4a7c-83e8-41ec-a617-d926e4ee6aab service swift] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:31.734638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee4a7c-83e8-41ec-a617-d926e4ee6aab service swift] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:31.735003 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee4a7c-83e8-41ec-a617-d926e4ee6aab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:31.747959 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee4a7c-83e8-41ec-a617-d926e4ee6aab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:31.749857 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee4a7c-83e8-41ec-a617-d926e4ee6aab service swift] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:31.765440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1238/2455] 10.222.0.69 () {60 vars in 1384 bytes} [Mon Aug 29 21:43:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 21:43:31.861149 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7025b1-402b-4528-b1dc-4db948b99c2a None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:31.865224 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-5e7025b1-402b-4528-b1dc-4db948b99c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:31.953019 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7025b1-402b-4528-b1dc-4db948b99c2a None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:31.961296 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be744363-231c-4437-ba2f-d9fc0bddc3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:31.961980 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be744363-231c-4437-ba2f-d9fc0bddc3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:31.962261 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be744363-231c-4437-ba2f-d9fc0bddc3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:31.962532 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be744363-231c-4437-ba2f-d9fc0bddc3ea admin admin] PATH_INFO: `/v3/projects/058e4257cdfe429f868fd9041ecc175b` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:31.964392 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be744363-231c-4437-ba2f-d9fc0bddc3ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=058e4257cdfe429f868fd9041ecc175b)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:31.966534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be744363-231c-4437-ba2f-d9fc0bddc3ea admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:31.995225 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:32.058965 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-be744363-231c-4437-ba2f-d9fc0bddc3ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '058e4257cdfe429f868fd9041ecc175b', 'request_id': 'req-be744363-231c-4437-ba2f-d9fc0bddc3ea'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:32.071462 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-be744363-231c-4437-ba2f-d9fc0bddc3ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '058e4257cdfe429f868fd9041ecc175b', 'request_id': 'req-be744363-231c-4437-ba2f-d9fc0bddc3ea'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:32.081788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-be744363-231c-4437-ba2f-d9fc0bddc3ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '058e4257cdfe429f868fd9041ecc175b', 'request_id': 'req-be744363-231c-4437-ba2f-d9fc0bddc3ea'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:32.097243 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-be744363-231c-4437-ba2f-d9fc0bddc3ea admin admin] The token cache is being invalidate because project 058e4257cdfe429f868fd9041ecc175b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:43:32.097939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-be744363-231c-4437-ba2f-d9fc0bddc3ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:32.098664 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-be744363-231c-4437-ba2f-d9fc0bddc3ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:43:32.100440 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1218/2456] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:43:31 2022] DELETE /identity/v3/projects/058e4257cdfe429f868fd9041ecc175b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:43:41.761769 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=17 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:42.093799 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:47.924862 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90258f7b-00cd-43ed-bd00-e3376a01b173 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:47.925781 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90258f7b-00cd-43ed-bd00-e3376a01b173 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:47.925781 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90258f7b-00cd-43ed-bd00-e3376a01b173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:47.949427 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-90258f7b-00cd-43ed-bd00-e3376a01b173 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:47.950699 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-90258f7b-00cd-43ed-bd00-e3376a01b173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:48.024662 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1239/2457] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Aug 29 21:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:43:48.054792 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be744363-231c-4437-ba2f-d9fc0bddc3ea admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:48.056865 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-be744363-231c-4437-ba2f-d9fc0bddc3ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:48.179203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be744363-231c-4437-ba2f-d9fc0bddc3ea admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:48.185896 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d7273-0b63-40cd-9342-fb217e931317 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:48.186659 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d7273-0b63-40cd-9342-fb217e931317 service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:48.187001 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d7273-0b63-40cd-9342-fb217e931317 service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:48.187340 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d7273-0b63-40cd-9342-fb217e931317 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:48.200102 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d7273-0b63-40cd-9342-fb217e931317 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:48.203699 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d7273-0b63-40cd-9342-fb217e931317 service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:48.223788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1219/2458] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:43:52.159148 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e14a8-2d5d-4ee7-affc-d40f96b5b29b None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:52.159756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e14a8-2d5d-4ee7-affc-d40f96b5b29b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:52.159756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e14a8-2d5d-4ee7-affc-d40f96b5b29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:52.181902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d20e14a8-2d5d-4ee7-affc-d40f96b5b29b None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:52.183692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d20e14a8-2d5d-4ee7-affc-d40f96b5b29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:52.192517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1240/2459] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Aug 29 21:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:52.226583 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d7273-0b63-40cd-9342-fb217e931317 service nova] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:52.228384 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-4d1d7273-0b63-40cd-9342-fb217e931317 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:52.246692 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d7273-0b63-40cd-9342-fb217e931317 service nova] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:52.253275 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1d799-2cd5-454b-93f1-123ef6ac8303 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:52.253805 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1d799-2cd5-454b-93f1-123ef6ac8303 service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:52.253935 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1d799-2cd5-454b-93f1-123ef6ac8303 service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:52.254134 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1d799-2cd5-454b-93f1-123ef6ac8303 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:52.263603 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1d799-2cd5-454b-93f1-123ef6ac8303 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:52.265267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1d799-2cd5-454b-93f1-123ef6ac8303 service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:52.276127 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1220/2460] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:57.260851 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7342718-a632-49e7-89cb-8f0de123b814 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:57.261683 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7342718-a632-49e7-89cb-8f0de123b814 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:57.264330 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7342718-a632-49e7-89cb-8f0de123b814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:57.289894 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f7342718-a632-49e7-89cb-8f0de123b814 None None] MFA Rules not processed for user `540e06e694524c4a9e84ebebd45956d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:57.291196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f7342718-a632-49e7-89cb-8f0de123b814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:57.402002 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1241/2461] 10.222.0.69 () {58 vars in 967 bytes} [Mon Aug 29 21:43:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:57.428468 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1d799-2cd5-454b-93f1-123ef6ac8303 service nova] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:57.431809 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-89f1d799-2cd5-454b-93f1-123ef6ac8303 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:57.548944 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1d799-2cd5-454b-93f1-123ef6ac8303 service nova] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:57.549197 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cae5e-2c91-4a46-bad6-f68575cc96b9 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:57.549670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cae5e-2c91-4a46-bad6-f68575cc96b9 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:57.551042 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cae5e-2c91-4a46-bad6-f68575cc96b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:57.556767 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2114b-a1e0-402e-b600-e82d2e31870a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '714a2ba019144211931dbe853f1960aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:57.557484 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2114b-a1e0-402e-b600-e82d2e31870a service swift] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:57.557914 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2114b-a1e0-402e-b600-e82d2e31870a service swift] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:57.558268 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2114b-a1e0-402e-b600-e82d2e31870a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:57.568736 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2114b-a1e0-402e-b600-e82d2e31870a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:57.570454 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2114b-a1e0-402e-b600-e82d2e31870a service swift] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:57.581285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1221/2462] 10.222.0.69 () {60 vars in 1384 bytes} [Mon Aug 29 21:43:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:43:57.598977 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-c09cae5e-2c91-4a46-bad6-f68575cc96b9 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:57.601202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c09cae5e-2c91-4a46-bad6-f68575cc96b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:57.615465 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1242/2463] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Aug 29 21:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:43:57.649923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2114b-a1e0-402e-b600-e82d2e31870a service swift] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:57.670486 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2114b-a1e0-402e-b600-e82d2e31870a service swift] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:57.678912 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236b8f7-2dab-4b28-bfa2-a37f6b3d252f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:57.679724 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236b8f7-2dab-4b28-bfa2-a37f6b3d252f service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:57.680164 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236b8f7-2dab-4b28-bfa2-a37f6b3d252f service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:57.680553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236b8f7-2dab-4b28-bfa2-a37f6b3d252f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:57.694007 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236b8f7-2dab-4b28-bfa2-a37f6b3d252f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:57.695534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236b8f7-2dab-4b28-bfa2-a37f6b3d252f service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:57.712348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1222/2464] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:44:07.589414 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=58 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:07.704403 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=78 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:21.013467 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cad24-25c1-456f-abb4-d585be33fcca None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:21.014466 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cad24-25c1-456f-abb4-d585be33fcca None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:21.014466 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cad24-25c1-456f-abb4-d585be33fcca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:21.036020 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-0b3cad24-25c1-456f-abb4-d585be33fcca None None] MFA Rules not processed for user `fd2d58e660a940dd8fd31903ee5a6968`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:44:21.037350 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0b3cad24-25c1-456f-abb4-d585be33fcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:21.118805 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1243/2465] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:44:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:44:30.737538 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ae81f-ea21-480a-9c7f-e1af86a7b1e7 None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:30.738176 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ae81f-ea21-480a-9c7f-e1af86a7b1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:30.738317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ae81f-ea21-480a-9c7f-e1af86a7b1e7 None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:30.740010 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1223/2466] 10.222.0.69 () {54 vars in 921 bytes} [Mon Aug 29 21:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:44:30.763891 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5ed48-8a54-4933-90da-9f8afe679ca0 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:30.764523 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5ed48-8a54-4933-90da-9f8afe679ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:30.764636 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5ed48-8a54-4933-90da-9f8afe679ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:30.786941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-23c5ed48-8a54-4933-90da-9f8afe679ca0 None None] MFA Rules not processed for user `a7911672bb2a471daf4f69ba940ef41d`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:44:30.788442 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-23c5ed48-8a54-4933-90da-9f8afe679ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:30.873002 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1244/2467] 10.222.0.69 () {58 vars in 1018 bytes} [Mon Aug 29 21:44:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:44:31.160158 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ae81f-ea21-480a-9c7f-e1af86a7b1e7 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:31.162295 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-dc8ae81f-ea21-480a-9c7f-e1af86a7b1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:31.193709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ae81f-ea21-480a-9c7f-e1af86a7b1e7 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:31.202967 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f155d-20dd-41eb-8ee7-8dbe2e525b0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7911672bb2a471daf4f69ba940ef41d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:31.204033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f155d-20dd-41eb-8ee7-8dbe2e525b0a service placement] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:31.204629 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f155d-20dd-41eb-8ee7-8dbe2e525b0a service placement] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:31.205151 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f155d-20dd-41eb-8ee7-8dbe2e525b0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:31.222176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5ed48-8a54-4933-90da-9f8afe679ca0 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:31.223894 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-23c5ed48-8a54-4933-90da-9f8afe679ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:31.230287 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f155d-20dd-41eb-8ee7-8dbe2e525b0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:31.233936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f155d-20dd-41eb-8ee7-8dbe2e525b0a service placement] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:31.247238 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5ed48-8a54-4933-90da-9f8afe679ca0 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:31.248005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1224/2468] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:44:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:44:31.255297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455dbdc2-a1c8-489a-813c-c09326a4cd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:31.256394 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dbdc2-a1c8-489a-813c-c09326a4cd05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:31.256855 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dbdc2-a1c8-489a-813c-c09326a4cd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:31.257315 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dbdc2-a1c8-489a-813c-c09326a4cd05 admin admin] PATH_INFO: `/v3/users/80ddaebaf27649ceaa6fb13e0c6b1e20` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:31.259324 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455dbdc2-a1c8-489a-813c-c09326a4cd05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80ddaebaf27649ceaa6fb13e0c6b1e20)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:31.263554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455dbdc2-a1c8-489a-813c-c09326a4cd05 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:31.335156 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-455dbdc2-a1c8-489a-813c-c09326a4cd05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80ddaebaf27649ceaa6fb13e0c6b1e20'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:44:31.343507 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-455dbdc2-a1c8-489a-813c-c09326a4cd05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80ddaebaf27649ceaa6fb13e0c6b1e20'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:44:31.353827 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-455dbdc2-a1c8-489a-813c-c09326a4cd05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80ddaebaf27649ceaa6fb13e0c6b1e20'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:44:31.354609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-455dbdc2-a1c8-489a-813c-c09326a4cd05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80ddaebaf27649ceaa6fb13e0c6b1e20'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:44:31.355343 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-455dbdc2-a1c8-489a-813c-c09326a4cd05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80ddaebaf27649ceaa6fb13e0c6b1e20'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:44:31.378733 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1245/2469] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:44:31 2022] DELETE /identity/v3/users/80ddaebaf27649ceaa6fb13e0c6b1e20 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:44:31.571779 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f155d-20dd-41eb-8ee7-8dbe2e525b0a service placement] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:31.587934 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f155d-20dd-41eb-8ee7-8dbe2e525b0a service placement] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:31.651703 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52bd42-cecc-44f0-a480-0aac685847c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:31.652962 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52bd42-cecc-44f0-a480-0aac685847c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:31.653245 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52bd42-cecc-44f0-a480-0aac685847c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:31.653518 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52bd42-cecc-44f0-a480-0aac685847c2 admin admin] PATH_INFO: `/v3/projects/65895dd0d29948609b35f4d6640360c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:31.655160 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52bd42-cecc-44f0-a480-0aac685847c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65895dd0d29948609b35f4d6640360c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:31.657356 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52bd42-cecc-44f0-a480-0aac685847c2 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:31.714134 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-7e52bd42-cecc-44f0-a480-0aac685847c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65895dd0d29948609b35f4d6640360c3', 'request_id': 'req-7e52bd42-cecc-44f0-a480-0aac685847c2'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:44:31.721746 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-7e52bd42-cecc-44f0-a480-0aac685847c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65895dd0d29948609b35f4d6640360c3', 'request_id': 'req-7e52bd42-cecc-44f0-a480-0aac685847c2'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:44:31.728457 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-7e52bd42-cecc-44f0-a480-0aac685847c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65895dd0d29948609b35f4d6640360c3', 'request_id': 'req-7e52bd42-cecc-44f0-a480-0aac685847c2'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:44:31.745389 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-7e52bd42-cecc-44f0-a480-0aac685847c2 admin admin] The token cache is being invalidate because project 65895dd0d29948609b35f4d6640360c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:44:31.746156 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-7e52bd42-cecc-44f0-a480-0aac685847c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:44:31.746468 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-7e52bd42-cecc-44f0-a480-0aac685847c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:44:31.748006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1225/2470] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:44:31 2022] DELETE /identity/v3/projects/65895dd0d29948609b35f4d6640360c3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:44:31.753449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadc110-5f95-4c78-a6b1-891bd72da0fd None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:31.753867 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadc110-5f95-4c78-a6b1-891bd72da0fd None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:31.754232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadc110-5f95-4c78-a6b1-891bd72da0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:31.776950 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-acadc110-5f95-4c78-a6b1-891bd72da0fd None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:44:31.778759 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-acadc110-5f95-4c78-a6b1-891bd72da0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:31.789211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:31.858411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1246/2471] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:44:31.866961 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe598b-9861-4fea-90b3-4ba268cc0b16 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:31.867298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe598b-9861-4fea-90b3-4ba268cc0b16 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:31.867496 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe598b-9861-4fea-90b3-4ba268cc0b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:31.890013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-cbbe598b-9861-4fea-90b3-4ba268cc0b16 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:44:31.891764 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-cbbe598b-9861-4fea-90b3-4ba268cc0b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:31.905151 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1226/2472] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:44:31.910454 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadc110-5f95-4c78-a6b1-891bd72da0fd None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:31.925209 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadc110-5f95-4c78-a6b1-891bd72da0fd None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:31.930192 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b0947-3269-4192-aff9-d8e9e801d89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:31.930850 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b0947-3269-4192-aff9-d8e9e801d89f admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:31.931133 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b0947-3269-4192-aff9-d8e9e801d89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:31.931401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b0947-3269-4192-aff9-d8e9e801d89f admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:31.932063 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b0947-3269-4192-aff9-d8e9e801d89f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:44:31.932401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b0947-3269-4192-aff9-d8e9e801d89f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:31.934072 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b0947-3269-4192-aff9-d8e9e801d89f admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:31.948517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1247/2473] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:44:31.954508 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe598b-9861-4fea-90b3-4ba268cc0b16 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:31.964839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe598b-9861-4fea-90b3-4ba268cc0b16 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:31.970167 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62130d2-750a-4e5e-8c08-a82d02e28ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:31.970793 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62130d2-750a-4e5e-8c08-a82d02e28ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:31.971093 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62130d2-750a-4e5e-8c08-a82d02e28ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:31.971368 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62130d2-750a-4e5e-8c08-a82d02e28ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:31.972023 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62130d2-750a-4e5e-8c08-a82d02e28ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:31.974753 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62130d2-750a-4e5e-8c08-a82d02e28ea5 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:32.006660 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1227/2474] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:44:31 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:44:32.011124 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b0947-3269-4192-aff9-d8e9e801d89f admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:32.023998 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b0947-3269-4192-aff9-d8e9e801d89f admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:32.101937 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675f300-1b8a-4496-b006-41d7f6dd8314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:32.102762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675f300-1b8a-4496-b006-41d7f6dd8314 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:32.103052 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675f300-1b8a-4496-b006-41d7f6dd8314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:32.103327 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675f300-1b8a-4496-b006-41d7f6dd8314 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:32.103974 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675f300-1b8a-4496-b006-41d7f6dd8314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:32.106041 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675f300-1b8a-4496-b006-41d7f6dd8314 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:32.135318 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1248/2475] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:44:32 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:44:32.139529 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62130d2-750a-4e5e-8c08-a82d02e28ea5 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:32.153498 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62130d2-750a-4e5e-8c08-a82d02e28ea5 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:32.161631 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db227b-d87e-4bcc-90c4-376de502dc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:32.162700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db227b-d87e-4bcc-90c4-376de502dc7c admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:32.163198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db227b-d87e-4bcc-90c4-376de502dc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:32.163684 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db227b-d87e-4bcc-90c4-376de502dc7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:32.164971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db227b-d87e-4bcc-90c4-376de502dc7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:32.168283 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db227b-d87e-4bcc-90c4-376de502dc7c admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:32.184574 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1228/2476] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:44:32.190605 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675f300-1b8a-4496-b006-41d7f6dd8314 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:32.203473 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675f300-1b8a-4496-b006-41d7f6dd8314 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:32.211214 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08a396-b7fd-4439-b1cf-236c93753add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:32.212334 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08a396-b7fd-4439-b1cf-236c93753add admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:32.212774 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08a396-b7fd-4439-b1cf-236c93753add admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:32.213167 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08a396-b7fd-4439-b1cf-236c93753add admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:32.214154 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08a396-b7fd-4439-b1cf-236c93753add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:32.218024 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08a396-b7fd-4439-b1cf-236c93753add admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:32.236517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1249/2477] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:44:32.241142 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db227b-d87e-4bcc-90c4-376de502dc7c admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:32.252391 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db227b-d87e-4bcc-90c4-376de502dc7c admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:32.257566 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c35f6-d44b-495a-b61c-4527a8e6bbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:32.258274 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c35f6-d44b-495a-b61c-4527a8e6bbb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:32.258557 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c35f6-d44b-495a-b61c-4527a8e6bbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:32.258849 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c35f6-d44b-495a-b61c-4527a8e6bbb2 admin admin] PATH_INFO: `/v3/projects/d5fc73e1535f4dcd8f6b5e3da0cbfae8/users/4850ae6216a9455ab9b96c64fa99e491/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:32.276787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c35f6-d44b-495a-b61c-4527a8e6bbb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5fc73e1535f4dcd8f6b5e3da0cbfae8, user_id=4850ae6216a9455ab9b96c64fa99e491, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:32.280261 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c35f6-d44b-495a-b61c-4527a8e6bbb2 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:32.295544 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1229/2478] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:44:32 2022] PUT /identity/v3/projects/d5fc73e1535f4dcd8f6b5e3da0cbfae8/users/4850ae6216a9455ab9b96c64fa99e491/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:44:32.301879 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae319e-bb7e-461c-a20e-72fc81780aa6 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:32.302375 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae319e-bb7e-461c-a20e-72fc81780aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:32.303049 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae319e-bb7e-461c-a20e-72fc81780aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:32.332862 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-e9ae319e-bb7e-461c-a20e-72fc81780aa6 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:44:32.334960 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e9ae319e-bb7e-461c-a20e-72fc81780aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:32.416444 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1250/2479] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:44:32.427295 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c35f6-d44b-495a-b61c-4527a8e6bbb2 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:32.429131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-d14c35f6-d44b-495a-b61c-4527a8e6bbb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:32.446345 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:32.505472 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c35f6-d44b-495a-b61c-4527a8e6bbb2 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:32.509317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff6de9-ee84-44df-8306-fa6e6a65925a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:32.509946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff6de9-ee84-44df-8306-fa6e6a65925a service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:32.510229 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff6de9-ee84-44df-8306-fa6e6a65925a service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:32.510534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff6de9-ee84-44df-8306-fa6e6a65925a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:32.522776 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff6de9-ee84-44df-8306-fa6e6a65925a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:32.524351 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff6de9-ee84-44df-8306-fa6e6a65925a service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:32.537235 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1230/2480] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:44:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:44:38.153168 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80129471-ddc4-42e5-847f-b36179c4840c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:38.154041 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80129471-ddc4-42e5-847f-b36179c4840c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:38.154196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80129471-ddc4-42e5-847f-b36179c4840c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:38.197451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-80129471-ddc4-42e5-847f-b36179c4840c None None] MFA Rules not processed for user `4850ae6216a9455ab9b96c64fa99e491`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:44:38.199374 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-80129471-ddc4-42e5-847f-b36179c4840c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:38.215179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:38.304107 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1251/2481] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:44:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:44:38.311369 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff6de9-ee84-44df-8306-fa6e6a65925a service neutron] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:38.327040 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff6de9-ee84-44df-8306-fa6e6a65925a service neutron] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:38.334912 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f3af3-b141-4882-b307-35d81cb706fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:38.335940 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f3af3-b141-4882-b307-35d81cb706fb admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:38.336452 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f3af3-b141-4882-b307-35d81cb706fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:38.336801 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f3af3-b141-4882-b307-35d81cb706fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:38.337529 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f3af3-b141-4882-b307-35d81cb706fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:38.339775 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f3af3-b141-4882-b307-35d81cb706fb admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:38.389041 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1231/2482] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:44:38 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:44:38.390532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80129471-ddc4-42e5-847f-b36179c4840c None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:38.409606 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80129471-ddc4-42e5-847f-b36179c4840c None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:38.507515 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd5804-2773-4834-b581-544378f5205b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:38.508518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd5804-2773-4834-b581-544378f5205b admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:38.508955 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd5804-2773-4834-b581-544378f5205b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:38.509377 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd5804-2773-4834-b581-544378f5205b admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:38.510468 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd5804-2773-4834-b581-544378f5205b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:38.514111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd5804-2773-4834-b581-544378f5205b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:38.556585 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1252/2483] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:44:38 2022] POST /identity/v3/users => generated 299 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:44:38.559153 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f3af3-b141-4882-b307-35d81cb706fb admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:38.577353 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f3af3-b141-4882-b307-35d81cb706fb admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:38.585941 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bfce5-49d4-41ab-af0b-f874d4550827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:38.586707 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bfce5-49d4-41ab-af0b-f874d4550827 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:38.587110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bfce5-49d4-41ab-af0b-f874d4550827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:38.587460 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bfce5-49d4-41ab-af0b-f874d4550827 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:38.588148 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bfce5-49d4-41ab-af0b-f874d4550827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:38.589900 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bfce5-49d4-41ab-af0b-f874d4550827 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:38.607760 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1232/2484] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:44:38.612816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd5804-2773-4834-b581-544378f5205b admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:38.627048 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd5804-2773-4834-b581-544378f5205b admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:38.633645 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f899f6e-5cfc-4ca3-b476-89b6d7e0c893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:38.634888 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f899f6e-5cfc-4ca3-b476-89b6d7e0c893 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:38.635407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f899f6e-5cfc-4ca3-b476-89b6d7e0c893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:38.636043 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f899f6e-5cfc-4ca3-b476-89b6d7e0c893 admin admin] PATH_INFO: `/v3/projects/d16d4e617c354ae9aadbec6e33f5b98a/users/bd838fbbe5e44ca29048458846f83387/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:38.659561 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f899f6e-5cfc-4ca3-b476-89b6d7e0c893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d16d4e617c354ae9aadbec6e33f5b98a, user_id=bd838fbbe5e44ca29048458846f83387, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:38.662864 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f899f6e-5cfc-4ca3-b476-89b6d7e0c893 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:38.684543 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1253/2485] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:44:38 2022] PUT /identity/v3/projects/d16d4e617c354ae9aadbec6e33f5b98a/users/bd838fbbe5e44ca29048458846f83387/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:44:38.689902 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bfce5-49d4-41ab-af0b-f874d4550827 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:38.702409 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bfce5-49d4-41ab-af0b-f874d4550827 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:38.778657 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90e92f-52a8-446e-a9b8-6b9fed44bb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:38.779423 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90e92f-52a8-446e-a9b8-6b9fed44bb63 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:38.779766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90e92f-52a8-446e-a9b8-6b9fed44bb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:38.780100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90e92f-52a8-446e-a9b8-6b9fed44bb63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:38.780875 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90e92f-52a8-446e-a9b8-6b9fed44bb63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:38.783047 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90e92f-52a8-446e-a9b8-6b9fed44bb63 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:38.800997 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1233/2486] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:44:38.806221 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f899f6e-5cfc-4ca3-b476-89b6d7e0c893 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:38.818502 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f899f6e-5cfc-4ca3-b476-89b6d7e0c893 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:38.823836 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5099b5-420b-4200-af85-7aea6e245a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:38.824663 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5099b5-420b-4200-af85-7aea6e245a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:38.824941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5099b5-420b-4200-af85-7aea6e245a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:38.825211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5099b5-420b-4200-af85-7aea6e245a03 admin admin] PATH_INFO: `/v3/projects/d16d4e617c354ae9aadbec6e33f5b98a/users/bd838fbbe5e44ca29048458846f83387/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:38.827368 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5099b5-420b-4200-af85-7aea6e245a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d16d4e617c354ae9aadbec6e33f5b98a, user_id=bd838fbbe5e44ca29048458846f83387, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:38.830196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5099b5-420b-4200-af85-7aea6e245a03 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:38.843139 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1254/2487] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:44:38 2022] PUT /identity/v3/projects/d16d4e617c354ae9aadbec6e33f5b98a/users/bd838fbbe5e44ca29048458846f83387/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:44:45.741524 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d63b3-b22a-409c-8fef-9562083ca5f5 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:45.743045 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d63b3-b22a-409c-8fef-9562083ca5f5 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:45.743789 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d63b3-b22a-409c-8fef-9562083ca5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:45.810431 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-1b7d63b3-b22a-409c-8fef-9562083ca5f5 None None] MFA Rules not processed for user `bd838fbbe5e44ca29048458846f83387`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:44:45.812742 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-1b7d63b3-b22a-409c-8fef-9562083ca5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:45.943830 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1234/2488] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:44:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:44:45.964146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5099b5-420b-4200-af85-7aea6e245a03 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:45.969458 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2b5099b5-420b-4200-af85-7aea6e245a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:46.038686 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d63b3-b22a-409c-8fef-9562083ca5f5 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:46.046246 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:46.126956 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5099b5-420b-4200-af85-7aea6e245a03 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:46.138457 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af5c4f-5f00-45fb-81b1-10a22754b26c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df18e704834948c4bb480691fa8d0824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:46.139705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af5c4f-5f00-45fb-81b1-10a22754b26c service glance] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:46.140489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af5c4f-5f00-45fb-81b1-10a22754b26c service glance] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:46.140990 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af5c4f-5f00-45fb-81b1-10a22754b26c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:46.141832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d63b3-b22a-409c-8fef-9562083ca5f5 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:46.148431 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcb88e-e37c-49bf-b260-d2030b70911e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:46.149528 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcb88e-e37c-49bf-b260-d2030b70911e service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:46.150050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcb88e-e37c-49bf-b260-d2030b70911e service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:46.150510 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcb88e-e37c-49bf-b260-d2030b70911e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:46.154078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-06dcb88e-e37c-49bf-b260-d2030b70911e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:46.174932 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:46.301840 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af5c4f-5f00-45fb-81b1-10a22754b26c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:46.304714 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af5c4f-5f00-45fb-81b1-10a22754b26c service glance] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:46.323660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1255/2489] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:44:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:44:46.331718 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcb88e-e37c-49bf-b260-d2030b70911e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:46.333346 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcb88e-e37c-49bf-b260-d2030b70911e service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:46.347358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1235/2490] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:44:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:44:46.564990 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c87e54-62b2-46c0-a590-c1126636eb24 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:46.564990 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c87e54-62b2-46c0-a590-c1126636eb24 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:46.564990 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c87e54-62b2-46c0-a590-c1126636eb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:46.590758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-a1c87e54-62b2-46c0-a590-c1126636eb24 None None] MFA Rules not processed for user `540e06e694524c4a9e84ebebd45956d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:44:46.593191 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a1c87e54-62b2-46c0-a590-c1126636eb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:46.688337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1256/2491] 10.222.0.69 () {58 vars in 1009 bytes} [Mon Aug 29 21:44:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:44:46.725012 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcb88e-e37c-49bf-b260-d2030b70911e service neutron] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:46.727483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-06dcb88e-e37c-49bf-b260-d2030b70911e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:46.834380 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcb88e-e37c-49bf-b260-d2030b70911e service neutron] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:46.840900 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5609e-6542-4686-ac56-c383b0599f0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '714a2ba019144211931dbe853f1960aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:46.841631 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5609e-6542-4686-ac56-c383b0599f0c service swift] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:46.841918 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5609e-6542-4686-ac56-c383b0599f0c service swift] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:46.842194 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5609e-6542-4686-ac56-c383b0599f0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:46.851601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5609e-6542-4686-ac56-c383b0599f0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:46.853305 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5609e-6542-4686-ac56-c383b0599f0c service swift] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:46.864983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1236/2492] 10.222.0.69 () {60 vars in 1384 bytes} [Mon Aug 29 21:44:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:44:47.729374 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c87e54-62b2-46c0-a590-c1126636eb24 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:47.746114 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c87e54-62b2-46c0-a590-c1126636eb24 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:47.751438 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78abf66-60a0-4eff-aa21-7c35037b734d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:47.752302 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78abf66-60a0-4eff-aa21-7c35037b734d service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:47.752692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78abf66-60a0-4eff-aa21-7c35037b734d service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:47.753075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78abf66-60a0-4eff-aa21-7c35037b734d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:47.755595 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e78abf66-60a0-4eff-aa21-7c35037b734d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:47.779271 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78abf66-60a0-4eff-aa21-7c35037b734d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:47.783281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78abf66-60a0-4eff-aa21-7c35037b734d service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:47.799625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1257/2493] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:44:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:44:56.860641 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=84 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:57.747779 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3bb10-4bdd-45f6-ac9d-ab9d40490344 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:57.748499 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3bb10-4bdd-45f6-ac9d-ab9d40490344 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:57.749175 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3bb10-4bdd-45f6-ac9d-ab9d40490344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:57.790451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=51 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:57.795053 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-a1a3bb10-4bdd-45f6-ac9d-ab9d40490344 None None] MFA Rules not processed for user `07cf908926af48e8b7d96f96d026254a`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:44:57.797161 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a1a3bb10-4bdd-45f6-ac9d-ab9d40490344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:57.968931 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1237/2494] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:44:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:44:58.363822 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78abf66-60a0-4eff-aa21-7c35037b734d service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:58.381118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78abf66-60a0-4eff-aa21-7c35037b734d service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:58.386309 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e668bbc-6544-4261-bd56-5477486d02db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:58.387222 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e668bbc-6544-4261-bd56-5477486d02db service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:58.388278 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e668bbc-6544-4261-bd56-5477486d02db service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:58.388723 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e668bbc-6544-4261-bd56-5477486d02db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:58.391892 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0e668bbc-6544-4261-bd56-5477486d02db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:58.423850 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e668bbc-6544-4261-bd56-5477486d02db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:58.425654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e668bbc-6544-4261-bd56-5477486d02db service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:58.438576 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1258/2495] 10.222.0.69 () {60 vars in 1396 bytes} [Mon Aug 29 21:44:58 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3264 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:44:58.565935 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3bb10-4bdd-45f6-ac9d-ab9d40490344 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:58.583182 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3bb10-4bdd-45f6-ac9d-ab9d40490344 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:58.589920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0316d3-495c-4ec6-8bf3-5164c6baa31e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:58.591538 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0316d3-495c-4ec6-8bf3-5164c6baa31e service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:58.592045 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0316d3-495c-4ec6-8bf3-5164c6baa31e service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:58.592575 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0316d3-495c-4ec6-8bf3-5164c6baa31e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:58.595839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-de0316d3-495c-4ec6-8bf3-5164c6baa31e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:58.615341 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0316d3-495c-4ec6-8bf3-5164c6baa31e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:58.618557 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0316d3-495c-4ec6-8bf3-5164c6baa31e service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:58.634766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1238/2496] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:44:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:44:59.272320 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e668bbc-6544-4261-bd56-5477486d02db service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:59.274051 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0e668bbc-6544-4261-bd56-5477486d02db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:59.401761 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e668bbc-6544-4261-bd56-5477486d02db service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:59.407489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43457edf-02ff-4f99-9e56-19162166a617 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7911672bb2a471daf4f69ba940ef41d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:59.408425 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43457edf-02ff-4f99-9e56-19162166a617 service placement] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:59.408793 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43457edf-02ff-4f99-9e56-19162166a617 service placement] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:59.409135 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43457edf-02ff-4f99-9e56-19162166a617 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:59.411558 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-43457edf-02ff-4f99-9e56-19162166a617 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:59.427134 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43457edf-02ff-4f99-9e56-19162166a617 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:59.429251 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43457edf-02ff-4f99-9e56-19162166a617 service placement] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:59.444513 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1259/2497] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:44:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:45:00.621822 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16d68e-aaed-4f04-b155-98af3f7eb602 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:00.623124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16d68e-aaed-4f04-b155-98af3f7eb602 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:00.623557 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16d68e-aaed-4f04-b155-98af3f7eb602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:00.652877 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-4e16d68e-aaed-4f04-b155-98af3f7eb602 None None] MFA Rules not processed for user `4850ae6216a9455ab9b96c64fa99e491`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:45:00.654937 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-4e16d68e-aaed-4f04-b155-98af3f7eb602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:00.670064 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1239/2498] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:45:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:45:04.045905 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7f57d-0125-4058-9426-2f562c96161d None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:04.047502 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7f57d-0125-4058-9426-2f562c96161d None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:04.048408 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7f57d-0125-4058-9426-2f562c96161d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:04.089948 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-efb7f57d-0125-4058-9426-2f562c96161d None None] MFA Rules not processed for user `540e06e694524c4a9e84ebebd45956d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:45:04.092297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-efb7f57d-0125-4058-9426-2f562c96161d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:04.103001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1260/2499] 10.222.0.69 () {58 vars in 1009 bytes} [Mon Aug 29 21:45:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:45:04.121305 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16d68e-aaed-4f04-b155-98af3f7eb602 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:45:04.136297 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16d68e-aaed-4f04-b155-98af3f7eb602 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:45:04.144021 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c293917-1fe1-471d-8599-171a559f1088 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '714a2ba019144211931dbe853f1960aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:45:04.145178 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c293917-1fe1-471d-8599-171a559f1088 service swift] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:04.145388 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c293917-1fe1-471d-8599-171a559f1088 service swift] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:04.145666 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c293917-1fe1-471d-8599-171a559f1088 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:04.165828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c293917-1fe1-471d-8599-171a559f1088 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:45:04.169485 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c293917-1fe1-471d-8599-171a559f1088 service swift] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:45:04.191435 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1240/2500] 10.222.0.69 () {60 vars in 1384 bytes} [Mon Aug 29 21:45:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:45:08.007659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7f57d-0125-4058-9426-2f562c96161d None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:45:08.010013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-efb7f57d-0125-4058-9426-2f562c96161d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:08.206129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7f57d-0125-4058-9426-2f562c96161d None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:45:08.217826 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169fdf6-4bd9-401b-bcb3-450f1085b809 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:45:08.224504 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169fdf6-4bd9-401b-bcb3-450f1085b809 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:08.225202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169fdf6-4bd9-401b-bcb3-450f1085b809 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:08.225692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169fdf6-4bd9-401b-bcb3-450f1085b809 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:08.230065 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c169fdf6-4bd9-401b-bcb3-450f1085b809 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:08.428887 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169fdf6-4bd9-401b-bcb3-450f1085b809 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:45:08.432011 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169fdf6-4bd9-401b-bcb3-450f1085b809 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:45:08.464693 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1261/2501] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:45:08 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:45:09.493809 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c293917-1fe1-471d-8599-171a559f1088 service swift] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:45:09.497434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-4c293917-1fe1-471d-8599-171a559f1088 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:09.542452 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c293917-1fe1-471d-8599-171a559f1088 service swift] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:45:09.562657 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ffc6b-2276-47d0-9741-dfcf56797015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:45:09.564479 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ffc6b-2276-47d0-9741-dfcf56797015 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:09.565401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ffc6b-2276-47d0-9741-dfcf56797015 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:09.566277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ffc6b-2276-47d0-9741-dfcf56797015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:09.571081 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-b15ffc6b-2276-47d0-9741-dfcf56797015 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:09.617764 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ffc6b-2276-47d0-9741-dfcf56797015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:45:09.620793 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ffc6b-2276-47d0-9741-dfcf56797015 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:45:09.663311 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1241/2502] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:45:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:45:18.446518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:45:19.638376 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=46 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:45:21.143388 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169fdf6-4bd9-401b-bcb3-450f1085b809 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:45:21.145330 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c169fdf6-4bd9-401b-bcb3-450f1085b809 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:21.176545 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169fdf6-4bd9-401b-bcb3-450f1085b809 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:45:21.192457 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d300e-c246-4bdd-9c5f-4d4792691da7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:45:21.194885 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d300e-c246-4bdd-9c5f-4d4792691da7 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:21.195173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d300e-c246-4bdd-9c5f-4d4792691da7 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:21.195451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d300e-c246-4bdd-9c5f-4d4792691da7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:21.212775 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e44d300e-c246-4bdd-9c5f-4d4792691da7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:21.243138 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d300e-c246-4bdd-9c5f-4d4792691da7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:45:21.244827 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d300e-c246-4bdd-9c5f-4d4792691da7 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:45:21.263801 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1262/2503] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:45:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:45:31.254410 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=6 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:45:37.164350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ffc6b-2276-47d0-9741-dfcf56797015 service neutron] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:45:37.181083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ffc6b-2276-47d0-9741-dfcf56797015 service neutron] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:45:37.188570 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b434a-3170-4684-9bd2-6fe7740db802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:45:37.189618 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b434a-3170-4684-9bd2-6fe7740db802 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:37.190100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b434a-3170-4684-9bd2-6fe7740db802 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:37.190595 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b434a-3170-4684-9bd2-6fe7740db802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:37.212204 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b434a-3170-4684-9bd2-6fe7740db802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:45:37.215049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b434a-3170-4684-9bd2-6fe7740db802 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:45:37.234590 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1242/2504] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:45:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:45:39.017093 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d300e-c246-4bdd-9c5f-4d4792691da7 service nova] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:45:39.031343 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d300e-c246-4bdd-9c5f-4d4792691da7 service nova] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:45:39.037734 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7371be4-a886-4b5e-8bdc-36132ab1c8bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:45:39.038711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7371be4-a886-4b5e-8bdc-36132ab1c8bd service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:39.039017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7371be4-a886-4b5e-8bdc-36132ab1c8bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:39.039330 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7371be4-a886-4b5e-8bdc-36132ab1c8bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:39.041860 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c7371be4-a886-4b5e-8bdc-36132ab1c8bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:39.167969 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7371be4-a886-4b5e-8bdc-36132ab1c8bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:45:39.172273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7371be4-a886-4b5e-8bdc-36132ab1c8bd service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:45:39.193597 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1263/2505] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:45:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:45:40.204416 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b434a-3170-4684-9bd2-6fe7740db802 service neutron] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:45:40.230885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b434a-3170-4684-9bd2-6fe7740db802 service neutron] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:45:40.242243 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70495d1-5894-4af5-9f9c-2bedb7377e63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:45:40.244021 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70495d1-5894-4af5-9f9c-2bedb7377e63 service nova] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:40.245012 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70495d1-5894-4af5-9f9c-2bedb7377e63 service nova] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:40.245791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70495d1-5894-4af5-9f9c-2bedb7377e63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:40.249715 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-d70495d1-5894-4af5-9f9c-2bedb7377e63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:40.278573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70495d1-5894-4af5-9f9c-2bedb7377e63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:45:40.283155 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70495d1-5894-4af5-9f9c-2bedb7377e63 service nova] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:45:40.324382 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1243/2506] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:45:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:45:46.772380 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7371be4-a886-4b5e-8bdc-36132ab1c8bd service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:45:46.774640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c7371be4-a886-4b5e-8bdc-36132ab1c8bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:46.791332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7371be4-a886-4b5e-8bdc-36132ab1c8bd service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:45:46.796906 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebbfdb-5055-4262-b19e-85fbd1506977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:45:46.797564 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebbfdb-5055-4262-b19e-85fbd1506977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:46.797843 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebbfdb-5055-4262-b19e-85fbd1506977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:46.798111 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebbfdb-5055-4262-b19e-85fbd1506977 admin admin] PATH_INFO: `/v3/users/fd2d58e660a940dd8fd31903ee5a6968` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:46.799310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ebbfdb-5055-4262-b19e-85fbd1506977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd2d58e660a940dd8fd31903ee5a6968)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:45:46.801573 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ebbfdb-5055-4262-b19e-85fbd1506977 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:45:46.867186 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-10ebbfdb-5055-4262-b19e-85fbd1506977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd2d58e660a940dd8fd31903ee5a6968'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:45:46.878728 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-10ebbfdb-5055-4262-b19e-85fbd1506977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd2d58e660a940dd8fd31903ee5a6968'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:45:46.887561 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-10ebbfdb-5055-4262-b19e-85fbd1506977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd2d58e660a940dd8fd31903ee5a6968'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:45:46.888489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-10ebbfdb-5055-4262-b19e-85fbd1506977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd2d58e660a940dd8fd31903ee5a6968'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:45:46.890390 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-10ebbfdb-5055-4262-b19e-85fbd1506977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd2d58e660a940dd8fd31903ee5a6968'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:45:46.912702 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1264/2507] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:45:46 2022] DELETE /identity/v3/users/fd2d58e660a940dd8fd31903ee5a6968 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:45:47.131845 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70495d1-5894-4af5-9f9c-2bedb7377e63 service nova] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:45:47.152456 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70495d1-5894-4af5-9f9c-2bedb7377e63 service nova] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:45:47.263506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da94fd6-fd2b-4ca1-8954-0e3b6510545b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:45:47.265457 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da94fd6-fd2b-4ca1-8954-0e3b6510545b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:47.265644 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da94fd6-fd2b-4ca1-8954-0e3b6510545b admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:47.266009 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da94fd6-fd2b-4ca1-8954-0e3b6510545b admin admin] PATH_INFO: `/v3/projects/f2a05eeed90743e7a757a87b6ebe81e4` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:47.267394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da94fd6-fd2b-4ca1-8954-0e3b6510545b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2a05eeed90743e7a757a87b6ebe81e4)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:45:47.270152 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da94fd6-fd2b-4ca1-8954-0e3b6510545b admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:45:47.354195 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-0da94fd6-fd2b-4ca1-8954-0e3b6510545b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2a05eeed90743e7a757a87b6ebe81e4', 'request_id': 'req-0da94fd6-fd2b-4ca1-8954-0e3b6510545b'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:45:47.366972 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-0da94fd6-fd2b-4ca1-8954-0e3b6510545b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2a05eeed90743e7a757a87b6ebe81e4', 'request_id': 'req-0da94fd6-fd2b-4ca1-8954-0e3b6510545b'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:45:47.379177 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-0da94fd6-fd2b-4ca1-8954-0e3b6510545b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2a05eeed90743e7a757a87b6ebe81e4', 'request_id': 'req-0da94fd6-fd2b-4ca1-8954-0e3b6510545b'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:45:47.400088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-0da94fd6-fd2b-4ca1-8954-0e3b6510545b admin admin] The token cache is being invalidate because project f2a05eeed90743e7a757a87b6ebe81e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:45:47.400716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-0da94fd6-fd2b-4ca1-8954-0e3b6510545b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:45:47.401583 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-0da94fd6-fd2b-4ca1-8954-0e3b6510545b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:45:47.403604 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1244/2508] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:45:47 2022] DELETE /identity/v3/projects/f2a05eeed90743e7a757a87b6ebe81e4 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:45:47.409322 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193be3a-9cd0-45d9-9235-fe87282195b8 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:47.409739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193be3a-9cd0-45d9-9235-fe87282195b8 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:47.410181 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193be3a-9cd0-45d9-9235-fe87282195b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:47.437275 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f193be3a-9cd0-45d9-9235-fe87282195b8 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:45:47.439345 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f193be3a-9cd0-45d9-9235-fe87282195b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:47.541449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1265/2509] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:45:47.551149 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af5e21-a5f5-49ed-a53f-655b82284f80 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:47.551677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af5e21-a5f5-49ed-a53f-655b82284f80 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:47.552149 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af5e21-a5f5-49ed-a53f-655b82284f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:47.579888 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-b3af5e21-a5f5-49ed-a53f-655b82284f80 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:45:47.581992 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-b3af5e21-a5f5-49ed-a53f-655b82284f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:47.600286 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1245/2510] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:45:47.605094 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193be3a-9cd0-45d9-9235-fe87282195b8 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:45:47.622466 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193be3a-9cd0-45d9-9235-fe87282195b8 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:45:47.635181 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47408c53-d8e3-4d5c-9330-b961a3a80eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:45:47.636512 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47408c53-d8e3-4d5c-9330-b961a3a80eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:47.637026 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47408c53-d8e3-4d5c-9330-b961a3a80eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:47.637525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47408c53-d8e3-4d5c-9330-b961a3a80eb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:47.640074 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47408c53-d8e3-4d5c-9330-b961a3a80eb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:45:47.640074 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47408c53-d8e3-4d5c-9330-b961a3a80eb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:45:47.642188 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47408c53-d8e3-4d5c-9330-b961a3a80eb8 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:45:47.645008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:45:47.673698 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1266/2511] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:45:47.679007 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af5e21-a5f5-49ed-a53f-655b82284f80 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:45:47.695879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af5e21-a5f5-49ed-a53f-655b82284f80 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:45:47.705229 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209d75b-aedc-472c-a163-d3f7712dc9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:45:47.706257 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209d75b-aedc-472c-a163-d3f7712dc9fb admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:47.706750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209d75b-aedc-472c-a163-d3f7712dc9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:47.707206 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209d75b-aedc-472c-a163-d3f7712dc9fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:47.708409 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6209d75b-aedc-472c-a163-d3f7712dc9fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:45:47.712547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6209d75b-aedc-472c-a163-d3f7712dc9fb admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:45:47.765678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1246/2512] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:45:47 2022] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:45:47.770910 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47408c53-d8e3-4d5c-9330-b961a3a80eb8 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:45:47.792359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47408c53-d8e3-4d5c-9330-b961a3a80eb8 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:45:47.887118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8059e65-81ee-48e2-b38a-fd6f1927d16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:45:47.888066 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8059e65-81ee-48e2-b38a-fd6f1927d16e admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:47.888660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8059e65-81ee-48e2-b38a-fd6f1927d16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:47.889710 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8059e65-81ee-48e2-b38a-fd6f1927d16e admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:47.890790 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8059e65-81ee-48e2-b38a-fd6f1927d16e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:45:47.893471 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8059e65-81ee-48e2-b38a-fd6f1927d16e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:45:47.926101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1267/2513] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:45:47 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:45:47.930664 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209d75b-aedc-472c-a163-d3f7712dc9fb admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:45:47.944294 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209d75b-aedc-472c-a163-d3f7712dc9fb admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:45:47.950331 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9171a-fdca-4e22-95f0-17edc2315c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:45:47.951080 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9171a-fdca-4e22-95f0-17edc2315c1e admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:47.952037 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9171a-fdca-4e22-95f0-17edc2315c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:47.952532 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9171a-fdca-4e22-95f0-17edc2315c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:47.953397 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9171a-fdca-4e22-95f0-17edc2315c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:45:47.955254 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9171a-fdca-4e22-95f0-17edc2315c1e admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:45:47.969498 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1247/2514] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:45:47.976059 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8059e65-81ee-48e2-b38a-fd6f1927d16e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:45:47.993083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8059e65-81ee-48e2-b38a-fd6f1927d16e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:45:47.998794 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fef8ad-95b6-4ffd-9782-fb43449a6c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:45:47.999476 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fef8ad-95b6-4ffd-9782-fb43449a6c8e admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:47.999794 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fef8ad-95b6-4ffd-9782-fb43449a6c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:48.000210 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fef8ad-95b6-4ffd-9782-fb43449a6c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:48.000963 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fef8ad-95b6-4ffd-9782-fb43449a6c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:45:48.002654 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fef8ad-95b6-4ffd-9782-fb43449a6c8e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:45:48.021700 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1268/2515] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:45:48.028537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9171a-fdca-4e22-95f0-17edc2315c1e admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:45:48.041168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9171a-fdca-4e22-95f0-17edc2315c1e admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:45:48.046619 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84608a44-e2f2-4609-9083-f4faaffb2187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:45:48.047310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84608a44-e2f2-4609-9083-f4faaffb2187 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:48.047618 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84608a44-e2f2-4609-9083-f4faaffb2187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:48.047896 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84608a44-e2f2-4609-9083-f4faaffb2187 admin admin] PATH_INFO: `/v3/projects/8c4c6a899dc7446c88c5e7a4d3f2e717/users/69b79740961d4100a287f62093ccae9d/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:48.066120 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84608a44-e2f2-4609-9083-f4faaffb2187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c4c6a899dc7446c88c5e7a4d3f2e717, user_id=69b79740961d4100a287f62093ccae9d, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:45:48.068920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84608a44-e2f2-4609-9083-f4faaffb2187 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:45:48.080805 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:45:48.089047 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1248/2516] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:45:48 2022] PUT /identity/v3/projects/8c4c6a899dc7446c88c5e7a4d3f2e717/users/69b79740961d4100a287f62093ccae9d/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:45:48.095451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de32934-3f92-45eb-be0b-e05a8a005649 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:48.095778 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de32934-3f92-45eb-be0b-e05a8a005649 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:48.096214 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de32934-3f92-45eb-be0b-e05a8a005649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:48.126620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-9de32934-3f92-45eb-be0b-e05a8a005649 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:45:48.128716 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9de32934-3f92-45eb-be0b-e05a8a005649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:48.219610 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1269/2517] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:45:48.230457 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84608a44-e2f2-4609-9083-f4faaffb2187 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:45:48.232424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-84608a44-e2f2-4609-9083-f4faaffb2187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:48.303942 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84608a44-e2f2-4609-9083-f4faaffb2187 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:45:48.310737 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202940fe-fa09-49c1-b1b3-55395c2e4564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:45:48.311750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202940fe-fa09-49c1-b1b3-55395c2e4564 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:48.312302 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202940fe-fa09-49c1-b1b3-55395c2e4564 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:48.312809 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202940fe-fa09-49c1-b1b3-55395c2e4564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:48.329155 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202940fe-fa09-49c1-b1b3-55395c2e4564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:45:48.330698 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202940fe-fa09-49c1-b1b3-55395c2e4564 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:45:48.343019 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1249/2518] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:45:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:45:51.996330 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d06ca9-9a4d-4aab-9a4e-46188435ea3c None None] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:51.997049 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d06ca9-9a4d-4aab-9a4e-46188435ea3c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:51.998404 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d06ca9-9a4d-4aab-9a4e-46188435ea3c None None] PATH_INFO: `/` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:51.999029 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1270/2519] 10.222.0.69 () {54 vars in 921 bytes} [Mon Aug 29 21:45:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:45:52.011277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83735952-b25b-4b00-aa60-36f0c6338b1c None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:52.012081 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83735952-b25b-4b00-aa60-36f0c6338b1c None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:52.012285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83735952-b25b-4b00-aa60-36f0c6338b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:52.058399 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-83735952-b25b-4b00-aa60-36f0c6338b1c None None] MFA Rules not processed for user `dfa16ba58c0040f8bdfa5e46f2681395`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:45:52.060523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-83735952-b25b-4b00-aa60-36f0c6338b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:52.071119 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1250/2520] 10.222.0.69 () {58 vars in 1018 bytes} [Mon Aug 29 21:45:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:45:52.106080 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d06ca9-9a4d-4aab-9a4e-46188435ea3c None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:45:52.127295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d06ca9-9a4d-4aab-9a4e-46188435ea3c None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:45:52.138312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e9dca-5c65-4eb5-a7ec-f3a6879099a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:45:52.138964 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e9dca-5c65-4eb5-a7ec-f3a6879099a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:52.139485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e9dca-5c65-4eb5-a7ec-f3a6879099a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:52.140010 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e9dca-5c65-4eb5-a7ec-f3a6879099a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:52.159679 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e9dca-5c65-4eb5-a7ec-f3a6879099a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:45:52.165557 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e9dca-5c65-4eb5-a7ec-f3a6879099a5 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:45:52.181017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1271/2521] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:45:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:45:52.370234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9dce1-5e12-4f22-8fc5-acfb3d97094c None None] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:52.370701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9dce1-5e12-4f22-8fc5-acfb3d97094c None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:52.371313 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9dce1-5e12-4f22-8fc5-acfb3d97094c None None] PATH_INFO: `/` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:52.377911 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1251/2522] 10.222.0.69 () {54 vars in 921 bytes} [Mon Aug 29 21:45:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:45:52.390678 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6717ff5-7758-4fb6-a041-964a72ac2cc8 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:52.390678 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6717ff5-7758-4fb6-a041-964a72ac2cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:52.391101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6717ff5-7758-4fb6-a041-964a72ac2cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:52.440312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-b6717ff5-7758-4fb6-a041-964a72ac2cc8 None None] MFA Rules not processed for user `96c35c544cae4ad187f1a1be723e0d21`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:45:52.442525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b6717ff5-7758-4fb6-a041-964a72ac2cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:52.570643 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:45:52.603416 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1272/2523] 10.222.0.69 () {58 vars in 1018 bytes} [Mon Aug 29 21:45:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:45:52.623199 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9dce1-5e12-4f22-8fc5-acfb3d97094c None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:45:52.627777 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-98e9dce1-5e12-4f22-8fc5-acfb3d97094c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:52.648862 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9dce1-5e12-4f22-8fc5-acfb3d97094c None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:45:52.654330 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3d537-d1a9-4abc-bfdf-355ff1bf4787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:45:52.656226 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3d537-d1a9-4abc-bfdf-355ff1bf4787 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:52.656971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3d537-d1a9-4abc-bfdf-355ff1bf4787 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:52.657567 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3d537-d1a9-4abc-bfdf-355ff1bf4787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:52.673889 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3d537-d1a9-4abc-bfdf-355ff1bf4787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:45:52.676949 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3d537-d1a9-4abc-bfdf-355ff1bf4787 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:45:52.694291 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1252/2524] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:45:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:45:54.194056 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6717ff5-7758-4fb6-a041-964a72ac2cc8 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:45:54.197968 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b6717ff5-7758-4fb6-a041-964a72ac2cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:54.233534 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6717ff5-7758-4fb6-a041-964a72ac2cc8 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:45:54.247573 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4b567-da5c-4073-8841-266117f675b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:45:54.249754 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4b567-da5c-4073-8841-266117f675b5 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:54.250691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4b567-da5c-4073-8841-266117f675b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:54.251489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4b567-da5c-4073-8841-266117f675b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:54.256901 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5fd4b567-da5c-4073-8841-266117f675b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:54.286965 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4b567-da5c-4073-8841-266117f675b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:45:54.290250 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4b567-da5c-4073-8841-266117f675b5 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:45:54.316131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1273/2525] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:45:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:45:54.700434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c35b2-8fdf-473f-bfae-f3f9397706ae None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:54.701556 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c35b2-8fdf-473f-bfae-f3f9397706ae None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:54.702131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c35b2-8fdf-473f-bfae-f3f9397706ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:54.739578 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-3f3c35b2-8fdf-473f-bfae-f3f9397706ae None None] MFA Rules not processed for user `69b79740961d4100a287f62093ccae9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:45:54.741924 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-3f3c35b2-8fdf-473f-bfae-f3f9397706ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:54.838129 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1253/2526] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:45:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:45:54.854999 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4b567-da5c-4073-8841-266117f675b5 service nova] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:45:54.856597 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5fd4b567-da5c-4073-8841-266117f675b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:54.875147 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4b567-da5c-4073-8841-266117f675b5 service nova] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:45:54.883347 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108360e-0a25-480e-a752-aa4258e3015f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:45:54.884375 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108360e-0a25-480e-a752-aa4258e3015f service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:54.884883 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108360e-0a25-480e-a752-aa4258e3015f service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:54.885378 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108360e-0a25-480e-a752-aa4258e3015f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:54.900730 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108360e-0a25-480e-a752-aa4258e3015f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:45:54.903485 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108360e-0a25-480e-a752-aa4258e3015f service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:45:54.922993 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1274/2527] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:45:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:45:57.246688 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518e7d0-5a8a-4373-a9fe-ed072d7a9bac None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:57.247317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518e7d0-5a8a-4373-a9fe-ed072d7a9bac None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:57.247620 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518e7d0-5a8a-4373-a9fe-ed072d7a9bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:57.270094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-0518e7d0-5a8a-4373-a9fe-ed072d7a9bac None None] MFA Rules not processed for user `69b79740961d4100a287f62093ccae9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:45:57.271491 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-0518e7d0-5a8a-4373-a9fe-ed072d7a9bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:57.279627 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1254/2528] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:45:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:45:57.911013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108360e-0a25-480e-a752-aa4258e3015f service nova] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:45:57.929100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108360e-0a25-480e-a752-aa4258e3015f service nova] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:45:57.937793 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede433e5-07e6-44fc-bf25-02629b62af4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:45:57.939006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede433e5-07e6-44fc-bf25-02629b62af4e service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:57.939533 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede433e5-07e6-44fc-bf25-02629b62af4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:57.940044 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede433e5-07e6-44fc-bf25-02629b62af4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:57.943421 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ede433e5-07e6-44fc-bf25-02629b62af4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:57.962423 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede433e5-07e6-44fc-bf25-02629b62af4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:45:57.964404 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede433e5-07e6-44fc-bf25-02629b62af4e service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:45:57.975133 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1275/2529] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:45:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:46:07.263512 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=70 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:46:07.970702 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=22 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:46:19.085219 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69890ef-b33d-4a87-8192-df6ae0e4afef None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:46:19.085890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69890ef-b33d-4a87-8192-df6ae0e4afef None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:46:19.086209 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69890ef-b33d-4a87-8192-df6ae0e4afef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:46:19.122518 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-a69890ef-b33d-4a87-8192-df6ae0e4afef None None] MFA Rules not processed for user `0d38cb68bef94e32abccab5f3772a330`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:46:19.125727 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a69890ef-b33d-4a87-8192-df6ae0e4afef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:46:19.232268 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1255/2530] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:46:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:46:29.220350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=25 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:46:30.057625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede433e5-07e6-44fc-bf25-02629b62af4e service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:46:30.081568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede433e5-07e6-44fc-bf25-02629b62af4e service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:46:30.092215 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec58b18-2888-476f-bc85-4f1f50ae3883 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:46:30.093256 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec58b18-2888-476f-bc85-4f1f50ae3883 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:46:30.094368 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec58b18-2888-476f-bc85-4f1f50ae3883 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:46:30.094857 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec58b18-2888-476f-bc85-4f1f50ae3883 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:46:30.097995 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-dec58b18-2888-476f-bc85-4f1f50ae3883 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:46:30.118626 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec58b18-2888-476f-bc85-4f1f50ae3883 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:46:30.121965 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec58b18-2888-476f-bc85-4f1f50ae3883 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:46:30.142129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1276/2531] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:46:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:46:39.602643 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21db17-a452-4079-bd24-d7e893929a42 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:46:39.603322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21db17-a452-4079-bd24-d7e893929a42 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:46:39.603617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21db17-a452-4079-bd24-d7e893929a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:46:39.631636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-8d21db17-a452-4079-bd24-d7e893929a42 None None] MFA Rules not processed for user `540e06e694524c4a9e84ebebd45956d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:46:39.633146 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-8d21db17-a452-4079-bd24-d7e893929a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:46:39.725754 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1256/2532] 10.222.0.69 () {58 vars in 1009 bytes} [Mon Aug 29 21:46:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:46:39.784705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec58b18-2888-476f-bc85-4f1f50ae3883 service nova] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:46:39.786287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-dec58b18-2888-476f-bc85-4f1f50ae3883 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:46:39.878841 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec58b18-2888-476f-bc85-4f1f50ae3883 service nova] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:46:39.884702 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012a784-863b-4d0b-93a4-c9e1a5a40dbd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '714a2ba019144211931dbe853f1960aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:46:39.885368 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012a784-863b-4d0b-93a4-c9e1a5a40dbd service swift] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:46:39.885656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012a784-863b-4d0b-93a4-c9e1a5a40dbd service swift] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:46:39.885931 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012a784-863b-4d0b-93a4-c9e1a5a40dbd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:46:39.897453 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012a784-863b-4d0b-93a4-c9e1a5a40dbd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:46:39.898536 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012a784-863b-4d0b-93a4-c9e1a5a40dbd service swift] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:46:39.914391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1277/2533] 10.222.0.69 () {60 vars in 1384 bytes} [Mon Aug 29 21:46:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 21:46:49.716682 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=25 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:46:49.907668 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=38 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:47:00.716257 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10f14a-0ef6-42d8-85ae-15dd6a2255a6 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:47:00.716905 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10f14a-0ef6-42d8-85ae-15dd6a2255a6 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:47:00.716905 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10f14a-0ef6-42d8-85ae-15dd6a2255a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:47:00.739006 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-df10f14a-0ef6-42d8-85ae-15dd6a2255a6 None None] MFA Rules not processed for user `540e06e694524c4a9e84ebebd45956d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:47:00.740328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-df10f14a-0ef6-42d8-85ae-15dd6a2255a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:47:00.749536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1257/2534] 10.222.0.69 () {58 vars in 1009 bytes} [Mon Aug 29 21:47:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:47:00.763886 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012a784-863b-4d0b-93a4-c9e1a5a40dbd service swift] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:47:00.780492 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012a784-863b-4d0b-93a4-c9e1a5a40dbd service swift] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:47:00.786717 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba7e20-b418-4efc-9b2b-e6478ab06891 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '714a2ba019144211931dbe853f1960aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:47:00.787365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba7e20-b418-4efc-9b2b-e6478ab06891 service swift] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:47:00.787651 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba7e20-b418-4efc-9b2b-e6478ab06891 service swift] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:47:00.787935 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba7e20-b418-4efc-9b2b-e6478ab06891 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:47:00.798543 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba7e20-b418-4efc-9b2b-e6478ab06891 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:47:00.800248 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba7e20-b418-4efc-9b2b-e6478ab06891 service swift] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:47:00.813706 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1278/2535] 10.222.0.69 () {60 vars in 1384 bytes} [Mon Aug 29 21:47:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:47:10.732172 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:47:10.807701 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=6 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:47:17.428926 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe182a1b-2570-496b-a4ed-43395e3ee30b None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:47:17.429538 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe182a1b-2570-496b-a4ed-43395e3ee30b None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:47:17.429654 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe182a1b-2570-496b-a4ed-43395e3ee30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:47:17.452949 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-fe182a1b-2570-496b-a4ed-43395e3ee30b None None] MFA Rules not processed for user `69b79740961d4100a287f62093ccae9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:47:17.454215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-fe182a1b-2570-496b-a4ed-43395e3ee30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:47:17.463719 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1258/2536] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:47:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:47:21.223761 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9252c-4fc7-4bb0-b5ed-e6008130ad98 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:47:21.224430 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9252c-4fc7-4bb0-b5ed-e6008130ad98 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:47:21.224567 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9252c-4fc7-4bb0-b5ed-e6008130ad98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:47:21.247953 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-11f9252c-4fc7-4bb0-b5ed-e6008130ad98 None None] MFA Rules not processed for user `540e06e694524c4a9e84ebebd45956d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:47:21.249321 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-11f9252c-4fc7-4bb0-b5ed-e6008130ad98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:47:21.257033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1279/2537] 10.222.0.69 () {58 vars in 967 bytes} [Mon Aug 29 21:47:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:47:21.275669 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe182a1b-2570-496b-a4ed-43395e3ee30b None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:47:21.289488 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe182a1b-2570-496b-a4ed-43395e3ee30b None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:47:21.295360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b0326-12cc-4cd2-adad-092f9032c1da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '714a2ba019144211931dbe853f1960aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:47:21.296063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b0326-12cc-4cd2-adad-092f9032c1da service swift] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:47:21.296420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b0326-12cc-4cd2-adad-092f9032c1da service swift] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:47:21.296783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b0326-12cc-4cd2-adad-092f9032c1da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:47:21.307164 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b0326-12cc-4cd2-adad-092f9032c1da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:47:21.309373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b0326-12cc-4cd2-adad-092f9032c1da service swift] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:47:21.319234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1259/2538] 10.222.0.69 () {60 vars in 1384 bytes} [Mon Aug 29 21:47:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:47:31.240912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:47:31.315217 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=9 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:47:35.257834 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9252c-4fc7-4bb0-b5ed-e6008130ad98 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:47:35.283368 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9252c-4fc7-4bb0-b5ed-e6008130ad98 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:47:35.288040 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b04e4-2ba1-43ba-9ce5-dfeb06b33bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:47:35.289346 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b04e4-2ba1-43ba-9ce5-dfeb06b33bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:47:35.290097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b04e4-2ba1-43ba-9ce5-dfeb06b33bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:47:35.290594 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b04e4-2ba1-43ba-9ce5-dfeb06b33bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:47:35.293305 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-093b04e4-2ba1-43ba-9ce5-dfeb06b33bc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:47:35.431993 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b04e4-2ba1-43ba-9ce5-dfeb06b33bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:47:35.435243 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b04e4-2ba1-43ba-9ce5-dfeb06b33bc4 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:47:35.453035 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1280/2539] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:47:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:47:44.366787 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6104e4-bd78-4bd4-a964-93b9407e2727 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:47:44.367680 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6104e4-bd78-4bd4-a964-93b9407e2727 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:47:44.368753 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6104e4-bd78-4bd4-a964-93b9407e2727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:47:44.428912 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-3b6104e4-bd78-4bd4-a964-93b9407e2727 None None] MFA Rules not processed for user `540e06e694524c4a9e84ebebd45956d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:47:44.431054 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-3b6104e4-bd78-4bd4-a964-93b9407e2727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:47:44.486271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1260/2540] 10.222.0.69 () {58 vars in 967 bytes} [Mon Aug 29 21:47:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:47:44.538963 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b04e4-2ba1-43ba-9ce5-dfeb06b33bc4 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:47:44.592030 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b04e4-2ba1-43ba-9ce5-dfeb06b33bc4 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:47:44.602841 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732e187-276d-465b-b68f-c0d1a6750d4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '714a2ba019144211931dbe853f1960aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:47:44.602841 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732e187-276d-465b-b68f-c0d1a6750d4f service swift] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:47:44.603308 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732e187-276d-465b-b68f-c0d1a6750d4f service swift] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:47:44.603757 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732e187-276d-465b-b68f-c0d1a6750d4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:47:44.621067 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732e187-276d-465b-b68f-c0d1a6750d4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:47:44.625556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732e187-276d-465b-b68f-c0d1a6750d4f service swift] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:47:44.643437 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1281/2541] 10.222.0.69 () {60 vars in 1384 bytes} [Mon Aug 29 21:47:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:47:44.755407 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6104e4-bd78-4bd4-a964-93b9407e2727 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:47:44.773949 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6104e4-bd78-4bd4-a964-93b9407e2727 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:47:44.781886 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a7276-c12b-4869-95da-0dfdf84e84f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:47:44.782952 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a7276-c12b-4869-95da-0dfdf84e84f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:47:44.783493 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a7276-c12b-4869-95da-0dfdf84e84f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:47:44.783987 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a7276-c12b-4869-95da-0dfdf84e84f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:47:44.788617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-021a7276-c12b-4869-95da-0dfdf84e84f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:47:44.918707 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a7276-c12b-4869-95da-0dfdf84e84f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:47:44.921934 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a7276-c12b-4869-95da-0dfdf84e84f1 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:47:44.971173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1261/2542] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:47:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:47:51.587190 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732e187-276d-465b-b68f-c0d1a6750d4f service swift] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:47:51.590780 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3732e187-276d-465b-b68f-c0d1a6750d4f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:47:51.788627 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732e187-276d-465b-b68f-c0d1a6750d4f service swift] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:47:51.800804 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491e9ea-ced2-44e8-b18a-766a34cb527f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7911672bb2a471daf4f69ba940ef41d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:47:51.801897 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491e9ea-ced2-44e8-b18a-766a34cb527f service placement] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:47:51.802660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491e9ea-ced2-44e8-b18a-766a34cb527f service placement] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:47:51.803185 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491e9ea-ced2-44e8-b18a-766a34cb527f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:47:51.806635 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e491e9ea-ced2-44e8-b18a-766a34cb527f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:47:51.831266 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e491e9ea-ced2-44e8-b18a-766a34cb527f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:47:51.834226 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e491e9ea-ced2-44e8-b18a-766a34cb527f service placement] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:47:51.854756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1282/2543] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:47:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:47:54.965262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=33 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:47:55.756988 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a7276-c12b-4869-95da-0dfdf84e84f1 service neutron] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:47:55.779078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a7276-c12b-4869-95da-0dfdf84e84f1 service neutron] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:47:55.789346 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e379b8-6fa9-4ba1-8b38-ff70885b9511 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7911672bb2a471daf4f69ba940ef41d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:47:55.791052 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e379b8-6fa9-4ba1-8b38-ff70885b9511 service placement] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:47:55.791593 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e379b8-6fa9-4ba1-8b38-ff70885b9511 service placement] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:47:55.792117 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e379b8-6fa9-4ba1-8b38-ff70885b9511 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:47:55.794990 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-41e379b8-6fa9-4ba1-8b38-ff70885b9511 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:47:55.814410 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e379b8-6fa9-4ba1-8b38-ff70885b9511 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:47:55.816760 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e379b8-6fa9-4ba1-8b38-ff70885b9511 service placement] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:47:55.842534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1262/2544] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:47:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:47:58.085210 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491e9ea-ced2-44e8-b18a-766a34cb527f service placement] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:47:58.087587 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e491e9ea-ced2-44e8-b18a-766a34cb527f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:47:58.114811 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491e9ea-ced2-44e8-b18a-766a34cb527f service placement] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:47:58.123097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325ca21-286f-40b9-8115-52102c35b5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:47:58.124318 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325ca21-286f-40b9-8115-52102c35b5f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:47:58.125377 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325ca21-286f-40b9-8115-52102c35b5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:47:58.125876 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325ca21-286f-40b9-8115-52102c35b5f8 admin admin] PATH_INFO: `/v3/users/1492ee44490f4372aa15ff391da1a8da` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:47:58.128161 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325ca21-286f-40b9-8115-52102c35b5f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1492ee44490f4372aa15ff391da1a8da)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:47:58.132310 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325ca21-286f-40b9-8115-52102c35b5f8 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:47:58.156905 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:47:58.251908 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d325ca21-286f-40b9-8115-52102c35b5f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1492ee44490f4372aa15ff391da1a8da'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:47:58.268665 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d325ca21-286f-40b9-8115-52102c35b5f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1492ee44490f4372aa15ff391da1a8da'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:47:58.285487 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d325ca21-286f-40b9-8115-52102c35b5f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1492ee44490f4372aa15ff391da1a8da'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:47:58.287013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d325ca21-286f-40b9-8115-52102c35b5f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1492ee44490f4372aa15ff391da1a8da'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:47:58.287965 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d325ca21-286f-40b9-8115-52102c35b5f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1492ee44490f4372aa15ff391da1a8da'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:47:58.326083 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1283/2545] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:47:58 2022] DELETE /identity/v3/users/1492ee44490f4372aa15ff391da1a8da => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:47:59.189254 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e379b8-6fa9-4ba1-8b38-ff70885b9511 service placement] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:47:59.208763 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e379b8-6fa9-4ba1-8b38-ff70885b9511 service placement] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:47:59.363811 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1849f4-c727-4afd-a591-76326737e837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:47:59.365491 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1849f4-c727-4afd-a591-76326737e837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:47:59.366316 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1849f4-c727-4afd-a591-76326737e837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:47:59.366959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1849f4-c727-4afd-a591-76326737e837 admin admin] PATH_INFO: `/v3/projects/1eb005583e694aac90ec9f4d5fcb1aa6` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:47:59.369862 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1849f4-c727-4afd-a591-76326737e837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eb005583e694aac90ec9f4d5fcb1aa6)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:47:59.376056 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1849f4-c727-4afd-a591-76326737e837 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:47:59.464427 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9a1849f4-c727-4afd-a591-76326737e837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eb005583e694aac90ec9f4d5fcb1aa6', 'request_id': 'req-9a1849f4-c727-4afd-a591-76326737e837'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:47:59.481510 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9a1849f4-c727-4afd-a591-76326737e837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eb005583e694aac90ec9f4d5fcb1aa6', 'request_id': 'req-9a1849f4-c727-4afd-a591-76326737e837'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:47:59.497479 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9a1849f4-c727-4afd-a591-76326737e837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eb005583e694aac90ec9f4d5fcb1aa6', 'request_id': 'req-9a1849f4-c727-4afd-a591-76326737e837'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:47:59.518429 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9a1849f4-c727-4afd-a591-76326737e837 admin admin] The token cache is being invalidate because project 1eb005583e694aac90ec9f4d5fcb1aa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:47:59.518892 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9a1849f4-c727-4afd-a591-76326737e837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:47:59.520663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9a1849f4-c727-4afd-a591-76326737e837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:47:59.523655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1263/2546] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:47:59 2022] DELETE /identity/v3/projects/1eb005583e694aac90ec9f4d5fcb1aa6 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:47:59.530655 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325ca21-286f-40b9-8115-52102c35b5f8 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:47:59.534770 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d325ca21-286f-40b9-8115-52102c35b5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:47:59.559648 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325ca21-286f-40b9-8115-52102c35b5f8 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:47:59.647397 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a818c-325e-44d2-9bd4-f9ab1f382342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:47:59.648467 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a818c-325e-44d2-9bd4-f9ab1f382342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:47:59.648949 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a818c-325e-44d2-9bd4-f9ab1f382342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:47:59.649660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a818c-325e-44d2-9bd4-f9ab1f382342 admin admin] PATH_INFO: `/v3/users/6985ba3846564a0a8f6c3f56fc0a9437` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:47:59.651584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a818c-325e-44d2-9bd4-f9ab1f382342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6985ba3846564a0a8f6c3f56fc0a9437)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:47:59.654857 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a818c-325e-44d2-9bd4-f9ab1f382342 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:47:59.750961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-538a818c-325e-44d2-9bd4-f9ab1f382342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6985ba3846564a0a8f6c3f56fc0a9437'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:47:59.767102 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-538a818c-325e-44d2-9bd4-f9ab1f382342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6985ba3846564a0a8f6c3f56fc0a9437'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:47:59.779121 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-538a818c-325e-44d2-9bd4-f9ab1f382342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6985ba3846564a0a8f6c3f56fc0a9437'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:47:59.780325 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-538a818c-325e-44d2-9bd4-f9ab1f382342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6985ba3846564a0a8f6c3f56fc0a9437'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:47:59.781475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-538a818c-325e-44d2-9bd4-f9ab1f382342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6985ba3846564a0a8f6c3f56fc0a9437'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:47:59.811264 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1284/2547] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:47:59 2022] DELETE /identity/v3/users/6985ba3846564a0a8f6c3f56fc0a9437 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:00.071249 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1849f4-c727-4afd-a591-76326737e837 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:00.072831 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-9a1849f4-c727-4afd-a591-76326737e837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:00.090424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1849f4-c727-4afd-a591-76326737e837 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:00.104326 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a818c-325e-44d2-9bd4-f9ab1f382342 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:00.107128 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-538a818c-325e-44d2-9bd4-f9ab1f382342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:00.130269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:00.205592 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbcd28-8783-4102-ae23-279e3f43c563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:00.206722 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbcd28-8783-4102-ae23-279e3f43c563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:00.207130 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbcd28-8783-4102-ae23-279e3f43c563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:00.207477 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbcd28-8783-4102-ae23-279e3f43c563 admin admin] PATH_INFO: `/v3/projects/19328c25dd7c4ef5bbaec76b6bbbcd46` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:00.209415 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cbcd28-8783-4102-ae23-279e3f43c563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19328c25dd7c4ef5bbaec76b6bbbcd46)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:00.211594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cbcd28-8783-4102-ae23-279e3f43c563 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:00.231312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a818c-325e-44d2-9bd4-f9ab1f382342 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:00.240618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9417a3-30c3-49f9-9c29-d8dcbf172ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:00.241488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9417a3-30c3-49f9-9c29-d8dcbf172ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:00.241927 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9417a3-30c3-49f9-9c29-d8dcbf172ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:00.242205 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9417a3-30c3-49f9-9c29-d8dcbf172ad4 admin admin] PATH_INFO: `/v3/users/4850ae6216a9455ab9b96c64fa99e491` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:00.242971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:00.243623 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9417a3-30c3-49f9-9c29-d8dcbf172ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4850ae6216a9455ab9b96c64fa99e491)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:00.245818 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9417a3-30c3-49f9-9c29-d8dcbf172ad4 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:00.286872 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-90cbcd28-8783-4102-ae23-279e3f43c563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19328c25dd7c4ef5bbaec76b6bbbcd46', 'request_id': 'req-90cbcd28-8783-4102-ae23-279e3f43c563'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:00.298383 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-90cbcd28-8783-4102-ae23-279e3f43c563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19328c25dd7c4ef5bbaec76b6bbbcd46', 'request_id': 'req-90cbcd28-8783-4102-ae23-279e3f43c563'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:00.308067 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-90cbcd28-8783-4102-ae23-279e3f43c563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19328c25dd7c4ef5bbaec76b6bbbcd46', 'request_id': 'req-90cbcd28-8783-4102-ae23-279e3f43c563'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:00.313350 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8e9417a3-30c3-49f9-9c29-d8dcbf172ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4850ae6216a9455ab9b96c64fa99e491'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:00.324638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-90cbcd28-8783-4102-ae23-279e3f43c563 admin admin] The token cache is being invalidate because project 19328c25dd7c4ef5bbaec76b6bbbcd46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:48:00.325202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8e9417a3-30c3-49f9-9c29-d8dcbf172ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4850ae6216a9455ab9b96c64fa99e491'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:00.325417 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-90cbcd28-8783-4102-ae23-279e3f43c563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:00.326065 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-90cbcd28-8783-4102-ae23-279e3f43c563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:00.328214 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1264/2548] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:48:00 2022] DELETE /identity/v3/projects/19328c25dd7c4ef5bbaec76b6bbbcd46 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:00.337476 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8e9417a3-30c3-49f9-9c29-d8dcbf172ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4850ae6216a9455ab9b96c64fa99e491'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:00.338459 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8e9417a3-30c3-49f9-9c29-d8dcbf172ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4850ae6216a9455ab9b96c64fa99e491'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:00.339526 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8e9417a3-30c3-49f9-9c29-d8dcbf172ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4850ae6216a9455ab9b96c64fa99e491'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:00.367395 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1285/2549] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:48:00 2022] DELETE /identity/v3/users/4850ae6216a9455ab9b96c64fa99e491 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:00.720149 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbcd28-8783-4102-ae23-279e3f43c563 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:00.725697 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-90cbcd28-8783-4102-ae23-279e3f43c563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:00.846238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbcd28-8783-4102-ae23-279e3f43c563 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:00.927706 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78509e4-5087-477f-be09-5e7e8579b82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:00.928017 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78509e4-5087-477f-be09-5e7e8579b82a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:00.928271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78509e4-5087-477f-be09-5e7e8579b82a admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:00.928431 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78509e4-5087-477f-be09-5e7e8579b82a admin admin] PATH_INFO: `/v3/projects/d5fc73e1535f4dcd8f6b5e3da0cbfae8` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:00.929812 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78509e4-5087-477f-be09-5e7e8579b82a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5fc73e1535f4dcd8f6b5e3da0cbfae8)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:00.931929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78509e4-5087-477f-be09-5e7e8579b82a admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:00.993678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d78509e4-5087-477f-be09-5e7e8579b82a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5fc73e1535f4dcd8f6b5e3da0cbfae8', 'request_id': 'req-d78509e4-5087-477f-be09-5e7e8579b82a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:01.001300 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d78509e4-5087-477f-be09-5e7e8579b82a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5fc73e1535f4dcd8f6b5e3da0cbfae8', 'request_id': 'req-d78509e4-5087-477f-be09-5e7e8579b82a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:01.003876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:01.011047 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d78509e4-5087-477f-be09-5e7e8579b82a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5fc73e1535f4dcd8f6b5e3da0cbfae8', 'request_id': 'req-d78509e4-5087-477f-be09-5e7e8579b82a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:01.030503 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d78509e4-5087-477f-be09-5e7e8579b82a admin admin] The token cache is being invalidate because project d5fc73e1535f4dcd8f6b5e3da0cbfae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:48:01.030798 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d78509e4-5087-477f-be09-5e7e8579b82a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:01.031538 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d78509e4-5087-477f-be09-5e7e8579b82a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:01.033148 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1265/2550] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:48:00 2022] DELETE /identity/v3/projects/d5fc73e1535f4dcd8f6b5e3da0cbfae8 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:01.037537 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9417a3-30c3-49f9-9c29-d8dcbf172ad4 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:01.039996 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-8e9417a3-30c3-49f9-9c29-d8dcbf172ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:01.063019 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9417a3-30c3-49f9-9c29-d8dcbf172ad4 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:01.166447 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c83849-e62b-4a7a-bb59-3abda5a7f57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:01.167270 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c83849-e62b-4a7a-bb59-3abda5a7f57d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:01.167659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c83849-e62b-4a7a-bb59-3abda5a7f57d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:01.168058 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c83849-e62b-4a7a-bb59-3abda5a7f57d admin admin] PATH_INFO: `/v3/users/bd838fbbe5e44ca29048458846f83387` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:01.169692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c83849-e62b-4a7a-bb59-3abda5a7f57d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd838fbbe5e44ca29048458846f83387)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:01.172085 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c83849-e62b-4a7a-bb59-3abda5a7f57d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:01.225420 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:01.254269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-60c83849-e62b-4a7a-bb59-3abda5a7f57d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd838fbbe5e44ca29048458846f83387'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:01.263179 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-60c83849-e62b-4a7a-bb59-3abda5a7f57d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd838fbbe5e44ca29048458846f83387'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:01.277068 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-60c83849-e62b-4a7a-bb59-3abda5a7f57d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd838fbbe5e44ca29048458846f83387'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:01.278082 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-60c83849-e62b-4a7a-bb59-3abda5a7f57d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd838fbbe5e44ca29048458846f83387'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:01.279028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-60c83849-e62b-4a7a-bb59-3abda5a7f57d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd838fbbe5e44ca29048458846f83387'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:01.310092 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1286/2551] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:48:01 2022] DELETE /identity/v3/users/bd838fbbe5e44ca29048458846f83387 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:48:01.586671 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78509e4-5087-477f-be09-5e7e8579b82a admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:01.588769 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-d78509e4-5087-477f-be09-5e7e8579b82a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:01.604342 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78509e4-5087-477f-be09-5e7e8579b82a admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:01.697885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163e91c-cfe9-4ca4-aa00-a620cc8a301f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:01.698581 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163e91c-cfe9-4ca4-aa00-a620cc8a301f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:01.698910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163e91c-cfe9-4ca4-aa00-a620cc8a301f admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:01.699634 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163e91c-cfe9-4ca4-aa00-a620cc8a301f admin admin] PATH_INFO: `/v3/projects/d16d4e617c354ae9aadbec6e33f5b98a` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:01.700642 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163e91c-cfe9-4ca4-aa00-a620cc8a301f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d16d4e617c354ae9aadbec6e33f5b98a)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:01.704221 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163e91c-cfe9-4ca4-aa00-a620cc8a301f admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:01.775446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9163e91c-cfe9-4ca4-aa00-a620cc8a301f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd16d4e617c354ae9aadbec6e33f5b98a', 'request_id': 'req-9163e91c-cfe9-4ca4-aa00-a620cc8a301f'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:01.787919 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9163e91c-cfe9-4ca4-aa00-a620cc8a301f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd16d4e617c354ae9aadbec6e33f5b98a', 'request_id': 'req-9163e91c-cfe9-4ca4-aa00-a620cc8a301f'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:01.796051 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9163e91c-cfe9-4ca4-aa00-a620cc8a301f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd16d4e617c354ae9aadbec6e33f5b98a', 'request_id': 'req-9163e91c-cfe9-4ca4-aa00-a620cc8a301f'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:01.812536 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9163e91c-cfe9-4ca4-aa00-a620cc8a301f admin admin] The token cache is being invalidate because project d16d4e617c354ae9aadbec6e33f5b98a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:48:01.812833 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9163e91c-cfe9-4ca4-aa00-a620cc8a301f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:01.813539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9163e91c-cfe9-4ca4-aa00-a620cc8a301f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:01.815251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1266/2552] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:48:01 2022] DELETE /identity/v3/projects/d16d4e617c354ae9aadbec6e33f5b98a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:03.145425 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c83849-e62b-4a7a-bb59-3abda5a7f57d admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:03.148014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-60c83849-e62b-4a7a-bb59-3abda5a7f57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:03.276371 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c83849-e62b-4a7a-bb59-3abda5a7f57d admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:03.347435 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447ae70-2323-4421-a589-a418be7c8877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:03.348468 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447ae70-2323-4421-a589-a418be7c8877 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:03.348940 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447ae70-2323-4421-a589-a418be7c8877 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:03.349264 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447ae70-2323-4421-a589-a418be7c8877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:03.352079 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1447ae70-2323-4421-a589-a418be7c8877 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:03.440748 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:03.457156 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447ae70-2323-4421-a589-a418be7c8877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:03.459027 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447ae70-2323-4421-a589-a418be7c8877 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:03.477134 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1287/2553] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:48:08.614587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163e91c-cfe9-4ca4-aa00-a620cc8a301f admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:08.617425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-9163e91c-cfe9-4ca4-aa00-a620cc8a301f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:08.647665 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163e91c-cfe9-4ca4-aa00-a620cc8a301f admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:08.660775 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f8c46-d36d-436a-9f3d-0a1e7033d4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:08.661479 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f8c46-d36d-436a-9f3d-0a1e7033d4b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:08.661743 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f8c46-d36d-436a-9f3d-0a1e7033d4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:08.662277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f8c46-d36d-436a-9f3d-0a1e7033d4b2 admin admin] PATH_INFO: `/v3/users/0d38cb68bef94e32abccab5f3772a330` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:08.664060 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f8c46-d36d-436a-9f3d-0a1e7033d4b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d38cb68bef94e32abccab5f3772a330)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:08.666139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f8c46-d36d-436a-9f3d-0a1e7033d4b2 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:08.754318 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-966f8c46-d36d-436a-9f3d-0a1e7033d4b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d38cb68bef94e32abccab5f3772a330'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:08.770155 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-966f8c46-d36d-436a-9f3d-0a1e7033d4b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d38cb68bef94e32abccab5f3772a330'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:08.797541 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:08.807094 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-966f8c46-d36d-436a-9f3d-0a1e7033d4b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d38cb68bef94e32abccab5f3772a330'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:08.808676 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-966f8c46-d36d-436a-9f3d-0a1e7033d4b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d38cb68bef94e32abccab5f3772a330'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:08.810685 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-966f8c46-d36d-436a-9f3d-0a1e7033d4b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d38cb68bef94e32abccab5f3772a330'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:08.849957 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1267/2554] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:48:08 2022] DELETE /identity/v3/users/0d38cb68bef94e32abccab5f3772a330 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:09.145357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447ae70-2323-4421-a589-a418be7c8877 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:09.165479 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447ae70-2323-4421-a589-a418be7c8877 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:09.270419 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404f9e8-4477-4d6f-b8ef-c6c5b756ba59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:09.271341 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404f9e8-4477-4d6f-b8ef-c6c5b756ba59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:09.271788 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404f9e8-4477-4d6f-b8ef-c6c5b756ba59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:09.272225 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404f9e8-4477-4d6f-b8ef-c6c5b756ba59 admin admin] PATH_INFO: `/v3/projects/bfa5001d627743b7b84cdd426a6cc275` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:09.273830 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404f9e8-4477-4d6f-b8ef-c6c5b756ba59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfa5001d627743b7b84cdd426a6cc275)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:09.276906 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404f9e8-4477-4d6f-b8ef-c6c5b756ba59 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:09.359564 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-b404f9e8-4477-4d6f-b8ef-c6c5b756ba59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfa5001d627743b7b84cdd426a6cc275', 'request_id': 'req-b404f9e8-4477-4d6f-b8ef-c6c5b756ba59'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:09.370680 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-b404f9e8-4477-4d6f-b8ef-c6c5b756ba59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfa5001d627743b7b84cdd426a6cc275', 'request_id': 'req-b404f9e8-4477-4d6f-b8ef-c6c5b756ba59'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:09.381556 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-b404f9e8-4477-4d6f-b8ef-c6c5b756ba59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfa5001d627743b7b84cdd426a6cc275', 'request_id': 'req-b404f9e8-4477-4d6f-b8ef-c6c5b756ba59'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:09.407665 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-b404f9e8-4477-4d6f-b8ef-c6c5b756ba59 admin admin] The token cache is being invalidate because project bfa5001d627743b7b84cdd426a6cc275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:48:09.408558 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-b404f9e8-4477-4d6f-b8ef-c6c5b756ba59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:09.409401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-b404f9e8-4477-4d6f-b8ef-c6c5b756ba59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:09.412031 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1288/2555] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:48:09 2022] DELETE /identity/v3/projects/bfa5001d627743b7b84cdd426a6cc275 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:09.420545 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cc6a1-cefb-464b-9ba5-ee02159ca4e3 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:09.421021 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cc6a1-cefb-464b-9ba5-ee02159ca4e3 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:09.421434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cc6a1-cefb-464b-9ba5-ee02159ca4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:09.516362 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-622cc6a1-cefb-464b-9ba5-ee02159ca4e3 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:09.517861 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-622cc6a1-cefb-464b-9ba5-ee02159ca4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:09.625712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1268/2556] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:48:09.640792 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593328a-7378-40b2-b99a-fcc08bc536b1 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:09.641451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593328a-7378-40b2-b99a-fcc08bc536b1 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:09.641806 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593328a-7378-40b2-b99a-fcc08bc536b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:09.678176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-2593328a-7378-40b2-b99a-fcc08bc536b1 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:09.680783 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2593328a-7378-40b2-b99a-fcc08bc536b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:09.695998 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1289/2557] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:09.701927 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cc6a1-cefb-464b-9ba5-ee02159ca4e3 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:09.714530 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cc6a1-cefb-464b-9ba5-ee02159ca4e3 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:09.720014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb6224-9bdc-4185-99bc-16c093efb4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:09.720682 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb6224-9bdc-4185-99bc-16c093efb4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:09.720939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb6224-9bdc-4185-99bc-16c093efb4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:09.721220 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb6224-9bdc-4185-99bc-16c093efb4f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:09.721893 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb6224-9bdc-4185-99bc-16c093efb4f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:48:09.722197 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb6224-9bdc-4185-99bc-16c093efb4f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:09.723982 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb6224-9bdc-4185-99bc-16c093efb4f0 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:09.738468 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1269/2558] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:48:09.744976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593328a-7378-40b2-b99a-fcc08bc536b1 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:09.756613 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593328a-7378-40b2-b99a-fcc08bc536b1 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:09.762931 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a924aca-041d-45c2-af92-14658e58d0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:09.763559 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a924aca-041d-45c2-af92-14658e58d0f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:09.763836 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a924aca-041d-45c2-af92-14658e58d0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:09.764106 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a924aca-041d-45c2-af92-14658e58d0f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:09.764804 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a924aca-041d-45c2-af92-14658e58d0f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:09.766787 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a924aca-041d-45c2-af92-14658e58d0f0 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:09.804129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1290/2559] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:48:09 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:48:09.810029 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb6224-9bdc-4185-99bc-16c093efb4f0 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:09.822593 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb6224-9bdc-4185-99bc-16c093efb4f0 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:09.908689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af83396-ff10-4831-9ca2-4d95d07c75b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:09.909392 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af83396-ff10-4831-9ca2-4d95d07c75b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:09.909676 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af83396-ff10-4831-9ca2-4d95d07c75b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:09.909955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af83396-ff10-4831-9ca2-4d95d07c75b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:09.910624 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af83396-ff10-4831-9ca2-4d95d07c75b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:09.912960 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af83396-ff10-4831-9ca2-4d95d07c75b4 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:09.942547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1270/2560] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:48:09 2022] POST /identity/v3/users => generated 288 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:48:09.947598 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a924aca-041d-45c2-af92-14658e58d0f0 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:09.962825 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a924aca-041d-45c2-af92-14658e58d0f0 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:09.968699 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b997f-7591-40a7-9025-e50e2ba0164e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:09.969465 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b997f-7591-40a7-9025-e50e2ba0164e admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:09.969788 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b997f-7591-40a7-9025-e50e2ba0164e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:09.970142 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b997f-7591-40a7-9025-e50e2ba0164e admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:09.971085 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b997f-7591-40a7-9025-e50e2ba0164e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:09.973159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b997f-7591-40a7-9025-e50e2ba0164e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:09.986623 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1291/2561] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:09.991490 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af83396-ff10-4831-9ca2-4d95d07c75b4 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:10.002895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af83396-ff10-4831-9ca2-4d95d07c75b4 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:10.009244 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179507f-cce3-4c38-aa42-c4f7c7f2b375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:10.009892 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179507f-cce3-4c38-aa42-c4f7c7f2b375 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:10.010171 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179507f-cce3-4c38-aa42-c4f7c7f2b375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:10.010443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179507f-cce3-4c38-aa42-c4f7c7f2b375 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:10.011115 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179507f-cce3-4c38-aa42-c4f7c7f2b375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:10.012842 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179507f-cce3-4c38-aa42-c4f7c7f2b375 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:10.025765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1271/2562] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:48:10.031129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b997f-7591-40a7-9025-e50e2ba0164e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:10.042465 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b997f-7591-40a7-9025-e50e2ba0164e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:10.048655 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f64b8-9bbd-49d0-bc07-2b6129c3a38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:10.049429 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f64b8-9bbd-49d0-bc07-2b6129c3a38d admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:10.049877 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f64b8-9bbd-49d0-bc07-2b6129c3a38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:10.050240 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f64b8-9bbd-49d0-bc07-2b6129c3a38d admin admin] PATH_INFO: `/v3/projects/268720f181b746ccb661b974e023c557/users/b9f91e1def064d65a1df9f005464c77e/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:10.071520 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f64b8-9bbd-49d0-bc07-2b6129c3a38d admin admin] RBAC: Authorizing `identity:create_grant(project_id=268720f181b746ccb661b974e023c557, user_id=b9f91e1def064d65a1df9f005464c77e, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:10.075428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f64b8-9bbd-49d0-bc07-2b6129c3a38d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:10.091290 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1292/2563] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:10 2022] PUT /identity/v3/projects/268720f181b746ccb661b974e023c557/users/b9f91e1def064d65a1df9f005464c77e/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:10.103008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f984dd2-48e3-4fde-a002-4f0e8bad67a8 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:10.103510 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f984dd2-48e3-4fde-a002-4f0e8bad67a8 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:10.103994 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f984dd2-48e3-4fde-a002-4f0e8bad67a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:10.157026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-7f984dd2-48e3-4fde-a002-4f0e8bad67a8 None None] MFA Rules not processed for user `b9f91e1def064d65a1df9f005464c77e`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:10.159256 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-7f984dd2-48e3-4fde-a002-4f0e8bad67a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:10.178588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:10.278376 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1272/2564] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:10.285581 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f64b8-9bbd-49d0-bc07-2b6129c3a38d admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:10.311859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:10.366277 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f64b8-9bbd-49d0-bc07-2b6129c3a38d admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:10.371742 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d9948-1468-42ad-893a-9a87abf2a478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:10.372397 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d9948-1468-42ad-893a-9a87abf2a478 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:10.372680 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d9948-1468-42ad-893a-9a87abf2a478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:10.372956 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d9948-1468-42ad-893a-9a87abf2a478 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:10.373601 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d9948-1468-42ad-893a-9a87abf2a478 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:10.375553 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d9948-1468-42ad-893a-9a87abf2a478 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:10.409037 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1293/2565] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:48:10 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:48:10.415379 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f984dd2-48e3-4fde-a002-4f0e8bad67a8 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:10.427516 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f984dd2-48e3-4fde-a002-4f0e8bad67a8 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:10.497626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447a2f0-cba6-4b9f-8f82-1b70534c704d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:10.498417 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447a2f0-cba6-4b9f-8f82-1b70534c704d admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:10.498866 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447a2f0-cba6-4b9f-8f82-1b70534c704d admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:10.499266 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447a2f0-cba6-4b9f-8f82-1b70534c704d admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:10.500126 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447a2f0-cba6-4b9f-8f82-1b70534c704d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:10.502516 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447a2f0-cba6-4b9f-8f82-1b70534c704d admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:10.533534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1273/2566] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:48:10 2022] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:48:10.542704 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d9948-1468-42ad-893a-9a87abf2a478 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:10.556406 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d9948-1468-42ad-893a-9a87abf2a478 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:10.561828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6359b-b341-42a2-8322-fc5a9f1c2200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:10.562452 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6359b-b341-42a2-8322-fc5a9f1c2200 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:10.562734 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6359b-b341-42a2-8322-fc5a9f1c2200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:10.563006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6359b-b341-42a2-8322-fc5a9f1c2200 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:10.563680 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6359b-b341-42a2-8322-fc5a9f1c2200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:10.565365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6359b-b341-42a2-8322-fc5a9f1c2200 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:10.578561 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1294/2567] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:10.583341 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447a2f0-cba6-4b9f-8f82-1b70534c704d admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:10.594664 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447a2f0-cba6-4b9f-8f82-1b70534c704d admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:10.600324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82cf12-c944-43f8-8e8e-d0ce273722f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:10.601026 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82cf12-c944-43f8-8e8e-d0ce273722f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:10.601308 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82cf12-c944-43f8-8e8e-d0ce273722f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:10.601587 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82cf12-c944-43f8-8e8e-d0ce273722f5 admin admin] PATH_INFO: `/v3/projects/fa79b0af32024610b34ba022fe56730e/users/b332bd0f00764c72b95f776a5b96e247/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:10.627276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82cf12-c944-43f8-8e8e-d0ce273722f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa79b0af32024610b34ba022fe56730e, user_id=b332bd0f00764c72b95f776a5b96e247, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:10.631876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82cf12-c944-43f8-8e8e-d0ce273722f5 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:10.648843 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1274/2568] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:10 2022] PUT /identity/v3/projects/fa79b0af32024610b34ba022fe56730e/users/b332bd0f00764c72b95f776a5b96e247/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:10.653645 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6359b-b341-42a2-8322-fc5a9f1c2200 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:10.665522 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6359b-b341-42a2-8322-fc5a9f1c2200 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:10.760658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6d5cf-81f0-44b0-b526-5ce2ae2e0f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:10.761668 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6d5cf-81f0-44b0-b526-5ce2ae2e0f20 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:10.762183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6d5cf-81f0-44b0-b526-5ce2ae2e0f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:10.762638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6d5cf-81f0-44b0-b526-5ce2ae2e0f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:10.763770 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6d5cf-81f0-44b0-b526-5ce2ae2e0f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:10.766788 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6d5cf-81f0-44b0-b526-5ce2ae2e0f20 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:10.788453 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1295/2569] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:10.793757 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82cf12-c944-43f8-8e8e-d0ce273722f5 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:10.806281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82cf12-c944-43f8-8e8e-d0ce273722f5 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:10.812876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209c0b8-d69d-463f-a5d3-b166adcfaa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:10.814737 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209c0b8-d69d-463f-a5d3-b166adcfaa46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:10.816222 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209c0b8-d69d-463f-a5d3-b166adcfaa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:10.816222 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209c0b8-d69d-463f-a5d3-b166adcfaa46 admin admin] PATH_INFO: `/v3/projects/fa79b0af32024610b34ba022fe56730e/users/b332bd0f00764c72b95f776a5b96e247/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:10.818378 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209c0b8-d69d-463f-a5d3-b166adcfaa46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa79b0af32024610b34ba022fe56730e, user_id=b332bd0f00764c72b95f776a5b96e247, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:10.821401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209c0b8-d69d-463f-a5d3-b166adcfaa46 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:10.841076 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1275/2570] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:10 2022] PUT /identity/v3/projects/fa79b0af32024610b34ba022fe56730e/users/b332bd0f00764c72b95f776a5b96e247/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:48:10.858742 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd20db-32b8-4ea3-aa43-511a3e0edb27 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:10.859246 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd20db-32b8-4ea3-aa43-511a3e0edb27 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:10.859568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd20db-32b8-4ea3-aa43-511a3e0edb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:10.913510 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-affd20db-32b8-4ea3-aa43-511a3e0edb27 None None] MFA Rules not processed for user `b332bd0f00764c72b95f776a5b96e247`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:10.914971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-affd20db-32b8-4ea3-aa43-511a3e0edb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:11.056500 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1296/2571] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:48:11.068736 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209c0b8-d69d-463f-a5d3-b166adcfaa46 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:11.070584 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-5209c0b8-d69d-463f-a5d3-b166adcfaa46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:11.178336 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:11.190844 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209c0b8-d69d-463f-a5d3-b166adcfaa46 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:11.195153 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4239259-fee3-44af-8a80-0d0d1c0029ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:11.195786 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4239259-fee3-44af-8a80-0d0d1c0029ef service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:11.196066 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4239259-fee3-44af-8a80-0d0d1c0029ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:11.196372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4239259-fee3-44af-8a80-0d0d1c0029ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:11.284520 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4239259-fee3-44af-8a80-0d0d1c0029ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:11.286871 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4239259-fee3-44af-8a80-0d0d1c0029ef service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:11.298608 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1276/2572] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:48:12.139075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd20db-32b8-4ea3-aa43-511a3e0edb27 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:12.141105 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-affd20db-32b8-4ea3-aa43-511a3e0edb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:12.159944 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:12.221755 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd20db-32b8-4ea3-aa43-511a3e0edb27 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:12.225944 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589b05a-5a48-4d37-957a-4b2050e25c82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:12.226584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589b05a-5a48-4d37-957a-4b2050e25c82 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:12.226864 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589b05a-5a48-4d37-957a-4b2050e25c82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:12.227138 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589b05a-5a48-4d37-957a-4b2050e25c82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:12.229351 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c589b05a-5a48-4d37-957a-4b2050e25c82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:12.316167 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589b05a-5a48-4d37-957a-4b2050e25c82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:12.317649 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589b05a-5a48-4d37-957a-4b2050e25c82 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:12.329656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1297/2573] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:48:14.081676 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4239259-fee3-44af-8a80-0d0d1c0029ef service cinder] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:14.084739 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f4239259-fee3-44af-8a80-0d0d1c0029ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:14.111466 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4239259-fee3-44af-8a80-0d0d1c0029ef service cinder] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:14.118301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f73ee-8453-4261-bd39-f941c0fa6cc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:14.119412 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f73ee-8453-4261-bd39-f941c0fa6cc5 service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:14.119941 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f73ee-8453-4261-bd39-f941c0fa6cc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:14.121889 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f73ee-8453-4261-bd39-f941c0fa6cc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:14.139154 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f73ee-8453-4261-bd39-f941c0fa6cc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:14.142055 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f73ee-8453-4261-bd39-f941c0fa6cc5 service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:14.165859 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1277/2574] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:48:16.929081 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589b05a-5a48-4d37-957a-4b2050e25c82 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:16.931554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c589b05a-5a48-4d37-957a-4b2050e25c82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:16.955317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589b05a-5a48-4d37-957a-4b2050e25c82 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:16.964431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae60e6f-74f1-4fd0-86eb-72763d93b798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:16.965576 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae60e6f-74f1-4fd0-86eb-72763d93b798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:16.966084 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae60e6f-74f1-4fd0-86eb-72763d93b798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:16.966600 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae60e6f-74f1-4fd0-86eb-72763d93b798 admin admin] PATH_INFO: `/v3/users/07cf908926af48e8b7d96f96d026254a` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:16.968904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae60e6f-74f1-4fd0-86eb-72763d93b798 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07cf908926af48e8b7d96f96d026254a)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:16.972820 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae60e6f-74f1-4fd0-86eb-72763d93b798 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:17.068137 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3ae60e6f-74f1-4fd0-86eb-72763d93b798 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07cf908926af48e8b7d96f96d026254a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:17.095357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3ae60e6f-74f1-4fd0-86eb-72763d93b798 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07cf908926af48e8b7d96f96d026254a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:17.105410 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3ae60e6f-74f1-4fd0-86eb-72763d93b798 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07cf908926af48e8b7d96f96d026254a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:17.106117 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3ae60e6f-74f1-4fd0-86eb-72763d93b798 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07cf908926af48e8b7d96f96d026254a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:17.106858 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3ae60e6f-74f1-4fd0-86eb-72763d93b798 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07cf908926af48e8b7d96f96d026254a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:17.141900 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1298/2575] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:48:16 2022] DELETE /identity/v3/users/07cf908926af48e8b7d96f96d026254a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:17.955923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f73ee-8453-4261-bd39-f941c0fa6cc5 service cinder] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:17.968857 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f73ee-8453-4261-bd39-f941c0fa6cc5 service cinder] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:18.050796 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c13b60-2d8c-4890-85b9-6838fc0a37cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:18.053194 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c13b60-2d8c-4890-85b9-6838fc0a37cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:18.054486 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c13b60-2d8c-4890-85b9-6838fc0a37cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:18.056885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c13b60-2d8c-4890-85b9-6838fc0a37cb admin admin] PATH_INFO: `/v3/projects/fe968d2a35a94c5f94d0b00097a17b01` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:18.059128 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c13b60-2d8c-4890-85b9-6838fc0a37cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe968d2a35a94c5f94d0b00097a17b01)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:18.062361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c13b60-2d8c-4890-85b9-6838fc0a37cb admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:18.140570 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-62c13b60-2d8c-4890-85b9-6838fc0a37cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe968d2a35a94c5f94d0b00097a17b01', 'request_id': 'req-62c13b60-2d8c-4890-85b9-6838fc0a37cb'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:18.149603 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-62c13b60-2d8c-4890-85b9-6838fc0a37cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe968d2a35a94c5f94d0b00097a17b01', 'request_id': 'req-62c13b60-2d8c-4890-85b9-6838fc0a37cb'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:18.159528 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-62c13b60-2d8c-4890-85b9-6838fc0a37cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe968d2a35a94c5f94d0b00097a17b01', 'request_id': 'req-62c13b60-2d8c-4890-85b9-6838fc0a37cb'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:18.187159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-62c13b60-2d8c-4890-85b9-6838fc0a37cb admin admin] The token cache is being invalidate because project fe968d2a35a94c5f94d0b00097a17b01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:48:18.188439 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-62c13b60-2d8c-4890-85b9-6838fc0a37cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:18.189650 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-62c13b60-2d8c-4890-85b9-6838fc0a37cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:18.192655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1278/2576] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:48:17 2022] DELETE /identity/v3/projects/fe968d2a35a94c5f94d0b00097a17b01 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:18.199093 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027869cf-3ed4-45e8-809f-a569a3b47606 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:18.199637 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027869cf-3ed4-45e8-809f-a569a3b47606 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:18.200138 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027869cf-3ed4-45e8-809f-a569a3b47606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:18.238592 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-027869cf-3ed4-45e8-809f-a569a3b47606 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:18.241078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-027869cf-3ed4-45e8-809f-a569a3b47606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:18.303151 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:18.371670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1299/2577] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:18.385424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df2452-1bc0-4cd2-a9be-6bc2184d4e63 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:18.385864 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df2452-1bc0-4cd2-a9be-6bc2184d4e63 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:18.386250 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df2452-1bc0-4cd2-a9be-6bc2184d4e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:18.411657 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-38df2452-1bc0-4cd2-a9be-6bc2184d4e63 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:18.413080 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-38df2452-1bc0-4cd2-a9be-6bc2184d4e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:18.432578 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1279/2578] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:18.433976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027869cf-3ed4-45e8-809f-a569a3b47606 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:18.450165 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027869cf-3ed4-45e8-809f-a569a3b47606 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:18.459389 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c33bac-c450-448d-a274-267995e6c29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:18.460507 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c33bac-c450-448d-a274-267995e6c29b admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:18.461634 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c33bac-c450-448d-a274-267995e6c29b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:18.461634 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c33bac-c450-448d-a274-267995e6c29b admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:18.462418 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c33bac-c450-448d-a274-267995e6c29b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:48:18.463536 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c33bac-c450-448d-a274-267995e6c29b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:18.466751 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c33bac-c450-448d-a274-267995e6c29b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:18.492460 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1300/2579] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:48:18.495205 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df2452-1bc0-4cd2-a9be-6bc2184d4e63 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:18.508384 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df2452-1bc0-4cd2-a9be-6bc2184d4e63 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:18.516950 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d67af-48e4-4cf7-ba80-c333b7810b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:18.517595 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d67af-48e4-4cf7-ba80-c333b7810b06 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:18.518118 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d67af-48e4-4cf7-ba80-c333b7810b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:18.518393 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d67af-48e4-4cf7-ba80-c333b7810b06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:18.519437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d67af-48e4-4cf7-ba80-c333b7810b06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:18.521128 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d67af-48e4-4cf7-ba80-c333b7810b06 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:18.528315 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:18.560904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1280/2580] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:48:18 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:48:18.565756 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c33bac-c450-448d-a274-267995e6c29b admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:18.585445 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c33bac-c450-448d-a274-267995e6c29b admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:18.720375 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcaf84-ebc7-40c2-956b-b2bb04fa97ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:18.721622 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcaf84-ebc7-40c2-956b-b2bb04fa97ac admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:18.722204 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcaf84-ebc7-40c2-956b-b2bb04fa97ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:18.722785 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcaf84-ebc7-40c2-956b-b2bb04fa97ac admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:18.724557 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcaf84-ebc7-40c2-956b-b2bb04fa97ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:18.731501 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcaf84-ebc7-40c2-956b-b2bb04fa97ac admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:18.788244 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1301/2581] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:48:18 2022] POST /identity/v3/users => generated 290 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:48:18.792227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d67af-48e4-4cf7-ba80-c333b7810b06 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:18.824173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d67af-48e4-4cf7-ba80-c333b7810b06 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:18.836578 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd40b4c-0bfe-4389-ae6b-60dc580c44f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:18.838273 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd40b4c-0bfe-4389-ae6b-60dc580c44f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:18.839045 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd40b4c-0bfe-4389-ae6b-60dc580c44f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:18.840217 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd40b4c-0bfe-4389-ae6b-60dc580c44f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:18.841265 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd40b4c-0bfe-4389-ae6b-60dc580c44f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:18.844433 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd40b4c-0bfe-4389-ae6b-60dc580c44f1 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:18.874461 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1281/2582] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:18.874830 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcaf84-ebc7-40c2-956b-b2bb04fa97ac admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:18.894641 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcaf84-ebc7-40c2-956b-b2bb04fa97ac admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:18.907896 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdec0af-2095-49cc-90ea-9ac433cc5b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:18.908995 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdec0af-2095-49cc-90ea-9ac433cc5b76 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:18.909750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdec0af-2095-49cc-90ea-9ac433cc5b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:18.910215 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdec0af-2095-49cc-90ea-9ac433cc5b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:18.911402 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdec0af-2095-49cc-90ea-9ac433cc5b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:18.918156 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdec0af-2095-49cc-90ea-9ac433cc5b76 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:18.941214 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1302/2583] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:18.946539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd40b4c-0bfe-4389-ae6b-60dc580c44f1 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:18.966207 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd40b4c-0bfe-4389-ae6b-60dc580c44f1 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:18.974993 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59ca39-9f34-41ed-bb8d-11dddfce0249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:18.976397 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59ca39-9f34-41ed-bb8d-11dddfce0249 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:18.976898 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59ca39-9f34-41ed-bb8d-11dddfce0249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:18.977386 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59ca39-9f34-41ed-bb8d-11dddfce0249 admin admin] PATH_INFO: `/v3/projects/2b63bc4a3ea14e05b31eee4e9c743783/users/65f1642f12c24aed8b46946dadf42080/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:19.008497 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59ca39-9f34-41ed-bb8d-11dddfce0249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b63bc4a3ea14e05b31eee4e9c743783, user_id=65f1642f12c24aed8b46946dadf42080, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:19.013820 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59ca39-9f34-41ed-bb8d-11dddfce0249 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:19.051781 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1282/2584] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:18 2022] PUT /identity/v3/projects/2b63bc4a3ea14e05b31eee4e9c743783/users/65f1642f12c24aed8b46946dadf42080/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:19.058607 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcf541-3dee-430c-9b8f-5af8cebf4b08 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:19.060129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcf541-3dee-430c-9b8f-5af8cebf4b08 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:19.060129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcf541-3dee-430c-9b8f-5af8cebf4b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:19.096666 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-ffdcf541-3dee-430c-9b8f-5af8cebf4b08 None None] MFA Rules not processed for user `65f1642f12c24aed8b46946dadf42080`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:19.099229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-ffdcf541-3dee-430c-9b8f-5af8cebf4b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:19.254940 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1303/2585] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:19.263628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59ca39-9f34-41ed-bb8d-11dddfce0249 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:19.378531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59ca39-9f34-41ed-bb8d-11dddfce0249 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:19.390658 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e5c12-22e2-4534-a818-dd2ce1a2d589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:19.391465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e5c12-22e2-4534-a818-dd2ce1a2d589 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:19.392243 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e5c12-22e2-4534-a818-dd2ce1a2d589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:19.392626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e5c12-22e2-4534-a818-dd2ce1a2d589 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:19.394107 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e5c12-22e2-4534-a818-dd2ce1a2d589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:19.398303 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e5c12-22e2-4534-a818-dd2ce1a2d589 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:19.463271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1283/2586] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:48:19 2022] POST /identity/v3/projects => generated 381 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:48:19.468581 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcf541-3dee-430c-9b8f-5af8cebf4b08 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:19.500629 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcf541-3dee-430c-9b8f-5af8cebf4b08 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:19.551300 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:19.591877 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2ef90-23ba-49b1-bb5c-07906eafdc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:19.592915 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2ef90-23ba-49b1-bb5c-07906eafdc99 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:19.593409 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2ef90-23ba-49b1-bb5c-07906eafdc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:19.595338 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2ef90-23ba-49b1-bb5c-07906eafdc99 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:19.599915 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2ef90-23ba-49b1-bb5c-07906eafdc99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:19.601114 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2ef90-23ba-49b1-bb5c-07906eafdc99 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:19.632955 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1304/2587] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:48:19 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:48:19.638862 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e5c12-22e2-4534-a818-dd2ce1a2d589 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:19.654407 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e5c12-22e2-4534-a818-dd2ce1a2d589 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:19.661441 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db83efa-bf11-44dd-957c-9ae89af0ed04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:19.662271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db83efa-bf11-44dd-957c-9ae89af0ed04 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:19.662617 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db83efa-bf11-44dd-957c-9ae89af0ed04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:19.662952 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db83efa-bf11-44dd-957c-9ae89af0ed04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:19.663706 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db83efa-bf11-44dd-957c-9ae89af0ed04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:19.666631 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db83efa-bf11-44dd-957c-9ae89af0ed04 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:19.691369 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1284/2588] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:19.698782 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2ef90-23ba-49b1-bb5c-07906eafdc99 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:19.725678 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2ef90-23ba-49b1-bb5c-07906eafdc99 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:19.734896 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc157fae-6a4d-4fde-a825-f2f9098cb8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:19.736110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc157fae-6a4d-4fde-a825-f2f9098cb8dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:19.736918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc157fae-6a4d-4fde-a825-f2f9098cb8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:19.737448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc157fae-6a4d-4fde-a825-f2f9098cb8dd admin admin] PATH_INFO: `/v3/projects/601ac2916eb149fbbc13bdf6a814c551/users/3e363c6302af43529c8b140d7d23162b/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:19.768669 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc157fae-6a4d-4fde-a825-f2f9098cb8dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=601ac2916eb149fbbc13bdf6a814c551, user_id=3e363c6302af43529c8b140d7d23162b, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:19.772312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc157fae-6a4d-4fde-a825-f2f9098cb8dd admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:19.800764 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1305/2589] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:19 2022] PUT /identity/v3/projects/601ac2916eb149fbbc13bdf6a814c551/users/3e363c6302af43529c8b140d7d23162b/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:19.808595 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db83efa-bf11-44dd-957c-9ae89af0ed04 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:19.829167 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db83efa-bf11-44dd-957c-9ae89af0ed04 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:19.930194 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9af36-7d7d-4276-a57e-79c63c8a8397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:19.931663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9af36-7d7d-4276-a57e-79c63c8a8397 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:19.932375 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9af36-7d7d-4276-a57e-79c63c8a8397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:19.932375 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9af36-7d7d-4276-a57e-79c63c8a8397 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:19.933004 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9af36-7d7d-4276-a57e-79c63c8a8397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:19.934755 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9af36-7d7d-4276-a57e-79c63c8a8397 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:19.947312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1285/2590] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:19.953792 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc157fae-6a4d-4fde-a825-f2f9098cb8dd admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:19.966076 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc157fae-6a4d-4fde-a825-f2f9098cb8dd admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:19.971401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068a4ca-6750-48fe-851e-342ec55901be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:19.972097 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068a4ca-6750-48fe-851e-342ec55901be admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:19.972421 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068a4ca-6750-48fe-851e-342ec55901be admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:19.972703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068a4ca-6750-48fe-851e-342ec55901be admin admin] PATH_INFO: `/v3/projects/601ac2916eb149fbbc13bdf6a814c551/users/3e363c6302af43529c8b140d7d23162b/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:19.974798 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068a4ca-6750-48fe-851e-342ec55901be admin admin] RBAC: Authorizing `identity:create_grant(project_id=601ac2916eb149fbbc13bdf6a814c551, user_id=3e363c6302af43529c8b140d7d23162b, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:19.977632 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068a4ca-6750-48fe-851e-342ec55901be admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:19.991001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1306/2591] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:19 2022] PUT /identity/v3/projects/601ac2916eb149fbbc13bdf6a814c551/users/3e363c6302af43529c8b140d7d23162b/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:48:20.004874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37e297-7115-4667-aaf2-f21f5ee55196 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:20.005501 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37e297-7115-4667-aaf2-f21f5ee55196 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:20.005501 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37e297-7115-4667-aaf2-f21f5ee55196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:20.040893 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-dc37e297-7115-4667-aaf2-f21f5ee55196 None None] MFA Rules not processed for user `3e363c6302af43529c8b140d7d23162b`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:20.042255 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-dc37e297-7115-4667-aaf2-f21f5ee55196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:20.057880 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:20.193672 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1286/2592] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:20 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:20.213056 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068a4ca-6750-48fe-851e-342ec55901be admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:20.215837 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f068a4ca-6750-48fe-851e-342ec55901be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:20.329667 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068a4ca-6750-48fe-851e-342ec55901be admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:20.342557 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906b440-ae2e-4b94-b3a4-59a3662497f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:20.343631 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906b440-ae2e-4b94-b3a4-59a3662497f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:20.344104 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906b440-ae2e-4b94-b3a4-59a3662497f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:20.344625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906b440-ae2e-4b94-b3a4-59a3662497f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:20.370194 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906b440-ae2e-4b94-b3a4-59a3662497f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:20.373082 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906b440-ae2e-4b94-b3a4-59a3662497f9 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:20.389993 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1307/2593] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:20 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:48:20.603673 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37e297-7115-4667-aaf2-f21f5ee55196 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:20.621177 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37e297-7115-4667-aaf2-f21f5ee55196 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:20.629507 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd7e33-aa48-4956-a65c-6cc293857739 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:20.630714 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd7e33-aa48-4956-a65c-6cc293857739 service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:20.631189 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd7e33-aa48-4956-a65c-6cc293857739 service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:20.631637 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd7e33-aa48-4956-a65c-6cc293857739 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:20.729232 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd7e33-aa48-4956-a65c-6cc293857739 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:20.731554 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd7e33-aa48-4956-a65c-6cc293857739 service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:20.749958 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1287/2594] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:48:29.137847 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906b440-ae2e-4b94-b3a4-59a3662497f9 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:29.139316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3906b440-ae2e-4b94-b3a4-59a3662497f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:29.243600 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906b440-ae2e-4b94-b3a4-59a3662497f9 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:29.249759 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de10243-bde6-4351-9486-b44beabd6e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:29.250425 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de10243-bde6-4351-9486-b44beabd6e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:29.250753 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de10243-bde6-4351-9486-b44beabd6e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:29.250991 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de10243-bde6-4351-9486-b44beabd6e0b admin admin] PATH_INFO: `/v3/users/b9f91e1def064d65a1df9f005464c77e` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:29.252305 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de10243-bde6-4351-9486-b44beabd6e0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9f91e1def064d65a1df9f005464c77e)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:29.254837 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de10243-bde6-4351-9486-b44beabd6e0b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:29.300254 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:29.331921 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9de10243-bde6-4351-9486-b44beabd6e0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9f91e1def064d65a1df9f005464c77e'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:29.345134 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9de10243-bde6-4351-9486-b44beabd6e0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9f91e1def064d65a1df9f005464c77e'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:29.354694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9de10243-bde6-4351-9486-b44beabd6e0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9f91e1def064d65a1df9f005464c77e'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:29.355682 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9de10243-bde6-4351-9486-b44beabd6e0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9f91e1def064d65a1df9f005464c77e'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:29.356583 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9de10243-bde6-4351-9486-b44beabd6e0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9f91e1def064d65a1df9f005464c77e'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:29.369797 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd7e33-aa48-4956-a65c-6cc293857739 service cinder] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:29.383499 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd7e33-aa48-4956-a65c-6cc293857739 service cinder] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:29.383732 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1308/2595] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:48:29 2022] DELETE /identity/v3/users/b9f91e1def064d65a1df9f005464c77e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:29.388320 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62693b56-be0c-415c-8645-f57167f3020f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:29.388609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62693b56-be0c-415c-8645-f57167f3020f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:29.388923 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62693b56-be0c-415c-8645-f57167f3020f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:29.412452 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-62693b56-be0c-415c-8645-f57167f3020f None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:29.413764 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-62693b56-be0c-415c-8645-f57167f3020f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:29.463048 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a1116-646d-46db-8e52-de14ea580bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:29.463734 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a1116-646d-46db-8e52-de14ea580bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:29.464133 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a1116-646d-46db-8e52-de14ea580bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:29.464474 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a1116-646d-46db-8e52-de14ea580bce admin admin] PATH_INFO: `/v3/users/65f1642f12c24aed8b46946dadf42080` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:29.465848 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a1116-646d-46db-8e52-de14ea580bce admin admin] RBAC: Authorizing `identity:delete_user(user_id=65f1642f12c24aed8b46946dadf42080)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:29.468022 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a1116-646d-46db-8e52-de14ea580bce admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:29.492664 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1309/2596] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:48:29.507427 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62693b56-be0c-415c-8645-f57167f3020f None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:29.509251 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-62693b56-be0c-415c-8645-f57167f3020f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:29.537710 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b39a1116-646d-46db-8e52-de14ea580bce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65f1642f12c24aed8b46946dadf42080'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:29.539431 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:29.551454 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b39a1116-646d-46db-8e52-de14ea580bce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65f1642f12c24aed8b46946dadf42080'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:29.568380 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b39a1116-646d-46db-8e52-de14ea580bce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65f1642f12c24aed8b46946dadf42080'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:29.570023 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b39a1116-646d-46db-8e52-de14ea580bce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65f1642f12c24aed8b46946dadf42080'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:29.570904 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b39a1116-646d-46db-8e52-de14ea580bce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65f1642f12c24aed8b46946dadf42080'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:29.590367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1288/2597] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:48:29 2022] DELETE /identity/v3/users/65f1642f12c24aed8b46946dadf42080 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:29.592368 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62693b56-be0c-415c-8645-f57167f3020f None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:29.596088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e693d-7f62-41ec-aafb-14a4cc5c2e04 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:29.596417 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e693d-7f62-41ec-aafb-14a4cc5c2e04 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:29.596701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e693d-7f62-41ec-aafb-14a4cc5c2e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:29.618366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-fc4e693d-7f62-41ec-aafb-14a4cc5c2e04 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:29.620013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-fc4e693d-7f62-41ec-aafb-14a4cc5c2e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:29.667206 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bd4cf-3283-453a-b66f-346df54cfebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:29.668236 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bd4cf-3283-453a-b66f-346df54cfebc service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:29.668236 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bd4cf-3283-453a-b66f-346df54cfebc service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:29.668940 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bd4cf-3283-453a-b66f-346df54cfebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:29.674273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-441bd4cf-3283-453a-b66f-346df54cfebc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:29.693718 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1289/2598] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:29.704680 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e693d-7f62-41ec-aafb-14a4cc5c2e04 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:29.706242 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-fc4e693d-7f62-41ec-aafb-14a4cc5c2e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:29.707809 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:29.721470 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e693d-7f62-41ec-aafb-14a4cc5c2e04 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:29.729056 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a245e-427c-4a3c-a99b-af3d2f6ca54d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:29.729714 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a245e-427c-4a3c-a99b-af3d2f6ca54d service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:29.730124 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a245e-427c-4a3c-a99b-af3d2f6ca54d service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:29.730405 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a245e-427c-4a3c-a99b-af3d2f6ca54d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:29.742584 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a245e-427c-4a3c-a99b-af3d2f6ca54d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:29.744099 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a245e-427c-4a3c-a99b-af3d2f6ca54d service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:29.758807 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1290/2599] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:48:29.802553 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441bd4cf-3283-453a-b66f-346df54cfebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:29.806105 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441bd4cf-3283-453a-b66f-346df54cfebc service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:29.825190 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1310/2600] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:48:30.280219 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a245e-427c-4a3c-a99b-af3d2f6ca54d service neutron] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:30.280219 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-e54a245e-427c-4a3c-a99b-af3d2f6ca54d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:30.304723 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a245e-427c-4a3c-a99b-af3d2f6ca54d service neutron] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:30.315464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820b4b1-73a3-4e57-abaa-81e22984dd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:30.317576 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820b4b1-73a3-4e57-abaa-81e22984dd63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:30.319475 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820b4b1-73a3-4e57-abaa-81e22984dd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:30.319999 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820b4b1-73a3-4e57-abaa-81e22984dd63 admin admin] PATH_INFO: `/v3/projects/268720f181b746ccb661b974e023c557` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:30.321671 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7820b4b1-73a3-4e57-abaa-81e22984dd63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=268720f181b746ccb661b974e023c557)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:30.324352 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7820b4b1-73a3-4e57-abaa-81e22984dd63 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:30.392004 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bd4cf-3283-453a-b66f-346df54cfebc service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:30.394991 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-441bd4cf-3283-453a-b66f-346df54cfebc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:30.416383 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-7820b4b1-73a3-4e57-abaa-81e22984dd63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '268720f181b746ccb661b974e023c557', 'request_id': 'req-7820b4b1-73a3-4e57-abaa-81e22984dd63'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:30.421892 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bd4cf-3283-453a-b66f-346df54cfebc service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:30.424780 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-7820b4b1-73a3-4e57-abaa-81e22984dd63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '268720f181b746ccb661b974e023c557', 'request_id': 'req-7820b4b1-73a3-4e57-abaa-81e22984dd63'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:30.437909 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-7820b4b1-73a3-4e57-abaa-81e22984dd63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '268720f181b746ccb661b974e023c557', 'request_id': 'req-7820b4b1-73a3-4e57-abaa-81e22984dd63'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:30.462545 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-7820b4b1-73a3-4e57-abaa-81e22984dd63 admin admin] The token cache is being invalidate because project 268720f181b746ccb661b974e023c557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:48:30.463003 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-7820b4b1-73a3-4e57-abaa-81e22984dd63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:30.464032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-7820b4b1-73a3-4e57-abaa-81e22984dd63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:30.470807 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1291/2601] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:48:30 2022] DELETE /identity/v3/projects/268720f181b746ccb661b974e023c557 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:30.472758 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e19707-0c46-40d6-b5de-fa17df470e6b None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:30.473179 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e19707-0c46-40d6-b5de-fa17df470e6b None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:30.473619 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e19707-0c46-40d6-b5de-fa17df470e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:30.509760 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-25e19707-0c46-40d6-b5de-fa17df470e6b None None] MFA Rules not processed for user `69b79740961d4100a287f62093ccae9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:30.512050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-25e19707-0c46-40d6-b5de-fa17df470e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:30.517501 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf29f64-b91a-40e2-bc51-a3eeb75ed296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:30.518209 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf29f64-b91a-40e2-bc51-a3eeb75ed296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:30.518618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf29f64-b91a-40e2-bc51-a3eeb75ed296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:30.519420 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf29f64-b91a-40e2-bc51-a3eeb75ed296 admin admin] PATH_INFO: `/v3/projects/2b63bc4a3ea14e05b31eee4e9c743783` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:30.521656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf29f64-b91a-40e2-bc51-a3eeb75ed296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b63bc4a3ea14e05b31eee4e9c743783)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:30.524290 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf29f64-b91a-40e2-bc51-a3eeb75ed296 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:30.553301 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:30.585408 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3cf29f64-b91a-40e2-bc51-a3eeb75ed296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b63bc4a3ea14e05b31eee4e9c743783', 'request_id': 'req-3cf29f64-b91a-40e2-bc51-a3eeb75ed296'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:30.593786 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3cf29f64-b91a-40e2-bc51-a3eeb75ed296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b63bc4a3ea14e05b31eee4e9c743783', 'request_id': 'req-3cf29f64-b91a-40e2-bc51-a3eeb75ed296'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:30.598442 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1292/2602] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:30.599338 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e19707-0c46-40d6-b5de-fa17df470e6b None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:30.601717 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-25e19707-0c46-40d6-b5de-fa17df470e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:30.602231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3cf29f64-b91a-40e2-bc51-a3eeb75ed296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b63bc4a3ea14e05b31eee4e9c743783', 'request_id': 'req-3cf29f64-b91a-40e2-bc51-a3eeb75ed296'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:30.619752 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e19707-0c46-40d6-b5de-fa17df470e6b None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:30.625542 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3cf29f64-b91a-40e2-bc51-a3eeb75ed296 admin admin] The token cache is being invalidate because project 2b63bc4a3ea14e05b31eee4e9c743783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:48:30.625891 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3cf29f64-b91a-40e2-bc51-a3eeb75ed296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:30.627930 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3cf29f64-b91a-40e2-bc51-a3eeb75ed296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:30.630758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1311/2603] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:48:30 2022] DELETE /identity/v3/projects/2b63bc4a3ea14e05b31eee4e9c743783 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:30.635638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf29f64-b91a-40e2-bc51-a3eeb75ed296 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:30.638927 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3cf29f64-b91a-40e2-bc51-a3eeb75ed296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:30.717697 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:30.730910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86527a5-0f7c-43c6-814b-2db5e378f47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:30.733921 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86527a5-0f7c-43c6-814b-2db5e378f47d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:30.734526 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86527a5-0f7c-43c6-814b-2db5e378f47d admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:30.735035 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86527a5-0f7c-43c6-814b-2db5e378f47d admin admin] PATH_INFO: `/v3/users/b332bd0f00764c72b95f776a5b96e247` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:30.737572 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86527a5-0f7c-43c6-814b-2db5e378f47d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b332bd0f00764c72b95f776a5b96e247)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:30.742408 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86527a5-0f7c-43c6-814b-2db5e378f47d admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:30.746395 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf29f64-b91a-40e2-bc51-a3eeb75ed296 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:30.752159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edee778-f56b-4de6-af1a-f955ad07c4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:30.752860 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edee778-f56b-4de6-af1a-f955ad07c4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:30.753146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edee778-f56b-4de6-af1a-f955ad07c4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:30.753443 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edee778-f56b-4de6-af1a-f955ad07c4ec admin admin] PATH_INFO: `/v3/users/3e363c6302af43529c8b140d7d23162b` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:30.754747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edee778-f56b-4de6-af1a-f955ad07c4ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e363c6302af43529c8b140d7d23162b)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:30.756843 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edee778-f56b-4de6-af1a-f955ad07c4ec admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:30.822014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9edee778-f56b-4de6-af1a-f955ad07c4ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e363c6302af43529c8b140d7d23162b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:30.822766 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b86527a5-0f7c-43c6-814b-2db5e378f47d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b332bd0f00764c72b95f776a5b96e247'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:30.831569 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9edee778-f56b-4de6-af1a-f955ad07c4ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e363c6302af43529c8b140d7d23162b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:30.833980 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b86527a5-0f7c-43c6-814b-2db5e378f47d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b332bd0f00764c72b95f776a5b96e247'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:30.844172 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9edee778-f56b-4de6-af1a-f955ad07c4ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e363c6302af43529c8b140d7d23162b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:30.845183 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9edee778-f56b-4de6-af1a-f955ad07c4ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e363c6302af43529c8b140d7d23162b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:30.846087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-9edee778-f56b-4de6-af1a-f955ad07c4ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e363c6302af43529c8b140d7d23162b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:30.855507 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b86527a5-0f7c-43c6-814b-2db5e378f47d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b332bd0f00764c72b95f776a5b96e247'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:30.857239 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b86527a5-0f7c-43c6-814b-2db5e378f47d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b332bd0f00764c72b95f776a5b96e247'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:30.858846 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-b86527a5-0f7c-43c6-814b-2db5e378f47d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b332bd0f00764c72b95f776a5b96e247'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:30.870822 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1312/2604] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:48:30 2022] DELETE /identity/v3/users/3e363c6302af43529c8b140d7d23162b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:48:30.884718 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1293/2605] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:48:30 2022] DELETE /identity/v3/users/b332bd0f00764c72b95f776a5b96e247 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:31.562259 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edee778-f56b-4de6-af1a-f955ad07c4ec admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:31.575242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-9edee778-f56b-4de6-af1a-f955ad07c4ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:31.588134 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86527a5-0f7c-43c6-814b-2db5e378f47d admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:31.592725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-b86527a5-0f7c-43c6-814b-2db5e378f47d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:31.716303 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86527a5-0f7c-43c6-814b-2db5e378f47d admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:31.723888 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ab66e-1ab9-436a-9244-c015aa6cd83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:31.724618 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ab66e-1ab9-436a-9244-c015aa6cd83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:31.725447 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ab66e-1ab9-436a-9244-c015aa6cd83c admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:31.725725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ab66e-1ab9-436a-9244-c015aa6cd83c admin admin] PATH_INFO: `/v3/projects/fa79b0af32024610b34ba022fe56730e` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:31.726982 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ab66e-1ab9-436a-9244-c015aa6cd83c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa79b0af32024610b34ba022fe56730e)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:31.729264 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ab66e-1ab9-436a-9244-c015aa6cd83c admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:31.731280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:31.753883 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edee778-f56b-4de6-af1a-f955ad07c4ec admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:31.760888 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8878ef-1228-412a-bc80-01d10a8eff0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:31.761578 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8878ef-1228-412a-bc80-01d10a8eff0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:31.761892 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8878ef-1228-412a-bc80-01d10a8eff0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:31.762176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8878ef-1228-412a-bc80-01d10a8eff0b admin admin] PATH_INFO: `/v3/projects/601ac2916eb149fbbc13bdf6a814c551` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:31.763809 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8878ef-1228-412a-bc80-01d10a8eff0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=601ac2916eb149fbbc13bdf6a814c551)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:31.766625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8878ef-1228-412a-bc80-01d10a8eff0b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:31.805223 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-301ab66e-1ab9-436a-9244-c015aa6cd83c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa79b0af32024610b34ba022fe56730e', 'request_id': 'req-301ab66e-1ab9-436a-9244-c015aa6cd83c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:31.812910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-301ab66e-1ab9-436a-9244-c015aa6cd83c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa79b0af32024610b34ba022fe56730e', 'request_id': 'req-301ab66e-1ab9-436a-9244-c015aa6cd83c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:31.829920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-301ab66e-1ab9-436a-9244-c015aa6cd83c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa79b0af32024610b34ba022fe56730e', 'request_id': 'req-301ab66e-1ab9-436a-9244-c015aa6cd83c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:31.853005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-301ab66e-1ab9-436a-9244-c015aa6cd83c admin admin] The token cache is being invalidate because project fa79b0af32024610b34ba022fe56730e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:48:31.853310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-301ab66e-1ab9-436a-9244-c015aa6cd83c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:31.854867 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-301ab66e-1ab9-436a-9244-c015aa6cd83c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:31.855100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8c8878ef-1228-412a-bc80-01d10a8eff0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '601ac2916eb149fbbc13bdf6a814c551', 'request_id': 'req-8c8878ef-1228-412a-bc80-01d10a8eff0b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:31.856230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1294/2606] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:48:31 2022] DELETE /identity/v3/projects/fa79b0af32024610b34ba022fe56730e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:31.866941 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac46d0b-4e45-4386-abc1-a081aca4037e None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:31.867573 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac46d0b-4e45-4386-abc1-a081aca4037e None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:31.867889 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac46d0b-4e45-4386-abc1-a081aca4037e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:31.868367 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8c8878ef-1228-412a-bc80-01d10a8eff0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '601ac2916eb149fbbc13bdf6a814c551', 'request_id': 'req-8c8878ef-1228-412a-bc80-01d10a8eff0b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:31.877053 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8c8878ef-1228-412a-bc80-01d10a8eff0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '601ac2916eb149fbbc13bdf6a814c551', 'request_id': 'req-8c8878ef-1228-412a-bc80-01d10a8eff0b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:31.879540 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:31.899241 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8c8878ef-1228-412a-bc80-01d10a8eff0b admin admin] The token cache is being invalidate because project 601ac2916eb149fbbc13bdf6a814c551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:48:31.899638 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-0ac46d0b-4e45-4386-abc1-a081aca4037e None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:31.899869 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8c8878ef-1228-412a-bc80-01d10a8eff0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:31.900557 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-8c8878ef-1228-412a-bc80-01d10a8eff0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:31.901709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-0ac46d0b-4e45-4386-abc1-a081aca4037e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:31.905518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1313/2607] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:48:31 2022] DELETE /identity/v3/projects/601ac2916eb149fbbc13bdf6a814c551 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:31.911167 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7d3e3-84d2-4a30-9e13-fe5800a7ce47 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:31.911511 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7d3e3-84d2-4a30-9e13-fe5800a7ce47 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:31.911704 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7d3e3-84d2-4a30-9e13-fe5800a7ce47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:31.937317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-42a7d3e3-84d2-4a30-9e13-fe5800a7ce47 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:31.938648 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-42a7d3e3-84d2-4a30-9e13-fe5800a7ce47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:32.016709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1295/2608] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:32.020607 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591c783-201d-4bac-b6d5-73ed74aab18f None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:32.021209 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591c783-201d-4bac-b6d5-73ed74aab18f None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:32.022317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591c783-201d-4bac-b6d5-73ed74aab18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:32.024363 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1314/2609] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:48:32.032856 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c22f1-d31a-4d43-acc7-1fc52d496c37 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:32.033118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c22f1-d31a-4d43-acc7-1fc52d496c37 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:32.034024 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c22f1-d31a-4d43-acc7-1fc52d496c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:32.059389 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-c44c22f1-d31a-4d43-acc7-1fc52d496c37 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:32.060752 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c44c22f1-d31a-4d43-acc7-1fc52d496c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:32.061632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-5591c783-201d-4bac-b6d5-73ed74aab18f None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:32.063789 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-5591c783-201d-4bac-b6d5-73ed74aab18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:32.069540 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1315/2610] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:48:32.073889 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c22f1-d31a-4d43-acc7-1fc52d496c37 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:32.078385 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1296/2611] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:32.083270 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591c783-201d-4bac-b6d5-73ed74aab18f None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:32.085391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c22f1-d31a-4d43-acc7-1fc52d496c37 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:32.090893 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e96e27-07b7-4aeb-9c9d-075ac40c8758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:32.091341 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e96e27-07b7-4aeb-9c9d-075ac40c8758 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:32.092779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e96e27-07b7-4aeb-9c9d-075ac40c8758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:32.092779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e96e27-07b7-4aeb-9c9d-075ac40c8758 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:32.093403 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e96e27-07b7-4aeb-9c9d-075ac40c8758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:48:32.093763 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e96e27-07b7-4aeb-9c9d-075ac40c8758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:32.095858 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e96e27-07b7-4aeb-9c9d-075ac40c8758 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:32.103267 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591c783-201d-4bac-b6d5-73ed74aab18f None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:32.115476 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1316/2612] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:48:32.115763 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82086c06-e449-44a0-9e09-bb844a3fe7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:32.115763 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82086c06-e449-44a0-9e09-bb844a3fe7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:32.115763 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82086c06-e449-44a0-9e09-bb844a3fe7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:32.115763 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82086c06-e449-44a0-9e09-bb844a3fe7a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:32.116495 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82086c06-e449-44a0-9e09-bb844a3fe7a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:48:32.116495 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82086c06-e449-44a0-9e09-bb844a3fe7a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:32.116917 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e96e27-07b7-4aeb-9c9d-075ac40c8758 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:32.119611 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82086c06-e449-44a0-9e09-bb844a3fe7a0 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:32.129388 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e96e27-07b7-4aeb-9c9d-075ac40c8758 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:32.136517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0ed65-43cc-4c4f-b16c-8e1ae8e83791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:32.137230 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0ed65-43cc-4c4f-b16c-8e1ae8e83791 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:32.137645 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0ed65-43cc-4c4f-b16c-8e1ae8e83791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:32.137920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0ed65-43cc-4c4f-b16c-8e1ae8e83791 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:32.147848 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0ed65-43cc-4c4f-b16c-8e1ae8e83791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:32.147848 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0ed65-43cc-4c4f-b16c-8e1ae8e83791 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:32.148461 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1297/2613] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:48:32.149948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82086c06-e449-44a0-9e09-bb844a3fe7a0 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:32.166485 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82086c06-e449-44a0-9e09-bb844a3fe7a0 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:32.182959 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941f95f-c859-4183-b4b7-458b4796b3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:32.184013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941f95f-c859-4183-b4b7-458b4796b3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:32.184868 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941f95f-c859-4183-b4b7-458b4796b3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:32.185361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941f95f-c859-4183-b4b7-458b4796b3f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:32.186744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941f95f-c859-4183-b4b7-458b4796b3f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:32.190545 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941f95f-c859-4183-b4b7-458b4796b3f1 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:32.191466 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1317/2614] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:48:32 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:48:32.198521 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0ed65-43cc-4c4f-b16c-8e1ae8e83791 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:32.241334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1298/2615] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:48:32 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:48:32.245944 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941f95f-c859-4183-b4b7-458b4796b3f1 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:32.309478 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0ed65-43cc-4c4f-b16c-8e1ae8e83791 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:32.325834 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:32.362277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941f95f-c859-4183-b4b7-458b4796b3f1 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:32.372132 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b4897-a823-457b-a95f-61c6b97595bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:32.373229 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b4897-a823-457b-a95f-61c6b97595bc admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:32.373723 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b4897-a823-457b-a95f-61c6b97595bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:32.374215 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b4897-a823-457b-a95f-61c6b97595bc admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:32.375491 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b4897-a823-457b-a95f-61c6b97595bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:32.379759 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b4897-a823-457b-a95f-61c6b97595bc admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:32.387232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:32.398055 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626825fb-5ae6-4bcd-80a9-3e068a4a1681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:32.400952 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626825fb-5ae6-4bcd-80a9-3e068a4a1681 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:32.401215 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626825fb-5ae6-4bcd-80a9-3e068a4a1681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:32.401482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626825fb-5ae6-4bcd-80a9-3e068a4a1681 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:32.402495 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626825fb-5ae6-4bcd-80a9-3e068a4a1681 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:32.405448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626825fb-5ae6-4bcd-80a9-3e068a4a1681 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:32.424339 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1299/2616] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:48:32 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:48:32.426191 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b4897-a823-457b-a95f-61c6b97595bc admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:32.440412 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b4897-a823-457b-a95f-61c6b97595bc admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:32.445625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1318/2617] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:48:32 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:48:32.450653 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626825fb-5ae6-4bcd-80a9-3e068a4a1681 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:32.451252 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c250e6-f6da-4dfc-8b38-e308a5aded7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:32.452497 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c250e6-f6da-4dfc-8b38-e308a5aded7b admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:32.452954 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c250e6-f6da-4dfc-8b38-e308a5aded7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:32.453477 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c250e6-f6da-4dfc-8b38-e308a5aded7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:32.454817 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c250e6-f6da-4dfc-8b38-e308a5aded7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:32.458217 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c250e6-f6da-4dfc-8b38-e308a5aded7b admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:32.464235 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626825fb-5ae6-4bcd-80a9-3e068a4a1681 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:32.471053 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d6780-ab75-4a6f-b8f8-0896ae2f31da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:32.471864 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d6780-ab75-4a6f-b8f8-0896ae2f31da admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:32.472347 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d6780-ab75-4a6f-b8f8-0896ae2f31da admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:32.472776 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d6780-ab75-4a6f-b8f8-0896ae2f31da admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:32.473639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d6780-ab75-4a6f-b8f8-0896ae2f31da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:32.476676 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d6780-ab75-4a6f-b8f8-0896ae2f31da admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:32.484509 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1300/2618] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:48:32.487670 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c250e6-f6da-4dfc-8b38-e308a5aded7b admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:32.499853 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1319/2619] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:32.502226 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c250e6-f6da-4dfc-8b38-e308a5aded7b admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:32.506276 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d6780-ab75-4a6f-b8f8-0896ae2f31da admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:32.516214 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c574d6c-e16d-4c4e-b227-3f174d9d6e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:32.516878 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c574d6c-e16d-4c4e-b227-3f174d9d6e9c admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:32.517166 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c574d6c-e16d-4c4e-b227-3f174d9d6e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:32.517444 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c574d6c-e16d-4c4e-b227-3f174d9d6e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:32.518221 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c574d6c-e16d-4c4e-b227-3f174d9d6e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:32.519828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c574d6c-e16d-4c4e-b227-3f174d9d6e9c admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:32.529504 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d6780-ab75-4a6f-b8f8-0896ae2f31da admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:32.534023 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1301/2620] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:32.537774 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781daa4-a4b5-4d89-a12a-ba997e08da60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:32.538628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781daa4-a4b5-4d89-a12a-ba997e08da60 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:32.539047 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781daa4-a4b5-4d89-a12a-ba997e08da60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:32.539239 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c574d6c-e16d-4c4e-b227-3f174d9d6e9c admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:32.539613 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781daa4-a4b5-4d89-a12a-ba997e08da60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:32.540760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781daa4-a4b5-4d89-a12a-ba997e08da60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:32.543553 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781daa4-a4b5-4d89-a12a-ba997e08da60 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:32.553703 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c574d6c-e16d-4c4e-b227-3f174d9d6e9c admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:32.559877 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b09e3-18f2-431e-a403-f537774f8932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:32.560682 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b09e3-18f2-431e-a403-f537774f8932 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:32.564987 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1320/2621] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:32.565574 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b09e3-18f2-431e-a403-f537774f8932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:32.565574 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b09e3-18f2-431e-a403-f537774f8932 admin admin] PATH_INFO: `/v3/projects/b7079d74cb5b426a851f1d1a734d85cc/users/4e8a0f8c5517414682f62c3816013d7c/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:32.566859 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781daa4-a4b5-4d89-a12a-ba997e08da60 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:32.583104 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781daa4-a4b5-4d89-a12a-ba997e08da60 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:32.590226 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0525a93-4f77-42fa-b7f8-801c57123963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:32.591266 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0525a93-4f77-42fa-b7f8-801c57123963 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:32.591641 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0525a93-4f77-42fa-b7f8-801c57123963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:32.591956 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0525a93-4f77-42fa-b7f8-801c57123963 admin admin] PATH_INFO: `/v3/projects/7753d0f2ae8b4477b1c4b73a21c3b665/users/88f300e83772494bb20857ad00b2259d/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:32.593566 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b09e3-18f2-431e-a403-f537774f8932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7079d74cb5b426a851f1d1a734d85cc, user_id=4e8a0f8c5517414682f62c3816013d7c, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:32.600938 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b09e3-18f2-431e-a403-f537774f8932 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:32.620698 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0525a93-4f77-42fa-b7f8-801c57123963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7753d0f2ae8b4477b1c4b73a21c3b665, user_id=88f300e83772494bb20857ad00b2259d, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:32.625672 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0525a93-4f77-42fa-b7f8-801c57123963 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:32.628373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1302/2622] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:32 2022] PUT /identity/v3/projects/b7079d74cb5b426a851f1d1a734d85cc/users/4e8a0f8c5517414682f62c3816013d7c/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:48:32.649330 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c264c91-2cc2-479b-9e01-c29ca7e72f16 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:32.650303 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c264c91-2cc2-479b-9e01-c29ca7e72f16 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:32.651485 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c264c91-2cc2-479b-9e01-c29ca7e72f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:32.652578 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1321/2623] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:32 2022] PUT /identity/v3/projects/7753d0f2ae8b4477b1c4b73a21c3b665/users/88f300e83772494bb20857ad00b2259d/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:48:32.666578 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51237de2-a1e0-4b67-9f9d-e3130b110575 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:32.667209 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51237de2-a1e0-4b67-9f9d-e3130b110575 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:32.667685 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51237de2-a1e0-4b67-9f9d-e3130b110575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:32.702372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-1c264c91-2cc2-479b-9e01-c29ca7e72f16 None None] MFA Rules not processed for user `4e8a0f8c5517414682f62c3816013d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:32.710839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-1c264c91-2cc2-479b-9e01-c29ca7e72f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:32.717927 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-51237de2-a1e0-4b67-9f9d-e3130b110575 None None] MFA Rules not processed for user `88f300e83772494bb20857ad00b2259d`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:32.720834 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-51237de2-a1e0-4b67-9f9d-e3130b110575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:32.836238 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1322/2624] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:32.840259 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51237de2-a1e0-4b67-9f9d-e3130b110575 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:32.851307 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1303/2625] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:32.856605 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c264c91-2cc2-479b-9e01-c29ca7e72f16 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:32.968868 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c264c91-2cc2-479b-9e01-c29ca7e72f16 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:32.976224 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d1760-7a40-4918-bcd2-7c8b3953a2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:32.977011 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51237de2-a1e0-4b67-9f9d-e3130b110575 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:32.977744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d1760-7a40-4918-bcd2-7c8b3953a2ce admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:32.978193 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d1760-7a40-4918-bcd2-7c8b3953a2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:32.978730 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d1760-7a40-4918-bcd2-7c8b3953a2ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:32.979639 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d1760-7a40-4918-bcd2-7c8b3953a2ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:32.982144 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d1760-7a40-4918-bcd2-7c8b3953a2ce admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:32.987414 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09177a24-ca92-4502-b78c-bbadda1c4158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:32.988960 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09177a24-ca92-4502-b78c-bbadda1c4158 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:32.989694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09177a24-ca92-4502-b78c-bbadda1c4158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:32.991075 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09177a24-ca92-4502-b78c-bbadda1c4158 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:32.992444 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09177a24-ca92-4502-b78c-bbadda1c4158 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:32.996630 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09177a24-ca92-4502-b78c-bbadda1c4158 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:33.029303 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1304/2626] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:48:32 2022] POST /identity/v3/projects => generated 375 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:48:33.037803 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d1760-7a40-4918-bcd2-7c8b3953a2ce admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:33.045214 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1323/2627] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:48:32 2022] POST /identity/v3/projects => generated 387 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:48:33.050951 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09177a24-ca92-4502-b78c-bbadda1c4158 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:33.059832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:33.105266 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:33.175326 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d1760-7a40-4918-bcd2-7c8b3953a2ce admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:33.183612 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09177a24-ca92-4502-b78c-bbadda1c4158 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:33.192707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d177e9-1b49-4e2c-a822-7b3a0c8ec430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:33.194107 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d177e9-1b49-4e2c-a822-7b3a0c8ec430 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:33.194405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d177e9-1b49-4e2c-a822-7b3a0c8ec430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:33.194687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d177e9-1b49-4e2c-a822-7b3a0c8ec430 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:33.195360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d177e9-1b49-4e2c-a822-7b3a0c8ec430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:33.199213 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d177e9-1b49-4e2c-a822-7b3a0c8ec430 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:33.241175 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1324/2628] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:48:33 2022] POST /identity/v3/users => generated 300 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:48:33.244318 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d177e9-1b49-4e2c-a822-7b3a0c8ec430 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:33.260300 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d177e9-1b49-4e2c-a822-7b3a0c8ec430 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:33.266861 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544b835-cba0-415a-a429-e77208335c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:33.268100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544b835-cba0-415a-a429-e77208335c57 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:33.268616 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544b835-cba0-415a-a429-e77208335c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:33.269276 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544b835-cba0-415a-a429-e77208335c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:33.270412 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9544b835-cba0-415a-a429-e77208335c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:33.272457 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9544b835-cba0-415a-a429-e77208335c57 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:33.280394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd3ecc-d303-4352-a343-af328609bd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:33.281806 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd3ecc-d303-4352-a343-af328609bd22 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:33.282346 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd3ecc-d303-4352-a343-af328609bd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:33.282898 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd3ecc-d303-4352-a343-af328609bd22 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:33.284208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd3ecc-d303-4352-a343-af328609bd22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:33.288225 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1325/2629] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:33.288729 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd3ecc-d303-4352-a343-af328609bd22 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:33.293038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544b835-cba0-415a-a429-e77208335c57 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:33.304438 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544b835-cba0-415a-a429-e77208335c57 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:33.310686 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aac938-6c96-4c74-a6f8-39779531e0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:33.312157 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aac938-6c96-4c74-a6f8-39779531e0ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:33.312641 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aac938-6c96-4c74-a6f8-39779531e0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:33.312919 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aac938-6c96-4c74-a6f8-39779531e0ca admin admin] PATH_INFO: `/v3/projects/5cbca187def6484c83c6e11e5265f073/users/8e58054ba345461abf8ca0549ad0dc9a/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:33.326529 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1305/2630] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:48:33 2022] POST /identity/v3/users => generated 294 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:48:33.330825 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd3ecc-d303-4352-a343-af328609bd22 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:33.337516 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aac938-6c96-4c74-a6f8-39779531e0ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cbca187def6484c83c6e11e5265f073, user_id=8e58054ba345461abf8ca0549ad0dc9a, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:33.341331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aac938-6c96-4c74-a6f8-39779531e0ca admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:33.345495 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd3ecc-d303-4352-a343-af328609bd22 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:33.352447 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060c348-c138-4daa-8a41-1955188a5cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:33.353313 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060c348-c138-4daa-8a41-1955188a5cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:33.353705 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060c348-c138-4daa-8a41-1955188a5cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:33.354130 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060c348-c138-4daa-8a41-1955188a5cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:33.355123 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060c348-c138-4daa-8a41-1955188a5cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:33.357238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060c348-c138-4daa-8a41-1955188a5cc1 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:33.359479 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1326/2631] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:33 2022] PUT /identity/v3/projects/5cbca187def6484c83c6e11e5265f073/users/8e58054ba345461abf8ca0549ad0dc9a/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:48:33.364780 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aac938-6c96-4c74-a6f8-39779531e0ca admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:33.379856 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1306/2632] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:48:33.387022 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060c348-c138-4daa-8a41-1955188a5cc1 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:33.408815 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060c348-c138-4daa-8a41-1955188a5cc1 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:33.483562 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aac938-6c96-4c74-a6f8-39779531e0ca admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:33.491394 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea36273-4c16-4705-bff9-1e765ff27bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:33.492439 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea36273-4c16-4705-bff9-1e765ff27bee admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:33.492755 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea36273-4c16-4705-bff9-1e765ff27bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:33.493030 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea36273-4c16-4705-bff9-1e765ff27bee admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:33.494232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea36273-4c16-4705-bff9-1e765ff27bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:33.495349 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea36273-4c16-4705-bff9-1e765ff27bee admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:33.513466 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1327/2633] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:33.518873 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea36273-4c16-4705-bff9-1e765ff27bee admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:33.535310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbb4c5-2afb-49a5-b4bd-5e57b739e750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:33.536432 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbb4c5-2afb-49a5-b4bd-5e57b739e750 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:33.537674 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbb4c5-2afb-49a5-b4bd-5e57b739e750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:33.538175 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbb4c5-2afb-49a5-b4bd-5e57b739e750 admin admin] PATH_INFO: `/v3/projects/6e5119ae77e0466b93bf3ce1aae77056/users/2b02a5cc57bc4f4d80756ad62e7d9f94/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:33.540883 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea36273-4c16-4705-bff9-1e765ff27bee admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:33.548011 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e35fc6-a987-4e3e-80c6-6b1832b93446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:33.548755 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e35fc6-a987-4e3e-80c6-6b1832b93446 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:33.549032 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e35fc6-a987-4e3e-80c6-6b1832b93446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:33.549312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e35fc6-a987-4e3e-80c6-6b1832b93446 admin admin] PATH_INFO: `/v3/projects/5cbca187def6484c83c6e11e5265f073/users/8e58054ba345461abf8ca0549ad0dc9a/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:33.552627 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e35fc6-a987-4e3e-80c6-6b1832b93446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cbca187def6484c83c6e11e5265f073, user_id=8e58054ba345461abf8ca0549ad0dc9a, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:33.555771 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e35fc6-a987-4e3e-80c6-6b1832b93446 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:33.569410 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1328/2634] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:33 2022] PUT /identity/v3/projects/5cbca187def6484c83c6e11e5265f073/users/8e58054ba345461abf8ca0549ad0dc9a/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:48:33.572555 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cbb4c5-2afb-49a5-b4bd-5e57b739e750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5119ae77e0466b93bf3ce1aae77056, user_id=2b02a5cc57bc4f4d80756ad62e7d9f94, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:33.577583 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cbb4c5-2afb-49a5-b4bd-5e57b739e750 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:33.582062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551afe35-b8aa-4137-a680-8533a82320eb None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:33.582343 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551afe35-b8aa-4137-a680-8533a82320eb None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:33.582619 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551afe35-b8aa-4137-a680-8533a82320eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:33.601473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1307/2635] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:33 2022] PUT /identity/v3/projects/6e5119ae77e0466b93bf3ce1aae77056/users/2b02a5cc57bc4f4d80756ad62e7d9f94/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:33.607521 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbb4c5-2afb-49a5-b4bd-5e57b739e750 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:33.620096 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-551afe35-b8aa-4137-a680-8533a82320eb None None] MFA Rules not processed for user `8e58054ba345461abf8ca0549ad0dc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:33.621397 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-551afe35-b8aa-4137-a680-8533a82320eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:33.635600 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:33.677197 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:33.727091 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbb4c5-2afb-49a5-b4bd-5e57b739e750 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:33.747001 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791cccb-bed7-43c3-8182-33b9da832565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:33.748110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791cccb-bed7-43c3-8182-33b9da832565 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:33.748662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791cccb-bed7-43c3-8182-33b9da832565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:33.749179 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791cccb-bed7-43c3-8182-33b9da832565 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:33.750448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791cccb-bed7-43c3-8182-33b9da832565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:33.757451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1329/2636] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:33 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:48:33.760509 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791cccb-bed7-43c3-8182-33b9da832565 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:33.778514 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551afe35-b8aa-4137-a680-8533a82320eb None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:33.781026 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-551afe35-b8aa-4137-a680-8533a82320eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:33.790275 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1308/2637] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:33.796338 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791cccb-bed7-43c3-8182-33b9da832565 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:33.820255 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791cccb-bed7-43c3-8182-33b9da832565 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:33.832037 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c504c9e-e8f2-4ba5-a5a0-2d656decc5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:33.833220 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c504c9e-e8f2-4ba5-a5a0-2d656decc5d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:33.835120 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c504c9e-e8f2-4ba5-a5a0-2d656decc5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:33.835612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c504c9e-e8f2-4ba5-a5a0-2d656decc5d0 admin admin] PATH_INFO: `/v3/projects/6e5119ae77e0466b93bf3ce1aae77056/users/2b02a5cc57bc4f4d80756ad62e7d9f94/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:33.840643 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c504c9e-e8f2-4ba5-a5a0-2d656decc5d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5119ae77e0466b93bf3ce1aae77056, user_id=2b02a5cc57bc4f4d80756ad62e7d9f94, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:33.847415 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c504c9e-e8f2-4ba5-a5a0-2d656decc5d0 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:33.871788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1309/2638] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:33 2022] PUT /identity/v3/projects/6e5119ae77e0466b93bf3ce1aae77056/users/2b02a5cc57bc4f4d80756ad62e7d9f94/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:33.887516 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45c85a-5f20-4b93-a6b2-4545607e38d4 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:33.889086 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45c85a-5f20-4b93-a6b2-4545607e38d4 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:33.897594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45c85a-5f20-4b93-a6b2-4545607e38d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:33.932110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551afe35-b8aa-4137-a680-8533a82320eb None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:33.958192 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-7c45c85a-5f20-4b93-a6b2-4545607e38d4 None None] MFA Rules not processed for user `2b02a5cc57bc4f4d80756ad62e7d9f94`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:33.961318 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-7c45c85a-5f20-4b93-a6b2-4545607e38d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:34.021107 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9cc3be-06cc-45fe-8526-cf20a4cf556a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:34.022557 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cc3be-06cc-45fe-8526-cf20a4cf556a service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:34.023007 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cc3be-06cc-45fe-8526-cf20a4cf556a service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:34.023457 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cc3be-06cc-45fe-8526-cf20a4cf556a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:34.090031 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1310/2639] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:34.102630 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45c85a-5f20-4b93-a6b2-4545607e38d4 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:34.106069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-7c45c85a-5f20-4b93-a6b2-4545607e38d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:34.120933 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45c85a-5f20-4b93-a6b2-4545607e38d4 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:34.125102 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca75f4-d35f-48d1-a69b-9e935c45741f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:34.125745 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca75f4-d35f-48d1-a69b-9e935c45741f service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:34.126024 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca75f4-d35f-48d1-a69b-9e935c45741f service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:34.126295 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca75f4-d35f-48d1-a69b-9e935c45741f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:34.160779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9cc3be-06cc-45fe-8526-cf20a4cf556a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:34.163977 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9cc3be-06cc-45fe-8526-cf20a4cf556a service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:34.184022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1330/2640] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:33 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:48:34.219931 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca75f4-d35f-48d1-a69b-9e935c45741f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:34.223002 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca75f4-d35f-48d1-a69b-9e935c45741f service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:34.242445 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1311/2641] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:48:34.249441 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9cc3be-06cc-45fe-8526-cf20a4cf556a service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:34.333235 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:34.367102 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9cc3be-06cc-45fe-8526-cf20a4cf556a service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:34.378637 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea770c5-5786-4752-8e61-f254cfc02957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:34.379783 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea770c5-5786-4752-8e61-f254cfc02957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:34.380389 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea770c5-5786-4752-8e61-f254cfc02957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:34.383339 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea770c5-5786-4752-8e61-f254cfc02957 admin admin] PATH_INFO: `/v3/users/88f300e83772494bb20857ad00b2259d` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:34.385750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea770c5-5786-4752-8e61-f254cfc02957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88f300e83772494bb20857ad00b2259d)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:34.391014 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea770c5-5786-4752-8e61-f254cfc02957 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:34.502330 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3ea770c5-5786-4752-8e61-f254cfc02957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88f300e83772494bb20857ad00b2259d'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:34.515342 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3ea770c5-5786-4752-8e61-f254cfc02957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88f300e83772494bb20857ad00b2259d'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:34.532436 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3ea770c5-5786-4752-8e61-f254cfc02957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88f300e83772494bb20857ad00b2259d'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:34.537023 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3ea770c5-5786-4752-8e61-f254cfc02957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88f300e83772494bb20857ad00b2259d'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:34.541921 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3ea770c5-5786-4752-8e61-f254cfc02957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88f300e83772494bb20857ad00b2259d'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:34.588647 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1331/2642] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:48:34 2022] DELETE /identity/v3/users/88f300e83772494bb20857ad00b2259d => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:34.596991 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836a7d6-68ff-4058-b5ed-03f192e56200 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:34.597511 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836a7d6-68ff-4058-b5ed-03f192e56200 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:34.600152 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836a7d6-68ff-4058-b5ed-03f192e56200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:34.666145 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-4836a7d6-68ff-4058-b5ed-03f192e56200 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:34.670850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-4836a7d6-68ff-4058-b5ed-03f192e56200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:34.742134 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:34.847324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1312/2643] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:34.872173 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea770c5-5786-4752-8e61-f254cfc02957 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:34.878008 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3ea770c5-5786-4752-8e61-f254cfc02957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:35.039787 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea770c5-5786-4752-8e61-f254cfc02957 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:35.047711 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e749da-8fbc-4ab7-879a-ec57b0a67b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:35.048958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e749da-8fbc-4ab7-879a-ec57b0a67b8b service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:35.049545 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e749da-8fbc-4ab7-879a-ec57b0a67b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:35.050128 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e749da-8fbc-4ab7-879a-ec57b0a67b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:35.065965 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e749da-8fbc-4ab7-879a-ec57b0a67b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:35.068877 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e749da-8fbc-4ab7-879a-ec57b0a67b8b service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:35.085417 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1332/2644] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:48:35.842696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836a7d6-68ff-4058-b5ed-03f192e56200 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:35.846188 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-4836a7d6-68ff-4058-b5ed-03f192e56200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:35.897047 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836a7d6-68ff-4058-b5ed-03f192e56200 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:35.917824 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef0e3f-186f-4c1d-af9a-8ba8a3c89796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:35.921068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef0e3f-186f-4c1d-af9a-8ba8a3c89796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:35.921560 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef0e3f-186f-4c1d-af9a-8ba8a3c89796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:35.922035 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef0e3f-186f-4c1d-af9a-8ba8a3c89796 admin admin] PATH_INFO: `/v3/projects/7753d0f2ae8b4477b1c4b73a21c3b665` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:35.924497 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef0e3f-186f-4c1d-af9a-8ba8a3c89796 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7753d0f2ae8b4477b1c4b73a21c3b665)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:35.928235 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef0e3f-186f-4c1d-af9a-8ba8a3c89796 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:36.026263 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-53ef0e3f-186f-4c1d-af9a-8ba8a3c89796 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7753d0f2ae8b4477b1c4b73a21c3b665', 'request_id': 'req-53ef0e3f-186f-4c1d-af9a-8ba8a3c89796'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:36.039673 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-53ef0e3f-186f-4c1d-af9a-8ba8a3c89796 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7753d0f2ae8b4477b1c4b73a21c3b665', 'request_id': 'req-53ef0e3f-186f-4c1d-af9a-8ba8a3c89796'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:36.051384 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-53ef0e3f-186f-4c1d-af9a-8ba8a3c89796 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7753d0f2ae8b4477b1c4b73a21c3b665', 'request_id': 'req-53ef0e3f-186f-4c1d-af9a-8ba8a3c89796'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:36.085790 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-53ef0e3f-186f-4c1d-af9a-8ba8a3c89796 admin admin] The token cache is being invalidate because project 7753d0f2ae8b4477b1c4b73a21c3b665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:48:36.086032 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-53ef0e3f-186f-4c1d-af9a-8ba8a3c89796 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:36.087042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-53ef0e3f-186f-4c1d-af9a-8ba8a3c89796 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:36.089318 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1313/2645] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:48:35 2022] DELETE /identity/v3/projects/7753d0f2ae8b4477b1c4b73a21c3b665 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:48:36.093937 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e749da-8fbc-4ab7-879a-ec57b0a67b8b service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:36.107750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e749da-8fbc-4ab7-879a-ec57b0a67b8b service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:36.230906 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d93956-3f5f-44b9-854c-bf390fed6474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:36.232977 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d93956-3f5f-44b9-854c-bf390fed6474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:36.233721 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d93956-3f5f-44b9-854c-bf390fed6474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:36.234650 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d93956-3f5f-44b9-854c-bf390fed6474 admin admin] PATH_INFO: `/v3/users/8e58054ba345461abf8ca0549ad0dc9a` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:36.238325 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d93956-3f5f-44b9-854c-bf390fed6474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e58054ba345461abf8ca0549ad0dc9a)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:36.242672 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d93956-3f5f-44b9-854c-bf390fed6474 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:36.255598 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:36.335193 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-c1d93956-3f5f-44b9-854c-bf390fed6474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e58054ba345461abf8ca0549ad0dc9a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:36.349656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-c1d93956-3f5f-44b9-854c-bf390fed6474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e58054ba345461abf8ca0549ad0dc9a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:36.376786 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-c1d93956-3f5f-44b9-854c-bf390fed6474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e58054ba345461abf8ca0549ad0dc9a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:36.378231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-c1d93956-3f5f-44b9-854c-bf390fed6474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e58054ba345461abf8ca0549ad0dc9a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:36.381732 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-c1d93956-3f5f-44b9-854c-bf390fed6474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e58054ba345461abf8ca0549ad0dc9a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:36.423189 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1333/2646] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:48:36 2022] DELETE /identity/v3/users/8e58054ba345461abf8ca0549ad0dc9a => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:36.775600 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef0e3f-186f-4c1d-af9a-8ba8a3c89796 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:36.777313 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-53ef0e3f-186f-4c1d-af9a-8ba8a3c89796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:36.797048 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef0e3f-186f-4c1d-af9a-8ba8a3c89796 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:36.874251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d924f-6feb-4ab4-995d-d75fe458224e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:36.874976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d924f-6feb-4ab4-995d-d75fe458224e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:36.875194 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d924f-6feb-4ab4-995d-d75fe458224e admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:36.875474 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d924f-6feb-4ab4-995d-d75fe458224e admin admin] PATH_INFO: `/v3/projects/5cbca187def6484c83c6e11e5265f073` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:36.876791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d924f-6feb-4ab4-995d-d75fe458224e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cbca187def6484c83c6e11e5265f073)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:36.878779 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d924f-6feb-4ab4-995d-d75fe458224e admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:37.060954 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:37.062806 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-117d924f-6feb-4ab4-995d-d75fe458224e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cbca187def6484c83c6e11e5265f073', 'request_id': 'req-117d924f-6feb-4ab4-995d-d75fe458224e'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:37.072234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-117d924f-6feb-4ab4-995d-d75fe458224e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cbca187def6484c83c6e11e5265f073', 'request_id': 'req-117d924f-6feb-4ab4-995d-d75fe458224e'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:37.080962 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-117d924f-6feb-4ab4-995d-d75fe458224e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cbca187def6484c83c6e11e5265f073', 'request_id': 'req-117d924f-6feb-4ab4-995d-d75fe458224e'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:37.096157 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-117d924f-6feb-4ab4-995d-d75fe458224e admin admin] The token cache is being invalidate because project 5cbca187def6484c83c6e11e5265f073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:48:37.096553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-117d924f-6feb-4ab4-995d-d75fe458224e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:37.097173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-117d924f-6feb-4ab4-995d-d75fe458224e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:37.099272 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1314/2647] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:48:36 2022] DELETE /identity/v3/projects/5cbca187def6484c83c6e11e5265f073 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:37.104916 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aa4e4-9251-409c-9433-7eb0e4ffde50 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:37.105537 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aa4e4-9251-409c-9433-7eb0e4ffde50 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:37.105883 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aa4e4-9251-409c-9433-7eb0e4ffde50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:37.132584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-cc4aa4e4-9251-409c-9433-7eb0e4ffde50 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:37.134107 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-cc4aa4e4-9251-409c-9433-7eb0e4ffde50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:37.216634 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1334/2648] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:37.225741 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa511b5-0c41-418c-bd40-5a38ba12c218 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:37.226029 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa511b5-0c41-418c-bd40-5a38ba12c218 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:37.226279 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa511b5-0c41-418c-bd40-5a38ba12c218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:37.248751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-0aa511b5-0c41-418c-bd40-5a38ba12c218 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:37.250541 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-0aa511b5-0c41-418c-bd40-5a38ba12c218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:37.260274 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1315/2649] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:48:37.265468 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4aa4e4-9251-409c-9433-7eb0e4ffde50 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:37.281116 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa511b5-0c41-418c-bd40-5a38ba12c218 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:37.282440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4aa4e4-9251-409c-9433-7eb0e4ffde50 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:37.283089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-0aa511b5-0c41-418c-bd40-5a38ba12c218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:37.288525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b8f9a-4538-4aba-8b6f-592b5d1beb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:37.289313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b8f9a-4538-4aba-8b6f-592b5d1beb4c admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:37.289657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b8f9a-4538-4aba-8b6f-592b5d1beb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:37.290001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b8f9a-4538-4aba-8b6f-592b5d1beb4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:37.290832 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b8f9a-4538-4aba-8b6f-592b5d1beb4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:48:37.291340 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b8f9a-4538-4aba-8b6f-592b5d1beb4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:37.293645 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b8f9a-4538-4aba-8b6f-592b5d1beb4c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:37.298557 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa511b5-0c41-418c-bd40-5a38ba12c218 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:37.305236 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae9dbe-740a-4fc7-a467-32bf90c7003b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:37.306592 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae9dbe-740a-4fc7-a467-32bf90c7003b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:37.306592 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae9dbe-740a-4fc7-a467-32bf90c7003b admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:37.306592 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae9dbe-740a-4fc7-a467-32bf90c7003b admin admin] PATH_INFO: `/v3/users/4e8a0f8c5517414682f62c3816013d7c` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:37.308258 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae9dbe-740a-4fc7-a467-32bf90c7003b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e8a0f8c5517414682f62c3816013d7c)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:37.310596 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1335/2650] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:48:37.310878 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae9dbe-740a-4fc7-a467-32bf90c7003b admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:37.315442 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b8f9a-4538-4aba-8b6f-592b5d1beb4c admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:37.327561 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b8f9a-4538-4aba-8b6f-592b5d1beb4c admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:37.336890 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac253d4-0e62-4290-a545-163758d32576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:37.337975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac253d4-0e62-4290-a545-163758d32576 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:37.338405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac253d4-0e62-4290-a545-163758d32576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:37.338887 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac253d4-0e62-4290-a545-163758d32576 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:37.340368 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac253d4-0e62-4290-a545-163758d32576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:37.344445 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac253d4-0e62-4290-a545-163758d32576 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:37.394281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1336/2651] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:48:37 2022] POST /identity/v3/projects => generated 387 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:48:37.394615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-92ae9dbe-740a-4fc7-a467-32bf90c7003b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e8a0f8c5517414682f62c3816013d7c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:37.397945 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac253d4-0e62-4290-a545-163758d32576 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:37.415513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-92ae9dbe-740a-4fc7-a467-32bf90c7003b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e8a0f8c5517414682f62c3816013d7c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:37.453407 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-92ae9dbe-740a-4fc7-a467-32bf90c7003b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e8a0f8c5517414682f62c3816013d7c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:37.456989 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-92ae9dbe-740a-4fc7-a467-32bf90c7003b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e8a0f8c5517414682f62c3816013d7c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:37.461662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-92ae9dbe-740a-4fc7-a467-32bf90c7003b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e8a0f8c5517414682f62c3816013d7c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:37.495021 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1316/2652] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:48:37 2022] DELETE /identity/v3/users/4e8a0f8c5517414682f62c3816013d7c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:37.501479 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d5165-9bcb-4f52-a008-1d503b83be07 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:37.503277 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d5165-9bcb-4f52-a008-1d503b83be07 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:37.504046 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d5165-9bcb-4f52-a008-1d503b83be07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:37.544022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:37.564080 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-312d5165-9bcb-4f52-a008-1d503b83be07 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:37.565881 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-312d5165-9bcb-4f52-a008-1d503b83be07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:37.574208 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac253d4-0e62-4290-a545-163758d32576 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:37.698636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1317/2653] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:37.712569 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f288670-3397-493f-a8fe-b151ba91dfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:37.713514 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f288670-3397-493f-a8fe-b151ba91dfb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:37.713982 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f288670-3397-493f-a8fe-b151ba91dfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:37.714472 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f288670-3397-493f-a8fe-b151ba91dfb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:37.715458 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f288670-3397-493f-a8fe-b151ba91dfb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:37.719101 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f288670-3397-493f-a8fe-b151ba91dfb1 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:37.722832 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d5165-9bcb-4f52-a008-1d503b83be07 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:37.725274 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-312d5165-9bcb-4f52-a008-1d503b83be07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:37.780560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1337/2654] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:48:37 2022] POST /identity/v3/users => generated 294 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:48:37.780560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f288670-3397-493f-a8fe-b151ba91dfb1 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:37.780560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1f288670-3397-493f-a8fe-b151ba91dfb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:37.800417 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f288670-3397-493f-a8fe-b151ba91dfb1 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:37.810666 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6b399-8a55-488f-98ce-5e8db86943e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:37.811441 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6b399-8a55-488f-98ce-5e8db86943e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:37.812029 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6b399-8a55-488f-98ce-5e8db86943e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:37.812466 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6b399-8a55-488f-98ce-5e8db86943e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:37.813755 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6b399-8a55-488f-98ce-5e8db86943e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:37.817837 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6b399-8a55-488f-98ce-5e8db86943e8 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:37.837067 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1338/2655] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:37.842980 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6b399-8a55-488f-98ce-5e8db86943e8 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:37.861088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:37.861609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6b399-8a55-488f-98ce-5e8db86943e8 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:37.870120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dad1c-eb32-4787-8c4d-ec46bc6ed846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:37.870495 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dad1c-eb32-4787-8c4d-ec46bc6ed846 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:37.870669 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dad1c-eb32-4787-8c4d-ec46bc6ed846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:37.870890 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dad1c-eb32-4787-8c4d-ec46bc6ed846 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:37.872067 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5dad1c-eb32-4787-8c4d-ec46bc6ed846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:37.875081 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5dad1c-eb32-4787-8c4d-ec46bc6ed846 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:37.900391 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1339/2656] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:37.901071 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d5165-9bcb-4f52-a008-1d503b83be07 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:37.907287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dad1c-eb32-4787-8c4d-ec46bc6ed846 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:37.909575 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa591644-f62e-47ac-936d-9cc76401a091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:37.910772 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa591644-f62e-47ac-936d-9cc76401a091 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:37.911323 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa591644-f62e-47ac-936d-9cc76401a091 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:37.911856 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa591644-f62e-47ac-936d-9cc76401a091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:37.920234 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dad1c-eb32-4787-8c4d-ec46bc6ed846 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:37.926674 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0b85e-c990-4aac-98aa-eaf384a031bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:37.927377 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0b85e-c990-4aac-98aa-eaf384a031bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:37.927669 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0b85e-c990-4aac-98aa-eaf384a031bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:37.927948 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0b85e-c990-4aac-98aa-eaf384a031bb admin admin] PATH_INFO: `/v3/projects/616f702946814cab8dd0ada7912321e1/users/b2f0dcf20d4244e2b204bf36e914db3f/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:37.937949 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa591644-f62e-47ac-936d-9cc76401a091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:37.941877 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa591644-f62e-47ac-936d-9cc76401a091 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:37.957215 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0b85e-c990-4aac-98aa-eaf384a031bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=616f702946814cab8dd0ada7912321e1, user_id=b2f0dcf20d4244e2b204bf36e914db3f, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:37.961046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0b85e-c990-4aac-98aa-eaf384a031bb admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:37.965238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1318/2657] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:48:37.989703 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1340/2658] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:37 2022] PUT /identity/v3/projects/616f702946814cab8dd0ada7912321e1/users/b2f0dcf20d4244e2b204bf36e914db3f/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:38.010544 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798b40d-3f40-4e5f-9f5b-5dfa34673413 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:38.011056 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798b40d-3f40-4e5f-9f5b-5dfa34673413 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:38.011890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798b40d-3f40-4e5f-9f5b-5dfa34673413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:38.061403 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-e798b40d-3f40-4e5f-9f5b-5dfa34673413 None None] MFA Rules not processed for user `b2f0dcf20d4244e2b204bf36e914db3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:38.063467 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-e798b40d-3f40-4e5f-9f5b-5dfa34673413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:38.219764 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1319/2659] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:38.227580 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0b85e-c990-4aac-98aa-eaf384a031bb admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:38.331070 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0b85e-c990-4aac-98aa-eaf384a031bb admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:38.340016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17390e0b-1385-423c-bc9d-707376638bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:38.340694 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17390e0b-1385-423c-bc9d-707376638bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:38.340981 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17390e0b-1385-423c-bc9d-707376638bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:38.341255 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17390e0b-1385-423c-bc9d-707376638bc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:38.341932 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17390e0b-1385-423c-bc9d-707376638bc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:38.344749 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17390e0b-1385-423c-bc9d-707376638bc0 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:38.382468 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798b40d-3f40-4e5f-9f5b-5dfa34673413 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:38.383226 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1341/2660] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:48:38 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:48:38.394767 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798b40d-3f40-4e5f-9f5b-5dfa34673413 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:38.408605 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17390e0b-1385-423c-bc9d-707376638bc0 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:38.412258 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-17390e0b-1385-423c-bc9d-707376638bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:38.460070 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:38.484411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26aa7a-dcd6-457f-9cb5-516cb4f95203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:38.485050 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26aa7a-dcd6-457f-9cb5-516cb4f95203 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:38.485319 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26aa7a-dcd6-457f-9cb5-516cb4f95203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:38.485611 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26aa7a-dcd6-457f-9cb5-516cb4f95203 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:38.486415 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26aa7a-dcd6-457f-9cb5-516cb4f95203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:38.488425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26aa7a-dcd6-457f-9cb5-516cb4f95203 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:38.510898 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17390e0b-1385-423c-bc9d-707376638bc0 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:38.521000 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1320/2661] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:48:38 2022] POST /identity/v3/users => generated 299 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:48:38.524933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb8534-dfd8-4f5c-a8b2-0194534ead1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:38.525316 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26aa7a-dcd6-457f-9cb5-516cb4f95203 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:38.526198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb8534-dfd8-4f5c-a8b2-0194534ead1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:38.527215 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb8534-dfd8-4f5c-a8b2-0194534ead1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:38.527410 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb8534-dfd8-4f5c-a8b2-0194534ead1c admin admin] PATH_INFO: `/v3/projects/b7079d74cb5b426a851f1d1a734d85cc` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:38.529584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb8534-dfd8-4f5c-a8b2-0194534ead1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7079d74cb5b426a851f1d1a734d85cc)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:38.533412 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb8534-dfd8-4f5c-a8b2-0194534ead1c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:38.546974 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26aa7a-dcd6-457f-9cb5-516cb4f95203 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:38.554957 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed94321-07b0-4106-9693-f8279321d822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:38.555606 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed94321-07b0-4106-9693-f8279321d822 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:38.555887 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed94321-07b0-4106-9693-f8279321d822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:38.556164 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed94321-07b0-4106-9693-f8279321d822 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:38.556885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed94321-07b0-4106-9693-f8279321d822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:38.558705 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed94321-07b0-4106-9693-f8279321d822 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:38.571732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1321/2662] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:48:38.577235 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed94321-07b0-4106-9693-f8279321d822 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:38.588887 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed94321-07b0-4106-9693-f8279321d822 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:38.606242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a0bb8534-dfd8-4f5c-a8b2-0194534ead1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7079d74cb5b426a851f1d1a734d85cc', 'request_id': 'req-a0bb8534-dfd8-4f5c-a8b2-0194534ead1c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:38.613555 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a0bb8534-dfd8-4f5c-a8b2-0194534ead1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7079d74cb5b426a851f1d1a734d85cc', 'request_id': 'req-a0bb8534-dfd8-4f5c-a8b2-0194534ead1c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:38.620969 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a0bb8534-dfd8-4f5c-a8b2-0194534ead1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7079d74cb5b426a851f1d1a734d85cc', 'request_id': 'req-a0bb8534-dfd8-4f5c-a8b2-0194534ead1c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:38.637181 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a0bb8534-dfd8-4f5c-a8b2-0194534ead1c admin admin] The token cache is being invalidate because project b7079d74cb5b426a851f1d1a734d85cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:48:38.637517 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a0bb8534-dfd8-4f5c-a8b2-0194534ead1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:38.638241 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a0bb8534-dfd8-4f5c-a8b2-0194534ead1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:38.639832 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1342/2663] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:48:38 2022] DELETE /identity/v3/projects/b7079d74cb5b426a851f1d1a734d85cc => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:38.644322 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb8534-dfd8-4f5c-a8b2-0194534ead1c admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:38.645966 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a0bb8534-dfd8-4f5c-a8b2-0194534ead1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:38.655283 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:38.670915 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f3a56-b265-43af-9a36-bc8f9fea9c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:38.671814 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f3a56-b265-43af-9a36-bc8f9fea9c76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:38.672103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f3a56-b265-43af-9a36-bc8f9fea9c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:38.672618 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f3a56-b265-43af-9a36-bc8f9fea9c76 admin admin] PATH_INFO: `/v3/projects/947e95254f194186bd2efbb1641f89fc/users/bf79d48c89d04902b6aa20e2c42faead/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:38.692574 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f3a56-b265-43af-9a36-bc8f9fea9c76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=947e95254f194186bd2efbb1641f89fc, user_id=bf79d48c89d04902b6aa20e2c42faead, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:38.696030 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f3a56-b265-43af-9a36-bc8f9fea9c76 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:38.715605 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1322/2664] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:38 2022] PUT /identity/v3/projects/947e95254f194186bd2efbb1641f89fc/users/bf79d48c89d04902b6aa20e2c42faead/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:38.720939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f3a56-b265-43af-9a36-bc8f9fea9c76 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:38.723821 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-075f3a56-b265-43af-9a36-bc8f9fea9c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:38.742851 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb8534-dfd8-4f5c-a8b2-0194534ead1c admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:38.832812 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac8200-b2f1-4d4c-986e-4f5e92e9244a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:38.834114 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac8200-b2f1-4d4c-986e-4f5e92e9244a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:38.834553 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac8200-b2f1-4d4c-986e-4f5e92e9244a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:38.834953 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac8200-b2f1-4d4c-986e-4f5e92e9244a admin admin] PATH_INFO: `/v3/users/2b02a5cc57bc4f4d80756ad62e7d9f94` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:38.835151 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f3a56-b265-43af-9a36-bc8f9fea9c76 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:38.836622 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac8200-b2f1-4d4c-986e-4f5e92e9244a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b02a5cc57bc4f4d80756ad62e7d9f94)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:38.839733 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac8200-b2f1-4d4c-986e-4f5e92e9244a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:38.843748 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff74c6a-8a0c-4a45-a456-d8a2df3676c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:38.844801 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff74c6a-8a0c-4a45-a456-d8a2df3676c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:38.845373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff74c6a-8a0c-4a45-a456-d8a2df3676c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:38.845735 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff74c6a-8a0c-4a45-a456-d8a2df3676c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:38.847921 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff74c6a-8a0c-4a45-a456-d8a2df3676c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:38.851099 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:38.852238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff74c6a-8a0c-4a45-a456-d8a2df3676c4 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:38.871527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1323/2665] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:38.877274 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff74c6a-8a0c-4a45-a456-d8a2df3676c4 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:38.896639 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff74c6a-8a0c-4a45-a456-d8a2df3676c4 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:38.906501 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f99fb-3635-47db-a16e-025ae481083d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:38.907777 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f99fb-3635-47db-a16e-025ae481083d admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:38.907777 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f99fb-3635-47db-a16e-025ae481083d admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:38.908119 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f99fb-3635-47db-a16e-025ae481083d admin admin] PATH_INFO: `/v3/projects/947e95254f194186bd2efbb1641f89fc/users/bf79d48c89d04902b6aa20e2c42faead/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:38.912261 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f99fb-3635-47db-a16e-025ae481083d admin admin] RBAC: Authorizing `identity:create_grant(project_id=947e95254f194186bd2efbb1641f89fc, user_id=bf79d48c89d04902b6aa20e2c42faead, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:38.916421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f99fb-3635-47db-a16e-025ae481083d admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:38.935270 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1324/2666] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:38 2022] PUT /identity/v3/projects/947e95254f194186bd2efbb1641f89fc/users/bf79d48c89d04902b6aa20e2c42faead/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:48:38.947201 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-38ac8200-b2f1-4d4c-986e-4f5e92e9244a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b02a5cc57bc4f4d80756ad62e7d9f94'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:38.949544 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09078e4-e68f-4885-b9cc-b0af143b5b36 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:38.949989 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09078e4-e68f-4885-b9cc-b0af143b5b36 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:38.952599 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09078e4-e68f-4885-b9cc-b0af143b5b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:38.972736 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-38ac8200-b2f1-4d4c-986e-4f5e92e9244a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b02a5cc57bc4f4d80756ad62e7d9f94'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:38.987449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-38ac8200-b2f1-4d4c-986e-4f5e92e9244a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b02a5cc57bc4f4d80756ad62e7d9f94'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:38.988449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-38ac8200-b2f1-4d4c-986e-4f5e92e9244a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b02a5cc57bc4f4d80756ad62e7d9f94'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:38.989342 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-38ac8200-b2f1-4d4c-986e-4f5e92e9244a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b02a5cc57bc4f4d80756ad62e7d9f94'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:39.003358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-a09078e4-e68f-4885-b9cc-b0af143b5b36 None None] MFA Rules not processed for user `bf79d48c89d04902b6aa20e2c42faead`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:39.005227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a09078e4-e68f-4885-b9cc-b0af143b5b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:39.023037 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1343/2667] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:48:38 2022] DELETE /identity/v3/users/2b02a5cc57bc4f4d80756ad62e7d9f94 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:48:39.137121 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1325/2668] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:39.157658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac8200-b2f1-4d4c-986e-4f5e92e9244a admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:39.160895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-38ac8200-b2f1-4d4c-986e-4f5e92e9244a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:39.284285 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac8200-b2f1-4d4c-986e-4f5e92e9244a admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:39.294089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19dc3a6-d7f3-4e76-ac26-2128262a0ddb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:39.295407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19dc3a6-d7f3-4e76-ac26-2128262a0ddb service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:39.296009 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19dc3a6-d7f3-4e76-ac26-2128262a0ddb service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:39.296658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19dc3a6-d7f3-4e76-ac26-2128262a0ddb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:39.455089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19dc3a6-d7f3-4e76-ac26-2128262a0ddb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:39.458459 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19dc3a6-d7f3-4e76-ac26-2128262a0ddb service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:39.479611 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1344/2669] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:48:39.588014 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09078e4-e68f-4885-b9cc-b0af143b5b36 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:39.593329 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a09078e4-e68f-4885-b9cc-b0af143b5b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:39.601294 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19dc3a6-d7f3-4e76-ac26-2128262a0ddb service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:39.605679 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d19dc3a6-d7f3-4e76-ac26-2128262a0ddb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:39.693324 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:39.695722 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:39.734357 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09078e4-e68f-4885-b9cc-b0af143b5b36 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:39.742069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3def1-a37a-433c-bee9-c4075593be51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:39.743408 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3def1-a37a-433c-bee9-c4075593be51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:39.744062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3def1-a37a-433c-bee9-c4075593be51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:39.744683 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3def1-a37a-433c-bee9-c4075593be51 admin admin] PATH_INFO: `/v3/projects/6e5119ae77e0466b93bf3ce1aae77056` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:39.747189 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3def1-a37a-433c-bee9-c4075593be51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e5119ae77e0466b93bf3ce1aae77056)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:39.750214 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3def1-a37a-433c-bee9-c4075593be51 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:39.757609 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19dc3a6-d7f3-4e76-ac26-2128262a0ddb service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:39.767222 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1ab53-cb77-4e81-89c0-abaafc5a6ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:39.768100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1ab53-cb77-4e81-89c0-abaafc5a6ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:39.768623 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1ab53-cb77-4e81-89c0-abaafc5a6ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:39.769108 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1ab53-cb77-4e81-89c0-abaafc5a6ba6 admin admin] PATH_INFO: `/v3/users/b2f0dcf20d4244e2b204bf36e914db3f` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:39.770893 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1ab53-cb77-4e81-89c0-abaafc5a6ba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f0dcf20d4244e2b204bf36e914db3f)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:39.773591 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1ab53-cb77-4e81-89c0-abaafc5a6ba6 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:39.856089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-97b3def1-a37a-433c-bee9-c4075593be51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e5119ae77e0466b93bf3ce1aae77056', 'request_id': 'req-97b3def1-a37a-433c-bee9-c4075593be51'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:39.869529 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-10c1ab53-cb77-4e81-89c0-abaafc5a6ba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f0dcf20d4244e2b204bf36e914db3f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:39.869845 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-97b3def1-a37a-433c-bee9-c4075593be51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e5119ae77e0466b93bf3ce1aae77056', 'request_id': 'req-97b3def1-a37a-433c-bee9-c4075593be51'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:39.880855 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-97b3def1-a37a-433c-bee9-c4075593be51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e5119ae77e0466b93bf3ce1aae77056', 'request_id': 'req-97b3def1-a37a-433c-bee9-c4075593be51'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:39.882056 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-10c1ab53-cb77-4e81-89c0-abaafc5a6ba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f0dcf20d4244e2b204bf36e914db3f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:39.905187 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-10c1ab53-cb77-4e81-89c0-abaafc5a6ba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f0dcf20d4244e2b204bf36e914db3f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:39.906175 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-97b3def1-a37a-433c-bee9-c4075593be51 admin admin] The token cache is being invalidate because project 6e5119ae77e0466b93bf3ce1aae77056 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:48:39.906668 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-97b3def1-a37a-433c-bee9-c4075593be51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:39.907825 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-10c1ab53-cb77-4e81-89c0-abaafc5a6ba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f0dcf20d4244e2b204bf36e914db3f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:39.908808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-97b3def1-a37a-433c-bee9-c4075593be51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:39.909171 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-10c1ab53-cb77-4e81-89c0-abaafc5a6ba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f0dcf20d4244e2b204bf36e914db3f'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:39.917793 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1326/2670] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:48:39 2022] DELETE /identity/v3/projects/6e5119ae77e0466b93bf3ce1aae77056 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:39.920957 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3086a8-c60b-41f9-94d8-c4a01976447b None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:39.921742 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3086a8-c60b-41f9-94d8-c4a01976447b None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:39.923012 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3086a8-c60b-41f9-94d8-c4a01976447b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:39.941065 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1345/2671] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:48:39 2022] DELETE /identity/v3/users/b2f0dcf20d4244e2b204bf36e914db3f => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:39.947460 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89191bf-bb0a-4670-8656-4f6817da9f6e None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:39.947844 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89191bf-bb0a-4670-8656-4f6817da9f6e None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:39.948280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89191bf-bb0a-4670-8656-4f6817da9f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:39.953158 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-1a3086a8-c60b-41f9-94d8-c4a01976447b None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:39.954400 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-1a3086a8-c60b-41f9-94d8-c4a01976447b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:39.979100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-c89191bf-bb0a-4670-8656-4f6817da9f6e None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:39.981172 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c89191bf-bb0a-4670-8656-4f6817da9f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:40.030483 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1327/2672] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:40.039838 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809cc38-cf85-4d86-88c7-9ec1f9e629cd None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:40.040131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809cc38-cf85-4d86-88c7-9ec1f9e629cd None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:40.040465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809cc38-cf85-4d86-88c7-9ec1f9e629cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:40.065081 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-e809cc38-cf85-4d86-88c7-9ec1f9e629cd None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:40.066427 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-e809cc38-cf85-4d86-88c7-9ec1f9e629cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:40.075137 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1328/2673] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:40.080968 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809cc38-cf85-4d86-88c7-9ec1f9e629cd None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:40.088967 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1346/2674] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:48:40.092579 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809cc38-cf85-4d86-88c7-9ec1f9e629cd None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:40.099669 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe19316-611e-4416-a769-76f0c225a610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:40.100629 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe19316-611e-4416-a769-76f0c225a610 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:40.101068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe19316-611e-4416-a769-76f0c225a610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:40.101473 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe19316-611e-4416-a769-76f0c225a610 admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:40.102213 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89191bf-bb0a-4670-8656-4f6817da9f6e None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:40.102440 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe19316-611e-4416-a769-76f0c225a610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:48:40.102786 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe19316-611e-4416-a769-76f0c225a610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:40.104554 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c89191bf-bb0a-4670-8656-4f6817da9f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:40.105143 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe19316-611e-4416-a769-76f0c225a610 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:40.120367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1329/2675] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:48:40.125286 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe19316-611e-4416-a769-76f0c225a610 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:40.136627 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe19316-611e-4416-a769-76f0c225a610 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:40.156446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362487b-e27a-4c2e-8274-59a9f8e52077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:40.156446 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362487b-e27a-4c2e-8274-59a9f8e52077 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:40.156816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362487b-e27a-4c2e-8274-59a9f8e52077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:40.157165 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362487b-e27a-4c2e-8274-59a9f8e52077 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:40.157593 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362487b-e27a-4c2e-8274-59a9f8e52077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:40.159969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362487b-e27a-4c2e-8274-59a9f8e52077 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:40.210523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1330/2676] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:48:40 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:48:40.217262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362487b-e27a-4c2e-8274-59a9f8e52077 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:40.222530 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89191bf-bb0a-4670-8656-4f6817da9f6e None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:40.233006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:40.291497 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:40.314963 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c10bc-f5e4-4856-871f-79c0adeb1e5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:40.316374 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c10bc-f5e4-4856-871f-79c0adeb1e5a service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:40.316567 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c10bc-f5e4-4856-871f-79c0adeb1e5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:40.318231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c10bc-f5e4-4856-871f-79c0adeb1e5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:40.323634 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362487b-e27a-4c2e-8274-59a9f8e52077 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:40.330657 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c75d1e-2001-4aaf-87c4-891985357c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:40.331310 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c75d1e-2001-4aaf-87c4-891985357c36 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:40.331595 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c75d1e-2001-4aaf-87c4-891985357c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:40.331885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c75d1e-2001-4aaf-87c4-891985357c36 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:40.333102 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c75d1e-2001-4aaf-87c4-891985357c36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:40.335186 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c75d1e-2001-4aaf-87c4-891985357c36 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:40.339833 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c10bc-f5e4-4856-871f-79c0adeb1e5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:40.342660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c10bc-f5e4-4856-871f-79c0adeb1e5a service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:40.363801 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1347/2677] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:48:40.365164 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1331/2678] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:48:40 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:48:40.373579 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c10bc-f5e4-4856-871f-79c0adeb1e5a service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:40.384797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c10bc-f5e4-4856-871f-79c0adeb1e5a service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:40.390589 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ea146-6678-4398-b67b-df2007d0996b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:40.390842 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ea146-6678-4398-b67b-df2007d0996b admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:40.390935 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ea146-6678-4398-b67b-df2007d0996b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:40.391610 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ea146-6678-4398-b67b-df2007d0996b admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:40.392383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ea146-6678-4398-b67b-df2007d0996b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:40.394149 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ea146-6678-4398-b67b-df2007d0996b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:40.406948 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1348/2679] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:40.411940 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c75d1e-2001-4aaf-87c4-891985357c36 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:40.424881 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c75d1e-2001-4aaf-87c4-891985357c36 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:40.435416 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5986a8-2f3d-482f-8b4b-18966c819a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:40.436296 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5986a8-2f3d-482f-8b4b-18966c819a40 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:40.436687 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5986a8-2f3d-482f-8b4b-18966c819a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:40.437096 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5986a8-2f3d-482f-8b4b-18966c819a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:40.438108 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5986a8-2f3d-482f-8b4b-18966c819a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:40.440119 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5986a8-2f3d-482f-8b4b-18966c819a40 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:40.456226 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1332/2680] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:40.463618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ea146-6678-4398-b67b-df2007d0996b admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:40.484621 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ea146-6678-4398-b67b-df2007d0996b admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:40.494884 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad2563-5624-4a32-b793-d7e451d4591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:40.496284 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad2563-5624-4a32-b793-d7e451d4591b admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:40.496606 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad2563-5624-4a32-b793-d7e451d4591b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:40.496895 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad2563-5624-4a32-b793-d7e451d4591b admin admin] PATH_INFO: `/v3/projects/b8262e4ce151427a959b91c2fae5992c/users/77eb13e33fac4d8a9b4d242b83d32bef/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:40.518986 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad2563-5624-4a32-b793-d7e451d4591b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8262e4ce151427a959b91c2fae5992c, user_id=77eb13e33fac4d8a9b4d242b83d32bef, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:40.522869 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad2563-5624-4a32-b793-d7e451d4591b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:40.544157 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1349/2681] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:40 2022] PUT /identity/v3/projects/b8262e4ce151427a959b91c2fae5992c/users/77eb13e33fac4d8a9b4d242b83d32bef/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:48:40.570272 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5baa00a-6b8f-485b-afac-62a5bf8cccb9 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:40.570932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5baa00a-6b8f-485b-afac-62a5bf8cccb9 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:40.571265 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5baa00a-6b8f-485b-afac-62a5bf8cccb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:40.632262 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-a5baa00a-6b8f-485b-afac-62a5bf8cccb9 None None] MFA Rules not processed for user `77eb13e33fac4d8a9b4d242b83d32bef`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:40.634046 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a5baa00a-6b8f-485b-afac-62a5bf8cccb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:40.727360 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1333/2682] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:48:40.734233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad2563-5624-4a32-b793-d7e451d4591b admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:40.829239 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5baa00a-6b8f-485b-afac-62a5bf8cccb9 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:40.830974 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad2563-5624-4a32-b793-d7e451d4591b admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:40.831879 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a5baa00a-6b8f-485b-afac-62a5bf8cccb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:40.836348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4962fc-bacb-458a-824d-4f1a8946725a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:40.836985 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4962fc-bacb-458a-824d-4f1a8946725a admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:40.837288 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4962fc-bacb-458a-824d-4f1a8946725a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:40.837543 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4962fc-bacb-458a-824d-4f1a8946725a admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:40.838211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4962fc-bacb-458a-824d-4f1a8946725a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:40.840237 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4962fc-bacb-458a-824d-4f1a8946725a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:40.865729 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5baa00a-6b8f-485b-afac-62a5bf8cccb9 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:40.875037 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf9f95-3346-43f7-935c-57f0cf379008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:40.875781 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf9f95-3346-43f7-935c-57f0cf379008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:40.880776 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf9f95-3346-43f7-935c-57f0cf379008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:40.881754 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1350/2683] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:48:40 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:48:40.882348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf9f95-3346-43f7-935c-57f0cf379008 admin admin] PATH_INFO: `/v3/projects/616f702946814cab8dd0ada7912321e1` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:40.882348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf9f95-3346-43f7-935c-57f0cf379008 admin admin] RBAC: Authorizing `identity:delete_project(project_id=616f702946814cab8dd0ada7912321e1)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:40.882870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4962fc-bacb-458a-824d-4f1a8946725a admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:40.883245 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf9f95-3346-43f7-935c-57f0cf379008 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:40.959962 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a0cf9f95-3346-43f7-935c-57f0cf379008 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '616f702946814cab8dd0ada7912321e1', 'request_id': 'req-a0cf9f95-3346-43f7-935c-57f0cf379008'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:40.967022 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a0cf9f95-3346-43f7-935c-57f0cf379008 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '616f702946814cab8dd0ada7912321e1', 'request_id': 'req-a0cf9f95-3346-43f7-935c-57f0cf379008'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:40.974801 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a0cf9f95-3346-43f7-935c-57f0cf379008 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '616f702946814cab8dd0ada7912321e1', 'request_id': 'req-a0cf9f95-3346-43f7-935c-57f0cf379008'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:40.977006 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4962fc-bacb-458a-824d-4f1a8946725a admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:40.984159 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:40.992784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a0cf9f95-3346-43f7-935c-57f0cf379008 admin admin] The token cache is being invalidate because project 616f702946814cab8dd0ada7912321e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:48:40.994438 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a0cf9f95-3346-43f7-935c-57f0cf379008 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:40.995632 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a0cf9f95-3346-43f7-935c-57f0cf379008 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:40.998300 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1334/2684] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:48:40 2022] DELETE /identity/v3/projects/616f702946814cab8dd0ada7912321e1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:48:41.004531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf9f95-3346-43f7-935c-57f0cf379008 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:41.007083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a0cf9f95-3346-43f7-935c-57f0cf379008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:41.047913 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:41.073501 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd122e6f-961d-4e40-99ad-56889d738311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:41.074516 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd122e6f-961d-4e40-99ad-56889d738311 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:41.075507 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd122e6f-961d-4e40-99ad-56889d738311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:41.075507 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd122e6f-961d-4e40-99ad-56889d738311 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:41.076288 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd122e6f-961d-4e40-99ad-56889d738311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:41.079865 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd122e6f-961d-4e40-99ad-56889d738311 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:41.105529 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf9f95-3346-43f7-935c-57f0cf379008 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:41.112143 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdad8c7-dcc4-475d-8d1d-a3934f97f310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:41.112840 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdad8c7-dcc4-475d-8d1d-a3934f97f310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:41.113150 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdad8c7-dcc4-475d-8d1d-a3934f97f310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:41.113466 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdad8c7-dcc4-475d-8d1d-a3934f97f310 admin admin] PATH_INFO: `/v3/users/bf79d48c89d04902b6aa20e2c42faead` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:41.114750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdad8c7-dcc4-475d-8d1d-a3934f97f310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf79d48c89d04902b6aa20e2c42faead)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:41.119187 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1351/2685] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:48:40 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:48:41.119421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdad8c7-dcc4-475d-8d1d-a3934f97f310 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:41.121357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd122e6f-961d-4e40-99ad-56889d738311 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:41.124311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-dd122e6f-961d-4e40-99ad-56889d738311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:41.148688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd122e6f-961d-4e40-99ad-56889d738311 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:41.160978 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd3d99-b359-4aa4-b3f6-7e52b05f4e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:41.162133 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd3d99-b359-4aa4-b3f6-7e52b05f4e66 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:41.162133 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd3d99-b359-4aa4-b3f6-7e52b05f4e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:41.162549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd3d99-b359-4aa4-b3f6-7e52b05f4e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:41.164368 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd3d99-b359-4aa4-b3f6-7e52b05f4e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:41.168088 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd3d99-b359-4aa4-b3f6-7e52b05f4e66 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:41.201917 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1352/2686] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:41.204598 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd3d99-b359-4aa4-b3f6-7e52b05f4e66 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:41.218177 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6cdad8c7-dcc4-475d-8d1d-a3934f97f310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf79d48c89d04902b6aa20e2c42faead'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:41.227850 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd3d99-b359-4aa4-b3f6-7e52b05f4e66 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:41.234405 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6cdad8c7-dcc4-475d-8d1d-a3934f97f310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf79d48c89d04902b6aa20e2c42faead'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:41.240143 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74119402-1e91-4e12-8914-5f69aebeec99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:41.241324 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74119402-1e91-4e12-8914-5f69aebeec99 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:41.241839 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74119402-1e91-4e12-8914-5f69aebeec99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:41.242315 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74119402-1e91-4e12-8914-5f69aebeec99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:41.243632 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74119402-1e91-4e12-8914-5f69aebeec99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:41.247663 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74119402-1e91-4e12-8914-5f69aebeec99 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:41.259113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6cdad8c7-dcc4-475d-8d1d-a3934f97f310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf79d48c89d04902b6aa20e2c42faead'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:41.260239 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6cdad8c7-dcc4-475d-8d1d-a3934f97f310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf79d48c89d04902b6aa20e2c42faead'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:41.261194 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6cdad8c7-dcc4-475d-8d1d-a3934f97f310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf79d48c89d04902b6aa20e2c42faead'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:41.266576 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1353/2687] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:41.271790 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74119402-1e91-4e12-8914-5f69aebeec99 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:41.274068 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-74119402-1e91-4e12-8914-5f69aebeec99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:41.289739 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74119402-1e91-4e12-8914-5f69aebeec99 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:41.293165 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1335/2688] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:48:41 2022] DELETE /identity/v3/users/bf79d48c89d04902b6aa20e2c42faead => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:41.304524 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6baec-9c92-4edd-93a3-145d9413b824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:41.305660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6baec-9c92-4edd-93a3-145d9413b824 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:41.306164 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6baec-9c92-4edd-93a3-145d9413b824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:41.306667 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6baec-9c92-4edd-93a3-145d9413b824 admin admin] PATH_INFO: `/v3/projects/af2e125e51f745b6b5bf1ec2c9ae7ae3/users/1f9deecc412147d2b6ba22db7c3d0f48/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:41.330319 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6baec-9c92-4edd-93a3-145d9413b824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af2e125e51f745b6b5bf1ec2c9ae7ae3, user_id=1f9deecc412147d2b6ba22db7c3d0f48, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:41.335421 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6baec-9c92-4edd-93a3-145d9413b824 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:41.358318 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1354/2689] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:41 2022] PUT /identity/v3/projects/af2e125e51f745b6b5bf1ec2c9ae7ae3/users/1f9deecc412147d2b6ba22db7c3d0f48/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:41.373736 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8c899-ad21-405e-8ac4-d7d64cf6a895 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:41.374214 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8c899-ad21-405e-8ac4-d7d64cf6a895 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:41.374706 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8c899-ad21-405e-8ac4-d7d64cf6a895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:41.435578 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-78b8c899-ad21-405e-8ac4-d7d64cf6a895 None None] MFA Rules not processed for user `1f9deecc412147d2b6ba22db7c3d0f48`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:41.437652 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-78b8c899-ad21-405e-8ac4-d7d64cf6a895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:41.622941 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1336/2690] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:41.629531 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6baec-9c92-4edd-93a3-145d9413b824 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:41.739122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6baec-9c92-4edd-93a3-145d9413b824 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:41.746082 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782f5d3-a762-4922-a2c3-52ba56e34baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:41.746750 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782f5d3-a762-4922-a2c3-52ba56e34baf admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:41.747038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782f5d3-a762-4922-a2c3-52ba56e34baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:41.747317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782f5d3-a762-4922-a2c3-52ba56e34baf admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:41.748102 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782f5d3-a762-4922-a2c3-52ba56e34baf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:41.750777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782f5d3-a762-4922-a2c3-52ba56e34baf admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:41.796252 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1355/2691] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:48:41 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:48:41.799602 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8c899-ad21-405e-8ac4-d7d64cf6a895 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:41.824988 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8c899-ad21-405e-8ac4-d7d64cf6a895 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:41.890805 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782f5d3-a762-4922-a2c3-52ba56e34baf admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:41.895102 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:41.895366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f782f5d3-a762-4922-a2c3-52ba56e34baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:41.938064 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb7cef-30d8-4528-b277-0736376d59cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:41.938567 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb7cef-30d8-4528-b277-0736376d59cc admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:41.939230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb7cef-30d8-4528-b277-0736376d59cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:41.939399 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb7cef-30d8-4528-b277-0736376d59cc admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:41.939986 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb7cef-30d8-4528-b277-0736376d59cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:41.942946 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb7cef-30d8-4528-b277-0736376d59cc admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:41.973411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1337/2692] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:48:41 2022] POST /identity/v3/users => generated 299 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:48:41.977862 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb7cef-30d8-4528-b277-0736376d59cc admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:41.989922 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb7cef-30d8-4528-b277-0736376d59cc admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:41.991767 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:41.999627 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71ee49-f443-4e77-b8bf-65e5fc61cb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:42.001043 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71ee49-f443-4e77-b8bf-65e5fc61cb57 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:42.001348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71ee49-f443-4e77-b8bf-65e5fc61cb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:42.001803 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71ee49-f443-4e77-b8bf-65e5fc61cb57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:42.002819 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71ee49-f443-4e77-b8bf-65e5fc61cb57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:42.005447 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71ee49-f443-4e77-b8bf-65e5fc61cb57 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:42.021049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1338/2693] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:48:42.025600 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71ee49-f443-4e77-b8bf-65e5fc61cb57 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:42.031168 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782f5d3-a762-4922-a2c3-52ba56e34baf admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:42.038549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ecf31-a359-4690-b8aa-77af73d35d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:42.039591 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ecf31-a359-4690-b8aa-77af73d35d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:42.040062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ecf31-a359-4690-b8aa-77af73d35d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:42.040546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ecf31-a359-4690-b8aa-77af73d35d02 admin admin] PATH_INFO: `/v3/projects/947e95254f194186bd2efbb1641f89fc` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:42.042693 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ecf31-a359-4690-b8aa-77af73d35d02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=947e95254f194186bd2efbb1641f89fc)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:42.043631 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71ee49-f443-4e77-b8bf-65e5fc61cb57 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:42.046280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ecf31-a359-4690-b8aa-77af73d35d02 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:42.052452 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb11d39-62b8-4df7-9ea2-1d200d4d458e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:42.058361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb11d39-62b8-4df7-9ea2-1d200d4d458e admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:42.059609 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb11d39-62b8-4df7-9ea2-1d200d4d458e admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:42.060313 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb11d39-62b8-4df7-9ea2-1d200d4d458e admin admin] PATH_INFO: `/v3/projects/5adfbc3a35ea46b8a6ee07802544a7a9/users/406b270331db446faaf9c55f0f37ac96/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:42.085098 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb11d39-62b8-4df7-9ea2-1d200d4d458e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5adfbc3a35ea46b8a6ee07802544a7a9, user_id=406b270331db446faaf9c55f0f37ac96, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:42.091465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb11d39-62b8-4df7-9ea2-1d200d4d458e admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:42.110433 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1339/2694] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:42 2022] PUT /identity/v3/projects/5adfbc3a35ea46b8a6ee07802544a7a9/users/406b270331db446faaf9c55f0f37ac96/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:48:42.115769 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb11d39-62b8-4df7-9ea2-1d200d4d458e admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:42.119671 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7c6ecf31-a359-4690-b8aa-77af73d35d02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '947e95254f194186bd2efbb1641f89fc', 'request_id': 'req-7c6ecf31-a359-4690-b8aa-77af73d35d02'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:42.129849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7c6ecf31-a359-4690-b8aa-77af73d35d02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '947e95254f194186bd2efbb1641f89fc', 'request_id': 'req-7c6ecf31-a359-4690-b8aa-77af73d35d02'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:42.138840 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7c6ecf31-a359-4690-b8aa-77af73d35d02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '947e95254f194186bd2efbb1641f89fc', 'request_id': 'req-7c6ecf31-a359-4690-b8aa-77af73d35d02'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:42.160089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7c6ecf31-a359-4690-b8aa-77af73d35d02 admin admin] The token cache is being invalidate because project 947e95254f194186bd2efbb1641f89fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:48:42.160516 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7c6ecf31-a359-4690-b8aa-77af73d35d02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:42.161640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7c6ecf31-a359-4690-b8aa-77af73d35d02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:42.164457 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1356/2695] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:48:41 2022] DELETE /identity/v3/projects/947e95254f194186bd2efbb1641f89fc => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:42.171666 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22293746-f88d-41a0-adcc-32551cc5c597 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:42.172127 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22293746-f88d-41a0-adcc-32551cc5c597 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:42.173695 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22293746-f88d-41a0-adcc-32551cc5c597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:42.202041 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-22293746-f88d-41a0-adcc-32551cc5c597 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:42.203543 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-22293746-f88d-41a0-adcc-32551cc5c597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:42.221127 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb11d39-62b8-4df7-9ea2-1d200d4d458e admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:42.226784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64ddc0-5b3f-43f1-8734-318114c8dc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:42.227499 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64ddc0-5b3f-43f1-8734-318114c8dc7c admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:42.228545 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64ddc0-5b3f-43f1-8734-318114c8dc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:42.228545 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64ddc0-5b3f-43f1-8734-318114c8dc7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:42.229586 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64ddc0-5b3f-43f1-8734-318114c8dc7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:42.231701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64ddc0-5b3f-43f1-8734-318114c8dc7c admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:42.250439 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1340/2696] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:42.251788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64ddc0-5b3f-43f1-8734-318114c8dc7c admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:42.255244 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-de64ddc0-5b3f-43f1-8734-318114c8dc7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:42.272740 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64ddc0-5b3f-43f1-8734-318114c8dc7c admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:42.279788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc88e2-ab3f-4785-b948-dc6a155abde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:42.280932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc88e2-ab3f-4785-b948-dc6a155abde5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:42.281480 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc88e2-ab3f-4785-b948-dc6a155abde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:42.281940 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc88e2-ab3f-4785-b948-dc6a155abde5 admin admin] PATH_INFO: `/v3/projects/5adfbc3a35ea46b8a6ee07802544a7a9/users/406b270331db446faaf9c55f0f37ac96/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:42.285408 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc88e2-ab3f-4785-b948-dc6a155abde5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5adfbc3a35ea46b8a6ee07802544a7a9, user_id=406b270331db446faaf9c55f0f37ac96, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:42.290578 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc88e2-ab3f-4785-b948-dc6a155abde5 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:42.292394 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1357/2697] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:48:42.304854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbadf7d-5b0e-4d6f-9452-8a19c85400db None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:42.305155 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbadf7d-5b0e-4d6f-9452-8a19c85400db None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:42.305568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbadf7d-5b0e-4d6f-9452-8a19c85400db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:42.324220 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1341/2698] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:42 2022] PUT /identity/v3/projects/5adfbc3a35ea46b8a6ee07802544a7a9/users/406b270331db446faaf9c55f0f37ac96/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:48:42.330357 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5143437-35e2-414c-ba12-ca7c99f90b37 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:42.330744 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5143437-35e2-414c-ba12-ca7c99f90b37 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:42.331240 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5143437-35e2-414c-ba12-ca7c99f90b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:42.338188 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-dfbadf7d-5b0e-4d6f-9452-8a19c85400db None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:42.340537 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-dfbadf7d-5b0e-4d6f-9452-8a19c85400db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:42.381923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-f5143437-35e2-414c-ba12-ca7c99f90b37 None None] MFA Rules not processed for user `406b270331db446faaf9c55f0f37ac96`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:42.384153 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f5143437-35e2-414c-ba12-ca7c99f90b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:42.423889 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1358/2699] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:48:42.428670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbadf7d-5b0e-4d6f-9452-8a19c85400db None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:42.440659 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbadf7d-5b0e-4d6f-9452-8a19c85400db None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:42.446674 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e9988-406f-4bba-9575-fd35f88162ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:42.447313 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e9988-406f-4bba-9575-fd35f88162ec admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:42.447592 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e9988-406f-4bba-9575-fd35f88162ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:42.447866 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e9988-406f-4bba-9575-fd35f88162ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:42.448594 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e9988-406f-4bba-9575-fd35f88162ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:48:42.448903 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e9988-406f-4bba-9575-fd35f88162ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:42.450562 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e9988-406f-4bba-9575-fd35f88162ec admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:42.454326 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:42.475380 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1359/2700] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:48:42.477035 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e9988-406f-4bba-9575-fd35f88162ec admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:42.492562 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:42.495639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e9988-406f-4bba-9575-fd35f88162ec admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:42.504780 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d79d1b-f2bb-4a84-be4d-9b566f590a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:42.505935 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d79d1b-f2bb-4a84-be4d-9b566f590a0b admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:42.506346 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d79d1b-f2bb-4a84-be4d-9b566f590a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:42.506346 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d79d1b-f2bb-4a84-be4d-9b566f590a0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:42.506346 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d79d1b-f2bb-4a84-be4d-9b566f590a0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:42.511718 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d79d1b-f2bb-4a84-be4d-9b566f590a0b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:42.520757 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1342/2701] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:48:42.535845 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5143437-35e2-414c-ba12-ca7c99f90b37 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:42.538191 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f5143437-35e2-414c-ba12-ca7c99f90b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:42.552087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1360/2702] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:48:42 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:48:42.556365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d79d1b-f2bb-4a84-be4d-9b566f590a0b admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:42.637697 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5143437-35e2-414c-ba12-ca7c99f90b37 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:42.656347 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d79d1b-f2bb-4a84-be4d-9b566f590a0b admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:42.662673 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569bc6c-906c-4056-81aa-919e56939ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:42.663496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569bc6c-906c-4056-81aa-919e56939ffa admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:42.663885 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569bc6c-906c-4056-81aa-919e56939ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:42.664337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569bc6c-906c-4056-81aa-919e56939ffa admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:42.665104 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569bc6c-906c-4056-81aa-919e56939ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:42.667368 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569bc6c-906c-4056-81aa-919e56939ffa admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:42.697305 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1361/2703] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:48:42 2022] POST /identity/v3/users => generated 291 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:48:42.699569 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d61de1-999b-45d1-b4cb-ae99ea760de4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:42.700436 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d61de1-999b-45d1-b4cb-ae99ea760de4 service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:42.700714 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d61de1-999b-45d1-b4cb-ae99ea760de4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:42.700986 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d61de1-999b-45d1-b4cb-ae99ea760de4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:42.703772 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a4d61de1-999b-45d1-b4cb-ae99ea760de4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:42.704021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569bc6c-906c-4056-81aa-919e56939ffa admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:42.721834 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569bc6c-906c-4056-81aa-919e56939ffa admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:42.728306 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd5dd6-662b-4994-93c5-9a4857bb2cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:42.729125 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd5dd6-662b-4994-93c5-9a4857bb2cbc admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:42.729534 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd5dd6-662b-4994-93c5-9a4857bb2cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:42.729994 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd5dd6-662b-4994-93c5-9a4857bb2cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:42.731070 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd5dd6-662b-4994-93c5-9a4857bb2cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:42.734143 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd5dd6-662b-4994-93c5-9a4857bb2cbc admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:42.749563 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1362/2704] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:48:42.754751 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd5dd6-662b-4994-93c5-9a4857bb2cbc admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:42.768854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd5dd6-662b-4994-93c5-9a4857bb2cbc admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:42.774894 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c104df9-d7a8-47a4-b730-317d4268134b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:42.775884 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c104df9-d7a8-47a4-b730-317d4268134b admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:42.776296 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c104df9-d7a8-47a4-b730-317d4268134b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:42.776665 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c104df9-d7a8-47a4-b730-317d4268134b admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:42.777409 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c104df9-d7a8-47a4-b730-317d4268134b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:42.779921 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c104df9-d7a8-47a4-b730-317d4268134b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:42.792276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d61de1-999b-45d1-b4cb-ae99ea760de4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:42.794234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d61de1-999b-45d1-b4cb-ae99ea760de4 service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:42.795646 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1363/2705] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:48:42.801359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c104df9-d7a8-47a4-b730-317d4268134b admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:42.812788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1343/2706] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:48:42.815365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c104df9-d7a8-47a4-b730-317d4268134b admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:42.821735 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d2aed-bca2-4faf-8a57-c48f449c9512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:42.822702 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d2aed-bca2-4faf-8a57-c48f449c9512 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:42.823197 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d2aed-bca2-4faf-8a57-c48f449c9512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:42.823656 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d2aed-bca2-4faf-8a57-c48f449c9512 admin admin] PATH_INFO: `/v3/projects/5bfe0b58f3f54743a35aea69d8a959c2/users/c5eb1ef146b9451b9aa6f230bd331424/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:42.997425 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d2aed-bca2-4faf-8a57-c48f449c9512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bfe0b58f3f54743a35aea69d8a959c2, user_id=c5eb1ef146b9451b9aa6f230bd331424, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:43.003223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d2aed-bca2-4faf-8a57-c48f449c9512 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:43.044397 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1364/2707] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:42 2022] PUT /identity/v3/projects/5bfe0b58f3f54743a35aea69d8a959c2/users/c5eb1ef146b9451b9aa6f230bd331424/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:48:43.063252 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e3a42-5431-4520-84e3-addc0f3536f8 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:43.064133 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e3a42-5431-4520-84e3-addc0f3536f8 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:43.064133 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e3a42-5431-4520-84e3-addc0f3536f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:43.139506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-171e3a42-5431-4520-84e3-addc0f3536f8 None None] MFA Rules not processed for user `c5eb1ef146b9451b9aa6f230bd331424`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:43.144606 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-171e3a42-5431-4520-84e3-addc0f3536f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:43.270984 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=100 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:43.293699 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1344/2708] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:48:43.312881 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d2aed-bca2-4faf-8a57-c48f449c9512 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:43.431553 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d2aed-bca2-4faf-8a57-c48f449c9512 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:43.440121 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e2d18-b441-490e-abad-8219dd053531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:43.441281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e2d18-b441-490e-abad-8219dd053531 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:43.441825 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e2d18-b441-490e-abad-8219dd053531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:43.442338 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e2d18-b441-490e-abad-8219dd053531 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:43.443706 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e2d18-b441-490e-abad-8219dd053531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:43.447511 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e2d18-b441-490e-abad-8219dd053531 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:43.502901 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1365/2709] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:48:43 2022] POST /identity/v3/projects => generated 381 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:48:43.508051 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e3a42-5431-4520-84e3-addc0f3536f8 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:43.526445 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e3a42-5431-4520-84e3-addc0f3536f8 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:43.619857 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0d72a-e0aa-4dc7-841f-aaa1ff7af552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:43.620588 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0d72a-e0aa-4dc7-841f-aaa1ff7af552 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:43.620971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0d72a-e0aa-4dc7-841f-aaa1ff7af552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:43.621375 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0d72a-e0aa-4dc7-841f-aaa1ff7af552 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:43.622152 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0d72a-e0aa-4dc7-841f-aaa1ff7af552 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:43.625284 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0d72a-e0aa-4dc7-841f-aaa1ff7af552 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:43.656684 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1345/2710] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:48:43 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:48:43.661733 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e2d18-b441-490e-abad-8219dd053531 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:43.668536 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:43.677532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e2d18-b441-490e-abad-8219dd053531 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:43.685053 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdbcda-027c-481a-baf3-f519935e13c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:43.685954 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdbcda-027c-481a-baf3-f519935e13c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:43.686408 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdbcda-027c-481a-baf3-f519935e13c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:43.686762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdbcda-027c-481a-baf3-f519935e13c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:43.688171 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdbcda-027c-481a-baf3-f519935e13c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:43.692820 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdbcda-027c-481a-baf3-f519935e13c2 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:43.713110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1366/2711] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:43.724210 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0d72a-e0aa-4dc7-841f-aaa1ff7af552 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:43.732791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0d72a-e0aa-4dc7-841f-aaa1ff7af552 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:43.739154 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fd31b-a682-4f6c-a310-c7a752140d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:43.740073 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fd31b-a682-4f6c-a310-c7a752140d7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:43.740528 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fd31b-a682-4f6c-a310-c7a752140d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:43.740926 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fd31b-a682-4f6c-a310-c7a752140d7e admin admin] PATH_INFO: `/v3/projects/0acf3c64270740b5a2d616bfa5ad9f5c/users/dea8d80cb3d9457197c9a1fe05dbe4eb/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:43.773125 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fd31b-a682-4f6c-a310-c7a752140d7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0acf3c64270740b5a2d616bfa5ad9f5c, user_id=dea8d80cb3d9457197c9a1fe05dbe4eb, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:43.779537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fd31b-a682-4f6c-a310-c7a752140d7e admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:43.807735 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1346/2712] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:43 2022] PUT /identity/v3/projects/0acf3c64270740b5a2d616bfa5ad9f5c/users/dea8d80cb3d9457197c9a1fe05dbe4eb/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:43.814653 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdbcda-027c-481a-baf3-f519935e13c2 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:43.832892 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdbcda-027c-481a-baf3-f519935e13c2 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:43.948215 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca40d1-bb78-4453-92c9-026e5c0e8ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:43.949292 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca40d1-bb78-4453-92c9-026e5c0e8ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:43.949798 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca40d1-bb78-4453-92c9-026e5c0e8ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:43.950298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca40d1-bb78-4453-92c9-026e5c0e8ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:43.951518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca40d1-bb78-4453-92c9-026e5c0e8ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:43.954903 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca40d1-bb78-4453-92c9-026e5c0e8ca6 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:43.978376 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1367/2713] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:43.984270 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fd31b-a682-4f6c-a310-c7a752140d7e admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:44.003438 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fd31b-a682-4f6c-a310-c7a752140d7e admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:44.011773 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2ee2c-660e-4fa7-b863-009236d95205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:44.013005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2ee2c-660e-4fa7-b863-009236d95205 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:44.013445 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2ee2c-660e-4fa7-b863-009236d95205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:44.013886 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2ee2c-660e-4fa7-b863-009236d95205 admin admin] PATH_INFO: `/v3/projects/0acf3c64270740b5a2d616bfa5ad9f5c/users/dea8d80cb3d9457197c9a1fe05dbe4eb/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:44.017730 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2ee2c-660e-4fa7-b863-009236d95205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0acf3c64270740b5a2d616bfa5ad9f5c, user_id=dea8d80cb3d9457197c9a1fe05dbe4eb, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:44.023485 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2ee2c-660e-4fa7-b863-009236d95205 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:44.044170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1347/2714] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:43 2022] PUT /identity/v3/projects/0acf3c64270740b5a2d616bfa5ad9f5c/users/dea8d80cb3d9457197c9a1fe05dbe4eb/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:48:44.062330 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde265bc-8a16-4c11-a5cc-e9ad79190074 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:44.062705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde265bc-8a16-4c11-a5cc-e9ad79190074 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:44.063129 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde265bc-8a16-4c11-a5cc-e9ad79190074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:44.113225 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-fde265bc-8a16-4c11-a5cc-e9ad79190074 None None] MFA Rules not processed for user `dea8d80cb3d9457197c9a1fe05dbe4eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:44.115454 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fde265bc-8a16-4c11-a5cc-e9ad79190074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:44.259812 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1368/2715] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:44.277603 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2ee2c-660e-4fa7-b863-009236d95205 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:44.376020 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2ee2c-660e-4fa7-b863-009236d95205 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:44.381236 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa71c16-9ffe-4f47-8cda-7068d5970f6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:44.381973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa71c16-9ffe-4f47-8cda-7068d5970f6c service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:44.382393 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa71c16-9ffe-4f47-8cda-7068d5970f6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:44.382788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa71c16-9ffe-4f47-8cda-7068d5970f6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:44.396998 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa71c16-9ffe-4f47-8cda-7068d5970f6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:44.400264 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa71c16-9ffe-4f47-8cda-7068d5970f6c service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:44.421531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1348/2716] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:44 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:48:44.792450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde265bc-8a16-4c11-a5cc-e9ad79190074 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:44.814120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde265bc-8a16-4c11-a5cc-e9ad79190074 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:44.821047 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ac157-9b1f-4f8a-b9e9-32a3a5960779 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:44.822158 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ac157-9b1f-4f8a-b9e9-32a3a5960779 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:44.822494 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ac157-9b1f-4f8a-b9e9-32a3a5960779 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:44.822940 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ac157-9b1f-4f8a-b9e9-32a3a5960779 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:44.826248 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-753ac157-9b1f-4f8a-b9e9-32a3a5960779 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:44.938222 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ac157-9b1f-4f8a-b9e9-32a3a5960779 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:44.941669 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ac157-9b1f-4f8a-b9e9-32a3a5960779 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:44.968337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1369/2717] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:48:45.045844 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa71c16-9ffe-4f47-8cda-7068d5970f6c service cinder] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:45.057792 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa71c16-9ffe-4f47-8cda-7068d5970f6c service cinder] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:45.066850 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b37cb-6f7b-4a6c-86c3-564df9533a6e tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea8d80cb3d9457197c9a1fe05dbe4eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0acf3c64270740b5a2d616bfa5ad9f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:45.067802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b37cb-6f7b-4a6c-86c3-564df9533a6e tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:45.068302 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b37cb-6f7b-4a6c-86c3-564df9533a6e tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:45.068753 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b37cb-6f7b-4a6c-86c3-564df9533a6e tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:45.069813 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b37cb-6f7b-4a6c-86c3-564df9533a6e tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:48:45.070330 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b37cb-6f7b-4a6c-86c3-564df9533a6e tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:45.073198 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b37cb-6f7b-4a6c-86c3-564df9533a6e tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:45.098173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1349/2718] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:48:45.099979 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ac157-9b1f-4f8a-b9e9-32a3a5960779 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:45.118536 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ac157-9b1f-4f8a-b9e9-32a3a5960779 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:45.126731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f908bc3-231c-4e16-8c40-bf9248902398 tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea8d80cb3d9457197c9a1fe05dbe4eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0acf3c64270740b5a2d616bfa5ad9f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:45.127499 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f908bc3-231c-4e16-8c40-bf9248902398 tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:45.127995 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f908bc3-231c-4e16-8c40-bf9248902398 tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:45.128477 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f908bc3-231c-4e16-8c40-bf9248902398 tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:45.129538 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f908bc3-231c-4e16-8c40-bf9248902398 tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:45.132971 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f908bc3-231c-4e16-8c40-bf9248902398 tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:45.150496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:45.198099 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1370/2719] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:48:45 2022] POST /identity/v3/projects => generated 354 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:48:45.199643 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b37cb-6f7b-4a6c-86c3-564df9533a6e tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:45.216144 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b37cb-6f7b-4a6c-86c3-564df9533a6e tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:45.271601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:45.308023 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91133a3-b4cc-4e37-930d-7a30c67213ea tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea8d80cb3d9457197c9a1fe05dbe4eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0acf3c64270740b5a2d616bfa5ad9f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:45.309163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91133a3-b4cc-4e37-930d-7a30c67213ea tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:45.309163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91133a3-b4cc-4e37-930d-7a30c67213ea tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:45.309514 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91133a3-b4cc-4e37-930d-7a30c67213ea tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:45.310027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91133a3-b4cc-4e37-930d-7a30c67213ea tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:48:45.310295 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91133a3-b4cc-4e37-930d-7a30c67213ea tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:45.312168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91133a3-b4cc-4e37-930d-7a30c67213ea tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:45.332656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1350/2720] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:48:45.376968 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f908bc3-231c-4e16-8c40-bf9248902398 tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:45.389888 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f908bc3-231c-4e16-8c40-bf9248902398 tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:45.396074 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddcde64-7699-459b-9175-9f469c6b4634 tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea8d80cb3d9457197c9a1fe05dbe4eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0acf3c64270740b5a2d616bfa5ad9f5c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:45.396976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcde64-7699-459b-9175-9f469c6b4634 tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:45.397373 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcde64-7699-459b-9175-9f469c6b4634 tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:45.397781 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcde64-7699-459b-9175-9f469c6b4634 tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] PATH_INFO: `/v3/projects/4fd844b973b949dea194b9c567051941` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:45.399328 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddcde64-7699-459b-9175-9f469c6b4634 tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4fd844b973b949dea194b9c567051941)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:45.401860 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddcde64-7699-459b-9175-9f469c6b4634 tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:45.469046 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0ddcde64-7699-459b-9175-9f469c6b4634 tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd844b973b949dea194b9c567051941', 'request_id': 'req-0ddcde64-7699-459b-9175-9f469c6b4634'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:45.477090 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0ddcde64-7699-459b-9175-9f469c6b4634 tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd844b973b949dea194b9c567051941', 'request_id': 'req-0ddcde64-7699-459b-9175-9f469c6b4634'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:45.484211 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0ddcde64-7699-459b-9175-9f469c6b4634 tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd844b973b949dea194b9c567051941', 'request_id': 'req-0ddcde64-7699-459b-9175-9f469c6b4634'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:45.504864 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0ddcde64-7699-459b-9175-9f469c6b4634 tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] The token cache is being invalidate because project 4fd844b973b949dea194b9c567051941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:48:45.504864 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0ddcde64-7699-459b-9175-9f469c6b4634 tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:45.505582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-0ddcde64-7699-459b-9175-9f469c6b4634 tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:45.507578 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1371/2721] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:48:45 2022] DELETE /identity/v3/projects/4fd844b973b949dea194b9c567051941 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:45.829103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91133a3-b4cc-4e37-930d-7a30c67213ea tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:45.831153 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-e91133a3-b4cc-4e37-930d-7a30c67213ea tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:45.884945 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddcde64-7699-459b-9175-9f469c6b4634 tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:45.886521 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0ddcde64-7699-459b-9175-9f469c6b4634 tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:45.949379 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91133a3-b4cc-4e37-930d-7a30c67213ea tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:45.968091 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddcde64-7699-459b-9175-9f469c6b4634 tempest-VolumeQuotaClassesTest-1776686842 tempest-VolumeQuotaClassesTest-1776686842-project-admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:45.973942 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258520c-7d0a-4f4d-abfe-960db1d229d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:45.973942 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258520c-7d0a-4f4d-abfe-960db1d229d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:45.974418 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258520c-7d0a-4f4d-abfe-960db1d229d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:45.974418 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258520c-7d0a-4f4d-abfe-960db1d229d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:45.976646 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f258520c-7d0a-4f4d-abfe-960db1d229d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:46.048623 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167f9b6-0272-4135-b27d-d15e78df646d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:46.050710 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167f9b6-0272-4135-b27d-d15e78df646d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:46.051225 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167f9b6-0272-4135-b27d-d15e78df646d admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:46.051840 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167f9b6-0272-4135-b27d-d15e78df646d admin admin] PATH_INFO: `/v3/users/c5eb1ef146b9451b9aa6f230bd331424` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:46.054709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167f9b6-0272-4135-b27d-d15e78df646d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5eb1ef146b9451b9aa6f230bd331424)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:46.058165 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167f9b6-0272-4135-b27d-d15e78df646d admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:46.062109 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258520c-7d0a-4f4d-abfe-960db1d229d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:46.063602 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258520c-7d0a-4f4d-abfe-960db1d229d6 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:46.080400 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1372/2722] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:45 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:48:46.148412 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6167f9b6-0272-4135-b27d-d15e78df646d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5eb1ef146b9451b9aa6f230bd331424'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:46.163727 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6167f9b6-0272-4135-b27d-d15e78df646d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5eb1ef146b9451b9aa6f230bd331424'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:46.195321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6167f9b6-0272-4135-b27d-d15e78df646d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5eb1ef146b9451b9aa6f230bd331424'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:46.197322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6167f9b6-0272-4135-b27d-d15e78df646d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5eb1ef146b9451b9aa6f230bd331424'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:46.197789 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6167f9b6-0272-4135-b27d-d15e78df646d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5eb1ef146b9451b9aa6f230bd331424'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:46.218350 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:46.234344 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1351/2723] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:48:45 2022] DELETE /identity/v3/users/c5eb1ef146b9451b9aa6f230bd331424 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:48:46.240601 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569c3e3-2b7e-4c11-b65c-66e131724e71 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:46.240901 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569c3e3-2b7e-4c11-b65c-66e131724e71 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:46.241178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569c3e3-2b7e-4c11-b65c-66e131724e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:46.274317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-1569c3e3-2b7e-4c11-b65c-66e131724e71 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:46.274317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1569c3e3-2b7e-4c11-b65c-66e131724e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:46.293514 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:46.392324 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1373/2724] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:46.409834 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167f9b6-0272-4135-b27d-d15e78df646d admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:46.413016 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-6167f9b6-0272-4135-b27d-d15e78df646d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:46.548503 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167f9b6-0272-4135-b27d-d15e78df646d admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:46.556036 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a2189-fdf7-4628-8dd1-0a27dfe596f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:46.557173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a2189-fdf7-4628-8dd1-0a27dfe596f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:46.557774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a2189-fdf7-4628-8dd1-0a27dfe596f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:46.558358 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a2189-fdf7-4628-8dd1-0a27dfe596f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:46.584457 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a2189-fdf7-4628-8dd1-0a27dfe596f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:46.587159 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a2189-fdf7-4628-8dd1-0a27dfe596f9 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:46.607518 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1352/2725] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:48:47.076640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569c3e3-2b7e-4c11-b65c-66e131724e71 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:47.079237 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1569c3e3-2b7e-4c11-b65c-66e131724e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:47.101240 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569c3e3-2b7e-4c11-b65c-66e131724e71 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:47.112782 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385b763-6b01-4ea2-8f77-0ea438c1ac70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:47.113961 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385b763-6b01-4ea2-8f77-0ea438c1ac70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:47.114566 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385b763-6b01-4ea2-8f77-0ea438c1ac70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:47.115061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385b763-6b01-4ea2-8f77-0ea438c1ac70 admin admin] PATH_INFO: `/v3/projects/5bfe0b58f3f54743a35aea69d8a959c2` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:47.117467 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385b763-6b01-4ea2-8f77-0ea438c1ac70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bfe0b58f3f54743a35aea69d8a959c2)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:47.121207 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385b763-6b01-4ea2-8f77-0ea438c1ac70 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:47.239631 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1385b763-6b01-4ea2-8f77-0ea438c1ac70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bfe0b58f3f54743a35aea69d8a959c2', 'request_id': 'req-1385b763-6b01-4ea2-8f77-0ea438c1ac70'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:47.255269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1385b763-6b01-4ea2-8f77-0ea438c1ac70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bfe0b58f3f54743a35aea69d8a959c2', 'request_id': 'req-1385b763-6b01-4ea2-8f77-0ea438c1ac70'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:47.273214 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1385b763-6b01-4ea2-8f77-0ea438c1ac70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bfe0b58f3f54743a35aea69d8a959c2', 'request_id': 'req-1385b763-6b01-4ea2-8f77-0ea438c1ac70'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:47.303345 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1385b763-6b01-4ea2-8f77-0ea438c1ac70 admin admin] The token cache is being invalidate because project 5bfe0b58f3f54743a35aea69d8a959c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:48:47.303848 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1385b763-6b01-4ea2-8f77-0ea438c1ac70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:47.305344 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-1385b763-6b01-4ea2-8f77-0ea438c1ac70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:47.308788 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1374/2726] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:48:47 2022] DELETE /identity/v3/projects/5bfe0b58f3f54743a35aea69d8a959c2 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:48:47.315672 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a2189-fdf7-4628-8dd1-0a27dfe596f9 service neutron] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:47.342660 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a2189-fdf7-4628-8dd1-0a27dfe596f9 service neutron] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:47.442665 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d411f9e-04dc-4126-81c3-812dafe06520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:47.443702 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d411f9e-04dc-4126-81c3-812dafe06520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:47.443865 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d411f9e-04dc-4126-81c3-812dafe06520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:47.444030 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d411f9e-04dc-4126-81c3-812dafe06520 admin admin] PATH_INFO: `/v3/users/dea8d80cb3d9457197c9a1fe05dbe4eb` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:47.445376 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d411f9e-04dc-4126-81c3-812dafe06520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dea8d80cb3d9457197c9a1fe05dbe4eb)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:47.447788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d411f9e-04dc-4126-81c3-812dafe06520 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:47.543877 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9d411f9e-04dc-4126-81c3-812dafe06520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dea8d80cb3d9457197c9a1fe05dbe4eb'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:47.558606 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9d411f9e-04dc-4126-81c3-812dafe06520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dea8d80cb3d9457197c9a1fe05dbe4eb'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:47.583197 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9d411f9e-04dc-4126-81c3-812dafe06520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dea8d80cb3d9457197c9a1fe05dbe4eb'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:47.584725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9d411f9e-04dc-4126-81c3-812dafe06520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dea8d80cb3d9457197c9a1fe05dbe4eb'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:47.586222 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-9d411f9e-04dc-4126-81c3-812dafe06520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dea8d80cb3d9457197c9a1fe05dbe4eb'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:47.606949 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1353/2727] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:48:47 2022] DELETE /identity/v3/users/dea8d80cb3d9457197c9a1fe05dbe4eb => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:48.101146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385b763-6b01-4ea2-8f77-0ea438c1ac70 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:48.103898 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1385b763-6b01-4ea2-8f77-0ea438c1ac70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:48.129132 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385b763-6b01-4ea2-8f77-0ea438c1ac70 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:48.256249 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141e87b-38b5-43d5-b0a5-be2ec511252c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:48.256956 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141e87b-38b5-43d5-b0a5-be2ec511252c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:48.257261 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141e87b-38b5-43d5-b0a5-be2ec511252c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:48.257536 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141e87b-38b5-43d5-b0a5-be2ec511252c admin admin] PATH_INFO: `/v3/projects/0acf3c64270740b5a2d616bfa5ad9f5c` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:48.259491 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141e87b-38b5-43d5-b0a5-be2ec511252c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0acf3c64270740b5a2d616bfa5ad9f5c)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:48.263803 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141e87b-38b5-43d5-b0a5-be2ec511252c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:48.330762 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:48.333178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5141e87b-38b5-43d5-b0a5-be2ec511252c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0acf3c64270740b5a2d616bfa5ad9f5c', 'request_id': 'req-5141e87b-38b5-43d5-b0a5-be2ec511252c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:48.341994 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5141e87b-38b5-43d5-b0a5-be2ec511252c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0acf3c64270740b5a2d616bfa5ad9f5c', 'request_id': 'req-5141e87b-38b5-43d5-b0a5-be2ec511252c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:48.349439 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5141e87b-38b5-43d5-b0a5-be2ec511252c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0acf3c64270740b5a2d616bfa5ad9f5c', 'request_id': 'req-5141e87b-38b5-43d5-b0a5-be2ec511252c'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:48.365755 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5141e87b-38b5-43d5-b0a5-be2ec511252c admin admin] The token cache is being invalidate because project 0acf3c64270740b5a2d616bfa5ad9f5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:48:48.366045 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5141e87b-38b5-43d5-b0a5-be2ec511252c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:48.366722 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5141e87b-38b5-43d5-b0a5-be2ec511252c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:48.368312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1375/2728] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:48:48 2022] DELETE /identity/v3/projects/0acf3c64270740b5a2d616bfa5ad9f5c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:48:48.374767 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca4b78-d36b-4425-8cfe-e92aa5665e8b None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:48.375263 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca4b78-d36b-4425-8cfe-e92aa5665e8b None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:48.375743 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca4b78-d36b-4425-8cfe-e92aa5665e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:48.411322 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-a9ca4b78-d36b-4425-8cfe-e92aa5665e8b None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:48.413559 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a9ca4b78-d36b-4425-8cfe-e92aa5665e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:48.439047 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:48.535650 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1354/2729] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:48.545810 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af5458-b921-47fa-9722-922c3b7d27eb None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:48.546270 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af5458-b921-47fa-9722-922c3b7d27eb None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:48.546784 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af5458-b921-47fa-9722-922c3b7d27eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:48.572978 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-39af5458-b921-47fa-9722-922c3b7d27eb None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:48.574463 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-39af5458-b921-47fa-9722-922c3b7d27eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:48.583679 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1376/2730] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:48.589430 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca4b78-d36b-4425-8cfe-e92aa5665e8b None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:48.607392 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca4b78-d36b-4425-8cfe-e92aa5665e8b None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:48.615835 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c0fb3-4138-4097-b81c-27c8877381f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:48.616743 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c0fb3-4138-4097-b81c-27c8877381f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:48.617120 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c0fb3-4138-4097-b81c-27c8877381f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:48.617488 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c0fb3-4138-4097-b81c-27c8877381f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:48.618388 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c0fb3-4138-4097-b81c-27c8877381f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:48:48.618794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c0fb3-4138-4097-b81c-27c8877381f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:48.620825 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c0fb3-4138-4097-b81c-27c8877381f6 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:48.636922 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1355/2731] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:48:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:48:48.644362 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af5458-b921-47fa-9722-922c3b7d27eb None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:48.656329 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af5458-b921-47fa-9722-922c3b7d27eb None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:48.661912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86933bea-c295-40c0-aa1a-2a23e4e87fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:48.662672 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86933bea-c295-40c0-aa1a-2a23e4e87fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:48.663061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86933bea-c295-40c0-aa1a-2a23e4e87fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:48.663432 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86933bea-c295-40c0-aa1a-2a23e4e87fe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:48.664232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86933bea-c295-40c0-aa1a-2a23e4e87fe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:48.666587 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86933bea-c295-40c0-aa1a-2a23e4e87fe2 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:48.702385 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1377/2732] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:48:48 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:48:48.707849 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c0fb3-4138-4097-b81c-27c8877381f6 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:48.720005 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c0fb3-4138-4097-b81c-27c8877381f6 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:48.818970 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c0d65-ab14-4a31-afba-01bbd3185b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:48.819604 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c0d65-ab14-4a31-afba-01bbd3185b8b admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:48.819881 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c0d65-ab14-4a31-afba-01bbd3185b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:48.820152 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c0d65-ab14-4a31-afba-01bbd3185b8b admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:48.820837 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c0d65-ab14-4a31-afba-01bbd3185b8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:48.822831 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c0d65-ab14-4a31-afba-01bbd3185b8b admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:48.857370 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1356/2733] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:48:48 2022] POST /identity/v3/users => generated 283 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:48:48.865302 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86933bea-c295-40c0-aa1a-2a23e4e87fe2 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:48.883412 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86933bea-c295-40c0-aa1a-2a23e4e87fe2 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:48.892271 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d149b16-ec08-4531-ba7c-13c066a6edb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:48.893423 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d149b16-ec08-4531-ba7c-13c066a6edb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:48.893956 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d149b16-ec08-4531-ba7c-13c066a6edb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:48.894483 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d149b16-ec08-4531-ba7c-13c066a6edb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:48.895719 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d149b16-ec08-4531-ba7c-13c066a6edb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:48.898841 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d149b16-ec08-4531-ba7c-13c066a6edb4 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:48.916276 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1378/2734] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:48.922765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c0d65-ab14-4a31-afba-01bbd3185b8b admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:48.943739 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c0d65-ab14-4a31-afba-01bbd3185b8b admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:48.958199 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7af2d8-8e19-4384-a25e-f255c1f87a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:48.959423 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7af2d8-8e19-4384-a25e-f255c1f87a9b admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:48.960083 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7af2d8-8e19-4384-a25e-f255c1f87a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:48.960659 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7af2d8-8e19-4384-a25e-f255c1f87a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:48.961896 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7af2d8-8e19-4384-a25e-f255c1f87a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:48.965312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7af2d8-8e19-4384-a25e-f255c1f87a9b admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:48.988305 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1357/2735] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:49.000597 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d149b16-ec08-4531-ba7c-13c066a6edb4 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:49.016146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d149b16-ec08-4531-ba7c-13c066a6edb4 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:49.023632 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91025ed-5e93-4ca0-ac38-bfa2c42d1ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:49.024687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91025ed-5e93-4ca0-ac38-bfa2c42d1ad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:49.025035 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91025ed-5e93-4ca0-ac38-bfa2c42d1ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:49.025514 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91025ed-5e93-4ca0-ac38-bfa2c42d1ad0 admin admin] PATH_INFO: `/v3/projects/81ef49d7f52c49f9a80eb55b2eb7e54a/users/e1971edfb9f14b028089edf0dd9f33d1/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:49.047627 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91025ed-5e93-4ca0-ac38-bfa2c42d1ad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ef49d7f52c49f9a80eb55b2eb7e54a, user_id=e1971edfb9f14b028089edf0dd9f33d1, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:49.050825 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91025ed-5e93-4ca0-ac38-bfa2c42d1ad0 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:49.075278 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1379/2736] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:48 2022] PUT /identity/v3/projects/81ef49d7f52c49f9a80eb55b2eb7e54a/users/e1971edfb9f14b028089edf0dd9f33d1/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:49.096138 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d311a-f43a-4afd-a169-43748f85bd76 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:49.096678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d311a-f43a-4afd-a169-43748f85bd76 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:49.097174 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d311a-f43a-4afd-a169-43748f85bd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:49.154334 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-432d311a-f43a-4afd-a169-43748f85bd76 None None] MFA Rules not processed for user `e1971edfb9f14b028089edf0dd9f33d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:49.155647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-432d311a-f43a-4afd-a169-43748f85bd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:49.242140 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1358/2737] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:49.248009 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91025ed-5e93-4ca0-ac38-bfa2c42d1ad0 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:49.346474 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91025ed-5e93-4ca0-ac38-bfa2c42d1ad0 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:49.353051 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a25a12-a38a-4168-82f2-1cc473f0774a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:49.353681 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a25a12-a38a-4168-82f2-1cc473f0774a admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:49.354188 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a25a12-a38a-4168-82f2-1cc473f0774a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:49.354937 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a25a12-a38a-4168-82f2-1cc473f0774a admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:49.355737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a25a12-a38a-4168-82f2-1cc473f0774a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:49.357790 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a25a12-a38a-4168-82f2-1cc473f0774a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:49.397150 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1380/2738] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:48:49 2022] POST /identity/v3/projects => generated 365 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:48:49.403314 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d311a-f43a-4afd-a169-43748f85bd76 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:49.418130 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d311a-f43a-4afd-a169-43748f85bd76 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:49.435425 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:49.496501 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548793e-585c-470b-bd4b-c40795fc5202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:49.497134 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548793e-585c-470b-bd4b-c40795fc5202 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:49.497467 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548793e-585c-470b-bd4b-c40795fc5202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:49.497813 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548793e-585c-470b-bd4b-c40795fc5202 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:49.498584 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548793e-585c-470b-bd4b-c40795fc5202 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:49.500890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548793e-585c-470b-bd4b-c40795fc5202 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:49.531204 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1359/2739] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:48:49 2022] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:48:49.535594 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a25a12-a38a-4168-82f2-1cc473f0774a admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:49.551169 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a25a12-a38a-4168-82f2-1cc473f0774a admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:49.558657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72f16d-3240-43b7-b972-450e290f54ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:49.559588 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72f16d-3240-43b7-b972-450e290f54ce admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:49.559885 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72f16d-3240-43b7-b972-450e290f54ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:49.560222 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72f16d-3240-43b7-b972-450e290f54ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:49.561030 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72f16d-3240-43b7-b972-450e290f54ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:49.562601 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72f16d-3240-43b7-b972-450e290f54ce admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:49.575470 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1381/2740] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:48:49.581067 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548793e-585c-470b-bd4b-c40795fc5202 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:49.592907 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548793e-585c-470b-bd4b-c40795fc5202 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:49.598602 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222fdbf-ba34-4d9a-a364-6a752e2d073c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:49.599284 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222fdbf-ba34-4d9a-a364-6a752e2d073c admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:49.599563 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222fdbf-ba34-4d9a-a364-6a752e2d073c admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:49.599848 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222fdbf-ba34-4d9a-a364-6a752e2d073c admin admin] PATH_INFO: `/v3/projects/a8ea17788cb34c7abd2135e1f136ee63/users/9d1b736cbad64c1d87625898f3f57ad7/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:49.619508 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222fdbf-ba34-4d9a-a364-6a752e2d073c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8ea17788cb34c7abd2135e1f136ee63, user_id=9d1b736cbad64c1d87625898f3f57ad7, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:49.624236 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222fdbf-ba34-4d9a-a364-6a752e2d073c admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:49.642805 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1360/2741] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:49 2022] PUT /identity/v3/projects/a8ea17788cb34c7abd2135e1f136ee63/users/9d1b736cbad64c1d87625898f3f57ad7/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:49.647535 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72f16d-3240-43b7-b972-450e290f54ce admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:49.659615 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72f16d-3240-43b7-b972-450e290f54ce admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:49.721635 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:49.740332 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07db9c-9bb4-43e3-bfd7-630a48345c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:49.741153 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07db9c-9bb4-43e3-bfd7-630a48345c48 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:49.741524 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07db9c-9bb4-43e3-bfd7-630a48345c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:49.741994 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07db9c-9bb4-43e3-bfd7-630a48345c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:49.742829 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07db9c-9bb4-43e3-bfd7-630a48345c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:49.744929 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07db9c-9bb4-43e3-bfd7-630a48345c48 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:49.756409 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1382/2742] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:49.761059 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222fdbf-ba34-4d9a-a364-6a752e2d073c admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:49.773552 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222fdbf-ba34-4d9a-a364-6a752e2d073c admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:49.779131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237bf66-1271-402b-aed0-10e4d8095b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:49.780046 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237bf66-1271-402b-aed0-10e4d8095b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:49.780418 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237bf66-1271-402b-aed0-10e4d8095b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:49.780742 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237bf66-1271-402b-aed0-10e4d8095b94 admin admin] PATH_INFO: `/v3/projects/a8ea17788cb34c7abd2135e1f136ee63/users/9d1b736cbad64c1d87625898f3f57ad7/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:49.783134 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237bf66-1271-402b-aed0-10e4d8095b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8ea17788cb34c7abd2135e1f136ee63, user_id=9d1b736cbad64c1d87625898f3f57ad7, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:49.786234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237bf66-1271-402b-aed0-10e4d8095b94 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:49.799545 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1361/2743] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:49 2022] PUT /identity/v3/projects/a8ea17788cb34c7abd2135e1f136ee63/users/9d1b736cbad64c1d87625898f3f57ad7/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:48:49.812108 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53222d09-82e9-4935-b3a7-c2165c9b4a68 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:49.812770 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53222d09-82e9-4935-b3a7-c2165c9b4a68 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:49.813262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53222d09-82e9-4935-b3a7-c2165c9b4a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:49.866143 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-53222d09-82e9-4935-b3a7-c2165c9b4a68 None None] MFA Rules not processed for user `9d1b736cbad64c1d87625898f3f57ad7`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:49.868326 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-53222d09-82e9-4935-b3a7-c2165c9b4a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:50.001108 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1383/2744] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:49 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:50.014768 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237bf66-1271-402b-aed0-10e4d8095b94 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:50.016889 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-1237bf66-1271-402b-aed0-10e4d8095b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:50.089597 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237bf66-1271-402b-aed0-10e4d8095b94 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:50.093788 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee1dc0-0fcb-49e1-89b4-33dc078650bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:50.094471 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee1dc0-0fcb-49e1-89b4-33dc078650bc service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:50.094789 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee1dc0-0fcb-49e1-89b4-33dc078650bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:50.095098 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee1dc0-0fcb-49e1-89b4-33dc078650bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:50.106860 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee1dc0-0fcb-49e1-89b4-33dc078650bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:50.108405 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee1dc0-0fcb-49e1-89b4-33dc078650bc service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:50.122058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1362/2745] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:48:50.233797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53222d09-82e9-4935-b3a7-c2165c9b4a68 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:50.244707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53222d09-82e9-4935-b3a7-c2165c9b4a68 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:50.249165 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d610266-cdd5-42bc-9028-099ce0c17f03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:50.250231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d610266-cdd5-42bc-9028-099ce0c17f03 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:50.250231 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d610266-cdd5-42bc-9028-099ce0c17f03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:50.250581 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d610266-cdd5-42bc-9028-099ce0c17f03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:50.365123 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d610266-cdd5-42bc-9028-099ce0c17f03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:50.367985 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d610266-cdd5-42bc-9028-099ce0c17f03 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:50.386690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1384/2746] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:48:50.538237 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee1dc0-0fcb-49e1-89b4-33dc078650bc service cinder] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:50.540464 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-98ee1dc0-0fcb-49e1-89b4-33dc078650bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:50.650192 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee1dc0-0fcb-49e1-89b4-33dc078650bc service cinder] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:50.655712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbd531-aabf-49c2-90b2-d45e14dbebf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:50.656418 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbd531-aabf-49c2-90b2-d45e14dbebf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:50.656702 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbd531-aabf-49c2-90b2-d45e14dbebf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:50.656976 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbd531-aabf-49c2-90b2-d45e14dbebf1 admin admin] PATH_INFO: `/v3/users/77eb13e33fac4d8a9b4d242b83d32bef` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:50.658213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbbd531-aabf-49c2-90b2-d45e14dbebf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77eb13e33fac4d8a9b4d242b83d32bef)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:50.660260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbbd531-aabf-49c2-90b2-d45e14dbebf1 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:50.676476 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:50.735521 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-cfbbd531-aabf-49c2-90b2-d45e14dbebf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77eb13e33fac4d8a9b4d242b83d32bef'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:50.750907 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-cfbbd531-aabf-49c2-90b2-d45e14dbebf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77eb13e33fac4d8a9b4d242b83d32bef'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:50.777818 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-cfbbd531-aabf-49c2-90b2-d45e14dbebf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77eb13e33fac4d8a9b4d242b83d32bef'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:50.779088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-cfbbd531-aabf-49c2-90b2-d45e14dbebf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77eb13e33fac4d8a9b4d242b83d32bef'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:50.780387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-cfbbd531-aabf-49c2-90b2-d45e14dbebf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77eb13e33fac4d8a9b4d242b83d32bef'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:50.808920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1363/2747] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:48:50 2022] DELETE /identity/v3/users/77eb13e33fac4d8a9b4d242b83d32bef => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:50.813745 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef157be-6a34-42a5-aa66-4f8600147980 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:50.814663 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef157be-6a34-42a5-aa66-4f8600147980 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:50.814897 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef157be-6a34-42a5-aa66-4f8600147980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:50.853605 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-5ef157be-6a34-42a5-aa66-4f8600147980 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:50.855907 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5ef157be-6a34-42a5-aa66-4f8600147980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:50.948030 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1385/2748] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:48:50.959726 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbd531-aabf-49c2-90b2-d45e14dbebf1 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:50.961370 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-cfbbd531-aabf-49c2-90b2-d45e14dbebf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:51.031351 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbd531-aabf-49c2-90b2-d45e14dbebf1 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:51.035968 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021c226-274a-49ab-beb3-917ad1fab475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:51.036655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021c226-274a-49ab-beb3-917ad1fab475 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:51.036938 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021c226-274a-49ab-beb3-917ad1fab475 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:51.037213 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021c226-274a-49ab-beb3-917ad1fab475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:51.048071 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021c226-274a-49ab-beb3-917ad1fab475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:51.049616 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021c226-274a-49ab-beb3-917ad1fab475 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:51.061439 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1364/2749] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:48:51.478475 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef157be-6a34-42a5-aa66-4f8600147980 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:51.480267 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5ef157be-6a34-42a5-aa66-4f8600147980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:51.499973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef157be-6a34-42a5-aa66-4f8600147980 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:51.505699 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836d1a1-62e4-4aa0-aa74-e92d8b4c52ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:51.506415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836d1a1-62e4-4aa0-aa74-e92d8b4c52ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:51.506741 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836d1a1-62e4-4aa0-aa74-e92d8b4c52ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:51.507536 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836d1a1-62e4-4aa0-aa74-e92d8b4c52ee admin admin] PATH_INFO: `/v3/projects/b8262e4ce151427a959b91c2fae5992c` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:51.508941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836d1a1-62e4-4aa0-aa74-e92d8b4c52ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8262e4ce151427a959b91c2fae5992c)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:51.511996 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836d1a1-62e4-4aa0-aa74-e92d8b4c52ee admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:51.514834 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:51.602779 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e836d1a1-62e4-4aa0-aa74-e92d8b4c52ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8262e4ce151427a959b91c2fae5992c', 'request_id': 'req-e836d1a1-62e4-4aa0-aa74-e92d8b4c52ee'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:51.612367 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e836d1a1-62e4-4aa0-aa74-e92d8b4c52ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8262e4ce151427a959b91c2fae5992c', 'request_id': 'req-e836d1a1-62e4-4aa0-aa74-e92d8b4c52ee'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:51.624151 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e836d1a1-62e4-4aa0-aa74-e92d8b4c52ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8262e4ce151427a959b91c2fae5992c', 'request_id': 'req-e836d1a1-62e4-4aa0-aa74-e92d8b4c52ee'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:51.648691 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e836d1a1-62e4-4aa0-aa74-e92d8b4c52ee admin admin] The token cache is being invalidate because project b8262e4ce151427a959b91c2fae5992c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:48:51.649240 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e836d1a1-62e4-4aa0-aa74-e92d8b4c52ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:51.650258 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-e836d1a1-62e4-4aa0-aa74-e92d8b4c52ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:51.652946 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1386/2750] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:48:51 2022] DELETE /identity/v3/projects/b8262e4ce151427a959b91c2fae5992c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:48:51.659622 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021c226-274a-49ab-beb3-917ad1fab475 service neutron] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:51.678133 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021c226-274a-49ab-beb3-917ad1fab475 service neutron] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:51.779073 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820bbfa-6503-47f6-91c8-7f748a3d5cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:51.779878 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820bbfa-6503-47f6-91c8-7f748a3d5cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:51.780338 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820bbfa-6503-47f6-91c8-7f748a3d5cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:51.780716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820bbfa-6503-47f6-91c8-7f748a3d5cf8 admin admin] PATH_INFO: `/v3/users/1f9deecc412147d2b6ba22db7c3d0f48` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:51.782197 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820bbfa-6503-47f6-91c8-7f748a3d5cf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f9deecc412147d2b6ba22db7c3d0f48)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:51.784612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820bbfa-6503-47f6-91c8-7f748a3d5cf8 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:51.843583 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:51.858769 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-3820bbfa-6503-47f6-91c8-7f748a3d5cf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f9deecc412147d2b6ba22db7c3d0f48'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:51.872772 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-3820bbfa-6503-47f6-91c8-7f748a3d5cf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f9deecc412147d2b6ba22db7c3d0f48'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:51.894623 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-3820bbfa-6503-47f6-91c8-7f748a3d5cf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f9deecc412147d2b6ba22db7c3d0f48'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:51.895731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-3820bbfa-6503-47f6-91c8-7f748a3d5cf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f9deecc412147d2b6ba22db7c3d0f48'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:51.896686 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-3820bbfa-6503-47f6-91c8-7f748a3d5cf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f9deecc412147d2b6ba22db7c3d0f48'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:51.918977 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1365/2751] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:48:51 2022] DELETE /identity/v3/users/1f9deecc412147d2b6ba22db7c3d0f48 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:52.403147 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836d1a1-62e4-4aa0-aa74-e92d8b4c52ee admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:52.404927 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e836d1a1-62e4-4aa0-aa74-e92d8b4c52ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:52.431140 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836d1a1-62e4-4aa0-aa74-e92d8b4c52ee admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:52.544387 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4290af-0e37-483e-96e1-c70dfba3dfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:52.545428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4290af-0e37-483e-96e1-c70dfba3dfa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:52.545933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4290af-0e37-483e-96e1-c70dfba3dfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:52.546268 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4290af-0e37-483e-96e1-c70dfba3dfa8 admin admin] PATH_INFO: `/v3/projects/af2e125e51f745b6b5bf1ec2c9ae7ae3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:52.548165 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4290af-0e37-483e-96e1-c70dfba3dfa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af2e125e51f745b6b5bf1ec2c9ae7ae3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:52.550925 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4290af-0e37-483e-96e1-c70dfba3dfa8 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:52.620108 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7b4290af-0e37-483e-96e1-c70dfba3dfa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af2e125e51f745b6b5bf1ec2c9ae7ae3', 'request_id': 'req-7b4290af-0e37-483e-96e1-c70dfba3dfa8'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:52.631364 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7b4290af-0e37-483e-96e1-c70dfba3dfa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af2e125e51f745b6b5bf1ec2c9ae7ae3', 'request_id': 'req-7b4290af-0e37-483e-96e1-c70dfba3dfa8'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:52.643572 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7b4290af-0e37-483e-96e1-c70dfba3dfa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af2e125e51f745b6b5bf1ec2c9ae7ae3', 'request_id': 'req-7b4290af-0e37-483e-96e1-c70dfba3dfa8'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:52.670930 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7b4290af-0e37-483e-96e1-c70dfba3dfa8 admin admin] The token cache is being invalidate because project af2e125e51f745b6b5bf1ec2c9ae7ae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:48:52.671532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7b4290af-0e37-483e-96e1-c70dfba3dfa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:52.672590 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-7b4290af-0e37-483e-96e1-c70dfba3dfa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:52.674536 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1387/2752] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:48:52 2022] DELETE /identity/v3/projects/af2e125e51f745b6b5bf1ec2c9ae7ae3 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:52.680558 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820bbfa-6503-47f6-91c8-7f748a3d5cf8 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:52.682168 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-3820bbfa-6503-47f6-91c8-7f748a3d5cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:52.698066 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820bbfa-6503-47f6-91c8-7f748a3d5cf8 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:52.774080 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cec45-adb7-4445-8d8d-a50cade24e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:52.774932 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cec45-adb7-4445-8d8d-a50cade24e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:52.775397 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cec45-adb7-4445-8d8d-a50cade24e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:52.775927 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cec45-adb7-4445-8d8d-a50cade24e0d admin admin] PATH_INFO: `/v3/users/406b270331db446faaf9c55f0f37ac96` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:52.777848 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08cec45-adb7-4445-8d8d-a50cade24e0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=406b270331db446faaf9c55f0f37ac96)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:52.780022 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08cec45-adb7-4445-8d8d-a50cade24e0d admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:52.851996 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f08cec45-adb7-4445-8d8d-a50cade24e0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '406b270331db446faaf9c55f0f37ac96'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:52.863545 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f08cec45-adb7-4445-8d8d-a50cade24e0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '406b270331db446faaf9c55f0f37ac96'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:52.880357 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f08cec45-adb7-4445-8d8d-a50cade24e0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '406b270331db446faaf9c55f0f37ac96'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:52.881115 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f08cec45-adb7-4445-8d8d-a50cade24e0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '406b270331db446faaf9c55f0f37ac96'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:52.881731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f08cec45-adb7-4445-8d8d-a50cade24e0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '406b270331db446faaf9c55f0f37ac96'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:52.903645 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1366/2753] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:48:52 2022] DELETE /identity/v3/users/406b270331db446faaf9c55f0f37ac96 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:53.277393 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4290af-0e37-483e-96e1-c70dfba3dfa8 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:53.279168 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-7b4290af-0e37-483e-96e1-c70dfba3dfa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:53.299052 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4290af-0e37-483e-96e1-c70dfba3dfa8 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:53.333489 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:53.393063 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f35ea2-9bdd-46c1-a2b2-a55e55c57671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:53.394034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f35ea2-9bdd-46c1-a2b2-a55e55c57671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:53.394450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f35ea2-9bdd-46c1-a2b2-a55e55c57671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:53.394990 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f35ea2-9bdd-46c1-a2b2-a55e55c57671 admin admin] PATH_INFO: `/v3/projects/5adfbc3a35ea46b8a6ee07802544a7a9` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:53.396525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f35ea2-9bdd-46c1-a2b2-a55e55c57671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5adfbc3a35ea46b8a6ee07802544a7a9)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:53.398652 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f35ea2-9bdd-46c1-a2b2-a55e55c57671 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:53.463724 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-49f35ea2-9bdd-46c1-a2b2-a55e55c57671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5adfbc3a35ea46b8a6ee07802544a7a9', 'request_id': 'req-49f35ea2-9bdd-46c1-a2b2-a55e55c57671'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:53.475324 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-49f35ea2-9bdd-46c1-a2b2-a55e55c57671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5adfbc3a35ea46b8a6ee07802544a7a9', 'request_id': 'req-49f35ea2-9bdd-46c1-a2b2-a55e55c57671'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:53.486430 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-49f35ea2-9bdd-46c1-a2b2-a55e55c57671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5adfbc3a35ea46b8a6ee07802544a7a9', 'request_id': 'req-49f35ea2-9bdd-46c1-a2b2-a55e55c57671'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:53.509223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-49f35ea2-9bdd-46c1-a2b2-a55e55c57671 admin admin] The token cache is being invalidate because project 5adfbc3a35ea46b8a6ee07802544a7a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:48:53.509647 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-49f35ea2-9bdd-46c1-a2b2-a55e55c57671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:53.510680 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-49f35ea2-9bdd-46c1-a2b2-a55e55c57671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:53.513578 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1388/2754] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:48:53 2022] DELETE /identity/v3/projects/5adfbc3a35ea46b8a6ee07802544a7a9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:48:53.520555 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d297db8-40ca-4292-885c-3a6614896c69 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:53.522104 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d297db8-40ca-4292-885c-3a6614896c69 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:53.522626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d297db8-40ca-4292-885c-3a6614896c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:53.559275 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-6d297db8-40ca-4292-885c-3a6614896c69 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:53.560650 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-6d297db8-40ca-4292-885c-3a6614896c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:53.607869 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:53.659518 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1367/2755] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:53.669973 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ed1b8-c2a8-4da9-8e5a-f14717e1ce43 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:53.671312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ed1b8-c2a8-4da9-8e5a-f14717e1ce43 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:53.671312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ed1b8-c2a8-4da9-8e5a-f14717e1ce43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:53.709220 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-1f8ed1b8-c2a8-4da9-8e5a-f14717e1ce43 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:53.711653 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1f8ed1b8-c2a8-4da9-8e5a-f14717e1ce43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:53.736167 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1389/2756] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:48:53.742701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d297db8-40ca-4292-885c-3a6614896c69 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:53.759298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d297db8-40ca-4292-885c-3a6614896c69 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:53.767595 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a196c08-0239-48c2-becb-2f7b88028339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:53.768547 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a196c08-0239-48c2-becb-2f7b88028339 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:53.768824 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a196c08-0239-48c2-becb-2f7b88028339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:53.769100 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a196c08-0239-48c2-becb-2f7b88028339 admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:53.770250 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a196c08-0239-48c2-becb-2f7b88028339 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:48:53.770565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a196c08-0239-48c2-becb-2f7b88028339 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:53.772574 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a196c08-0239-48c2-becb-2f7b88028339 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:53.796280 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1368/2757] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:48:53.798700 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ed1b8-c2a8-4da9-8e5a-f14717e1ce43 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:53.817875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ed1b8-c2a8-4da9-8e5a-f14717e1ce43 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:53.830115 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b846854-bdd4-45a5-8db0-febd8db4dabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:53.831290 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b846854-bdd4-45a5-8db0-febd8db4dabd admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:53.831845 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b846854-bdd4-45a5-8db0-febd8db4dabd admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:53.832722 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b846854-bdd4-45a5-8db0-febd8db4dabd admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:53.833897 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b846854-bdd4-45a5-8db0-febd8db4dabd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:53.838328 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b846854-bdd4-45a5-8db0-febd8db4dabd admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:53.886607 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1390/2758] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:48:53 2022] POST /identity/v3/projects => generated 369 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:48:53.891709 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a196c08-0239-48c2-becb-2f7b88028339 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:53.913754 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a196c08-0239-48c2-becb-2f7b88028339 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:54.012367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c2591-1f0c-4381-a9da-521bcb5f285c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:54.013003 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c2591-1f0c-4381-a9da-521bcb5f285c admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:54.016049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c2591-1f0c-4381-a9da-521bcb5f285c admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:54.016049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c2591-1f0c-4381-a9da-521bcb5f285c admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:54.016049 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c2591-1f0c-4381-a9da-521bcb5f285c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:54.017254 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c2591-1f0c-4381-a9da-521bcb5f285c admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:54.051331 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1369/2759] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:48:53 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:48:54.056236 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b846854-bdd4-45a5-8db0-febd8db4dabd admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:54.070146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b846854-bdd4-45a5-8db0-febd8db4dabd admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:54.076082 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743e049-5de7-40a4-98b8-e0016a30d13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:54.080655 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743e049-5de7-40a4-98b8-e0016a30d13d admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:54.081198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743e049-5de7-40a4-98b8-e0016a30d13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:54.081674 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743e049-5de7-40a4-98b8-e0016a30d13d admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:54.084848 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e743e049-5de7-40a4-98b8-e0016a30d13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:54.088105 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e743e049-5de7-40a4-98b8-e0016a30d13d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:54.109562 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1391/2760] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:54.115369 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c2591-1f0c-4381-a9da-521bcb5f285c admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:54.129448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c2591-1f0c-4381-a9da-521bcb5f285c admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:54.137434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465ed02-2653-4dd1-9dab-f8e05a9a058f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:54.138013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465ed02-2653-4dd1-9dab-f8e05a9a058f admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:54.138553 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465ed02-2653-4dd1-9dab-f8e05a9a058f admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:54.138888 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465ed02-2653-4dd1-9dab-f8e05a9a058f admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:54.139732 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465ed02-2653-4dd1-9dab-f8e05a9a058f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:54.142731 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465ed02-2653-4dd1-9dab-f8e05a9a058f admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:54.155432 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1370/2761] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:48:54.161900 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743e049-5de7-40a4-98b8-e0016a30d13d admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:54.180407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743e049-5de7-40a4-98b8-e0016a30d13d admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:54.186740 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ad1fa-ad57-427c-9b10-a40a2742e43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:54.187915 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ad1fa-ad57-427c-9b10-a40a2742e43e admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:54.188976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ad1fa-ad57-427c-9b10-a40a2742e43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:54.189464 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ad1fa-ad57-427c-9b10-a40a2742e43e admin admin] PATH_INFO: `/v3/projects/ec5f72343e774dd4ab638e694e336203/users/32f9436b66d54c92a06728336e33138a/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:54.217824 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ad1fa-ad57-427c-9b10-a40a2742e43e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec5f72343e774dd4ab638e694e336203, user_id=32f9436b66d54c92a06728336e33138a, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:54.221164 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ad1fa-ad57-427c-9b10-a40a2742e43e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:54.239363 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1392/2762] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:54 2022] PUT /identity/v3/projects/ec5f72343e774dd4ab638e694e336203/users/32f9436b66d54c92a06728336e33138a/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:54.253295 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c694d-940e-4da5-836a-7ea32bcb97e1 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:54.253826 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c694d-940e-4da5-836a-7ea32bcb97e1 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:54.254352 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c694d-940e-4da5-836a-7ea32bcb97e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:54.297981 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-fa7c694d-940e-4da5-836a-7ea32bcb97e1 None None] MFA Rules not processed for user `32f9436b66d54c92a06728336e33138a`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:54.299598 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-fa7c694d-940e-4da5-836a-7ea32bcb97e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:54.398790 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1371/2763] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:54.415893 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ad1fa-ad57-427c-9b10-a40a2742e43e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:54.418712 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0b2ad1fa-ad57-427c-9b10-a40a2742e43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:54.512078 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:54.523103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ad1fa-ad57-427c-9b10-a40a2742e43e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:54.533732 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a21592-1092-4ac4-b712-f84ea0746d44 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df18e704834948c4bb480691fa8d0824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:54.535396 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21592-1092-4ac4-b712-f84ea0746d44 service glance] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:54.537123 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21592-1092-4ac4-b712-f84ea0746d44 service glance] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:54.538503 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21592-1092-4ac4-b712-f84ea0746d44 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:54.561696 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a21592-1092-4ac4-b712-f84ea0746d44 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:54.564364 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a21592-1092-4ac4-b712-f84ea0746d44 service glance] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:54.582560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1393/2764] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:48:56.134037 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c694d-940e-4da5-836a-7ea32bcb97e1 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:56.136275 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-fa7c694d-940e-4da5-836a-7ea32bcb97e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:56.177158 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:56.221001 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c694d-940e-4da5-836a-7ea32bcb97e1 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:56.225895 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38298126-e1c0-4cbc-bdda-f6d451ffca12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:56.226689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38298126-e1c0-4cbc-bdda-f6d451ffca12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:56.227020 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38298126-e1c0-4cbc-bdda-f6d451ffca12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:56.227319 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38298126-e1c0-4cbc-bdda-f6d451ffca12 admin admin] PATH_INFO: `/v3/users/e1971edfb9f14b028089edf0dd9f33d1` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:56.228982 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38298126-e1c0-4cbc-bdda-f6d451ffca12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1971edfb9f14b028089edf0dd9f33d1)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:56.231251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38298126-e1c0-4cbc-bdda-f6d451ffca12 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:56.289820 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-38298126-e1c0-4cbc-bdda-f6d451ffca12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1971edfb9f14b028089edf0dd9f33d1'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:56.298545 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-38298126-e1c0-4cbc-bdda-f6d451ffca12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1971edfb9f14b028089edf0dd9f33d1'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:56.311595 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-38298126-e1c0-4cbc-bdda-f6d451ffca12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1971edfb9f14b028089edf0dd9f33d1'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:56.312398 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-38298126-e1c0-4cbc-bdda-f6d451ffca12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1971edfb9f14b028089edf0dd9f33d1'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:56.313251 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-38298126-e1c0-4cbc-bdda-f6d451ffca12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1971edfb9f14b028089edf0dd9f33d1'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:56.330016 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1372/2765] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:48:56 2022] DELETE /identity/v3/users/e1971edfb9f14b028089edf0dd9f33d1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:56.334781 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e067eec-28e1-48aa-8530-a6de8b5a5eb0 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:56.335357 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e067eec-28e1-48aa-8530-a6de8b5a5eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:56.335476 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e067eec-28e1-48aa-8530-a6de8b5a5eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:56.357838 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-0e067eec-28e1-48aa-8530-a6de8b5a5eb0 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:56.361236 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0e067eec-28e1-48aa-8530-a6de8b5a5eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:56.440962 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1394/2766] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:48:56.451501 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38298126-e1c0-4cbc-bdda-f6d451ffca12 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:56.453069 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-38298126-e1c0-4cbc-bdda-f6d451ffca12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:56.525434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38298126-e1c0-4cbc-bdda-f6d451ffca12 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:56.529885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879703b-7908-4f43-807b-bd116eccc190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:56.530581 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879703b-7908-4f43-807b-bd116eccc190 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:56.530939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879703b-7908-4f43-807b-bd116eccc190 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:56.531349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879703b-7908-4f43-807b-bd116eccc190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:56.543183 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879703b-7908-4f43-807b-bd116eccc190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:56.544846 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879703b-7908-4f43-807b-bd116eccc190 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:56.556044 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1373/2767] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:48:56.952133 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e067eec-28e1-48aa-8530-a6de8b5a5eb0 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:56.955039 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0e067eec-28e1-48aa-8530-a6de8b5a5eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:56.981939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e067eec-28e1-48aa-8530-a6de8b5a5eb0 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:56.990467 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e96e35-109f-4fa7-8257-71ccb468e1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:56.991551 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e96e35-109f-4fa7-8257-71ccb468e1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:56.992124 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e96e35-109f-4fa7-8257-71ccb468e1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:56.992774 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e96e35-109f-4fa7-8257-71ccb468e1a3 admin admin] PATH_INFO: `/v3/projects/81ef49d7f52c49f9a80eb55b2eb7e54a` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:56.999077 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e96e35-109f-4fa7-8257-71ccb468e1a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81ef49d7f52c49f9a80eb55b2eb7e54a)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:56.999077 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e96e35-109f-4fa7-8257-71ccb468e1a3 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:57.087939 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-77e96e35-109f-4fa7-8257-71ccb468e1a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81ef49d7f52c49f9a80eb55b2eb7e54a', 'request_id': 'req-77e96e35-109f-4fa7-8257-71ccb468e1a3'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:57.106156 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-77e96e35-109f-4fa7-8257-71ccb468e1a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81ef49d7f52c49f9a80eb55b2eb7e54a', 'request_id': 'req-77e96e35-109f-4fa7-8257-71ccb468e1a3'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:57.121140 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-77e96e35-109f-4fa7-8257-71ccb468e1a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81ef49d7f52c49f9a80eb55b2eb7e54a', 'request_id': 'req-77e96e35-109f-4fa7-8257-71ccb468e1a3'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:57.153196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-77e96e35-109f-4fa7-8257-71ccb468e1a3 admin admin] The token cache is being invalidate because project 81ef49d7f52c49f9a80eb55b2eb7e54a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:48:57.153551 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-77e96e35-109f-4fa7-8257-71ccb468e1a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:57.154241 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-77e96e35-109f-4fa7-8257-71ccb468e1a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:57.155863 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1395/2768] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:48:56 2022] DELETE /identity/v3/projects/81ef49d7f52c49f9a80eb55b2eb7e54a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:57.162591 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879703b-7908-4f43-807b-bd116eccc190 service neutron] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:57.175202 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879703b-7908-4f43-807b-bd116eccc190 service neutron] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:57.259537 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:57.282417 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bf288-cad0-4906-b5ff-d5fc2bbff3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:57.283336 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bf288-cad0-4906-b5ff-d5fc2bbff3b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:57.283614 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bf288-cad0-4906-b5ff-d5fc2bbff3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:57.283926 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bf288-cad0-4906-b5ff-d5fc2bbff3b0 admin admin] PATH_INFO: `/v3/users/9d1b736cbad64c1d87625898f3f57ad7` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:57.286187 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bf288-cad0-4906-b5ff-d5fc2bbff3b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d1b736cbad64c1d87625898f3f57ad7)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:57.289008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bf288-cad0-4906-b5ff-d5fc2bbff3b0 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:57.356271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e93bf288-cad0-4906-b5ff-d5fc2bbff3b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d1b736cbad64c1d87625898f3f57ad7'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:57.366265 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e93bf288-cad0-4906-b5ff-d5fc2bbff3b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d1b736cbad64c1d87625898f3f57ad7'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:57.384419 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e93bf288-cad0-4906-b5ff-d5fc2bbff3b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d1b736cbad64c1d87625898f3f57ad7'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:57.385452 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e93bf288-cad0-4906-b5ff-d5fc2bbff3b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d1b736cbad64c1d87625898f3f57ad7'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:57.386122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e93bf288-cad0-4906-b5ff-d5fc2bbff3b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d1b736cbad64c1d87625898f3f57ad7'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:57.403827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1374/2769] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:48:57 2022] DELETE /identity/v3/users/9d1b736cbad64c1d87625898f3f57ad7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:57.825045 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e96e35-109f-4fa7-8257-71ccb468e1a3 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:57.828167 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-77e96e35-109f-4fa7-8257-71ccb468e1a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:57.848824 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e96e35-109f-4fa7-8257-71ccb468e1a3 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:57.960516 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88529ce-692a-468e-89e0-b637a0a2164a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:57.961665 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88529ce-692a-468e-89e0-b637a0a2164a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:57.962136 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88529ce-692a-468e-89e0-b637a0a2164a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:57.962632 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88529ce-692a-468e-89e0-b637a0a2164a admin admin] PATH_INFO: `/v3/projects/a8ea17788cb34c7abd2135e1f136ee63` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:57.964772 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88529ce-692a-468e-89e0-b637a0a2164a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8ea17788cb34c7abd2135e1f136ee63)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:57.969180 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88529ce-692a-468e-89e0-b637a0a2164a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:58.000990 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:58.049582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d88529ce-692a-468e-89e0-b637a0a2164a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8ea17788cb34c7abd2135e1f136ee63', 'request_id': 'req-d88529ce-692a-468e-89e0-b637a0a2164a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:58.057561 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d88529ce-692a-468e-89e0-b637a0a2164a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8ea17788cb34c7abd2135e1f136ee63', 'request_id': 'req-d88529ce-692a-468e-89e0-b637a0a2164a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:58.064346 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d88529ce-692a-468e-89e0-b637a0a2164a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8ea17788cb34c7abd2135e1f136ee63', 'request_id': 'req-d88529ce-692a-468e-89e0-b637a0a2164a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:58.080902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d88529ce-692a-468e-89e0-b637a0a2164a admin admin] The token cache is being invalidate because project a8ea17788cb34c7abd2135e1f136ee63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:48:58.081252 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d88529ce-692a-468e-89e0-b637a0a2164a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:58.082068 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-d88529ce-692a-468e-89e0-b637a0a2164a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:48:58.083687 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1396/2770] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:48:57 2022] DELETE /identity/v3/projects/a8ea17788cb34c7abd2135e1f136ee63 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:58.089929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879fe7b-1f4b-4243-9ee5-7f3b718c0c85 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:58.090234 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879fe7b-1f4b-4243-9ee5-7f3b718c0c85 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:58.090469 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879fe7b-1f4b-4243-9ee5-7f3b718c0c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:58.114752 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-0879fe7b-1f4b-4243-9ee5-7f3b718c0c85 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:58.116063 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-0879fe7b-1f4b-4243-9ee5-7f3b718c0c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:58.208285 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1375/2771] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:48:58.276843 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b18110-2c4e-4738-a654-bb5bbf9bae52 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:58.277264 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b18110-2c4e-4738-a654-bb5bbf9bae52 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:58.277781 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b18110-2c4e-4738-a654-bb5bbf9bae52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:58.305317 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-87b18110-2c4e-4738-a654-bb5bbf9bae52 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:58.307568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-87b18110-2c4e-4738-a654-bb5bbf9bae52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:58.319208 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1397/2772] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:58.324371 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879fe7b-1f4b-4243-9ee5-7f3b718c0c85 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:58.336349 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879fe7b-1f4b-4243-9ee5-7f3b718c0c85 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:58.342177 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabd4ca-a86f-41d2-8bb6-a1bc19e8b7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:58.342816 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabd4ca-a86f-41d2-8bb6-a1bc19e8b7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:58.343219 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabd4ca-a86f-41d2-8bb6-a1bc19e8b7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:58.343529 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabd4ca-a86f-41d2-8bb6-a1bc19e8b7d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:58.344246 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabd4ca-a86f-41d2-8bb6-a1bc19e8b7d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:48:58.344557 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabd4ca-a86f-41d2-8bb6-a1bc19e8b7d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:58.346243 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabd4ca-a86f-41d2-8bb6-a1bc19e8b7d6 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:58.361559 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1376/2773] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:48:58.368729 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b18110-2c4e-4738-a654-bb5bbf9bae52 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:58.386030 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b18110-2c4e-4738-a654-bb5bbf9bae52 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:58.395209 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082f42c-3097-418c-9eba-2b5d164eee2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:58.396273 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082f42c-3097-418c-9eba-2b5d164eee2b admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:58.396778 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082f42c-3097-418c-9eba-2b5d164eee2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:58.397232 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082f42c-3097-418c-9eba-2b5d164eee2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:58.398290 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082f42c-3097-418c-9eba-2b5d164eee2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:58.402381 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082f42c-3097-418c-9eba-2b5d164eee2b admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:58.451348 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1398/2774] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:48:58 2022] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:48:58.456203 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabd4ca-a86f-41d2-8bb6-a1bc19e8b7d6 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:58.467527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabd4ca-a86f-41d2-8bb6-a1bc19e8b7d6 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:58.551746 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:58.571302 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68dd4e-e1f9-4e3a-820b-2ff69e61e5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:58.572119 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68dd4e-e1f9-4e3a-820b-2ff69e61e5bf admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:58.572631 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68dd4e-e1f9-4e3a-820b-2ff69e61e5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:58.573013 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68dd4e-e1f9-4e3a-820b-2ff69e61e5bf admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:58.573883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68dd4e-e1f9-4e3a-820b-2ff69e61e5bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:58.576314 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68dd4e-e1f9-4e3a-820b-2ff69e61e5bf admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:58.608136 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1377/2775] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:48:58 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:48:58.612592 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082f42c-3097-418c-9eba-2b5d164eee2b admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:58.625558 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082f42c-3097-418c-9eba-2b5d164eee2b admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:58.631184 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40d669-7063-49e1-9b9a-86a0a2bf8bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:58.631958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40d669-7063-49e1-9b9a-86a0a2bf8bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:58.632242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40d669-7063-49e1-9b9a-86a0a2bf8bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:58.632526 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40d669-7063-49e1-9b9a-86a0a2bf8bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:58.633202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40d669-7063-49e1-9b9a-86a0a2bf8bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:58.634867 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40d669-7063-49e1-9b9a-86a0a2bf8bf4 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:58.650334 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1399/2776] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:48:58.655387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68dd4e-e1f9-4e3a-820b-2ff69e61e5bf admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:58.667528 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68dd4e-e1f9-4e3a-820b-2ff69e61e5bf admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:58.672658 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dddce6e-5e4c-48b3-8fa6-87f91ab8c405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:58.673355 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddce6e-5e4c-48b3-8fa6-87f91ab8c405 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:58.673795 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddce6e-5e4c-48b3-8fa6-87f91ab8c405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:58.674017 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddce6e-5e4c-48b3-8fa6-87f91ab8c405 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:58.674748 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dddce6e-5e4c-48b3-8fa6-87f91ab8c405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:58.676720 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dddce6e-5e4c-48b3-8fa6-87f91ab8c405 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:58.691743 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1378/2777] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:48:58.696722 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40d669-7063-49e1-9b9a-86a0a2bf8bf4 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:58.715115 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40d669-7063-49e1-9b9a-86a0a2bf8bf4 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:58.724758 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfa6e8-da28-42fd-ad05-480d1cb9338e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:58.725807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfa6e8-da28-42fd-ad05-480d1cb9338e admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:58.726337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfa6e8-da28-42fd-ad05-480d1cb9338e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:58.726918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfa6e8-da28-42fd-ad05-480d1cb9338e admin admin] PATH_INFO: `/v3/projects/a685117a4b7f46ac995d586172e8acbe/users/20452f1132814e769d8ab6c443a8faa9/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:58.751034 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfa6e8-da28-42fd-ad05-480d1cb9338e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a685117a4b7f46ac995d586172e8acbe, user_id=20452f1132814e769d8ab6c443a8faa9, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:58.754162 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfa6e8-da28-42fd-ad05-480d1cb9338e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:58.771570 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1400/2778] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:48:58 2022] PUT /identity/v3/projects/a685117a4b7f46ac995d586172e8acbe/users/20452f1132814e769d8ab6c443a8faa9/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:48:58.784754 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9bc53-577e-4a47-872d-c9b874b6f2a9 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:58.785231 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9bc53-577e-4a47-872d-c9b874b6f2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:58.785688 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9bc53-577e-4a47-872d-c9b874b6f2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:58.833949 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-f6c9bc53-577e-4a47-872d-c9b874b6f2a9 None None] MFA Rules not processed for user `20452f1132814e769d8ab6c443a8faa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:58.835363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f6c9bc53-577e-4a47-872d-c9b874b6f2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:58.955019 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1379/2779] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:48:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:58.973476 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfa6e8-da28-42fd-ad05-480d1cb9338e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:58.975842 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3cdfa6e8-da28-42fd-ad05-480d1cb9338e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:59.059244 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfa6e8-da28-42fd-ad05-480d1cb9338e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:59.065505 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f231ca-bc58-4ebb-808e-192475af6ca0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:59.066526 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f231ca-bc58-4ebb-808e-192475af6ca0 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:59.067017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f231ca-bc58-4ebb-808e-192475af6ca0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:59.067498 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f231ca-bc58-4ebb-808e-192475af6ca0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:59.083550 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f231ca-bc58-4ebb-808e-192475af6ca0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:59.086568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f231ca-bc58-4ebb-808e-192475af6ca0 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:59.103649 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1401/2780] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:49:08.948828 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=41,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:49:09.095266 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:49:12.358698 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9bc53-577e-4a47-872d-c9b874b6f2a9 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:49:12.451478 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9bc53-577e-4a47-872d-c9b874b6f2a9 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:49:12.457586 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607fd1e-b66d-4320-af4f-5335ce4ea74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:49:12.458689 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607fd1e-b66d-4320-af4f-5335ce4ea74d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:12.459156 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607fd1e-b66d-4320-af4f-5335ce4ea74d admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:12.459527 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607fd1e-b66d-4320-af4f-5335ce4ea74d admin admin] PATH_INFO: `/v3/users/20452f1132814e769d8ab6c443a8faa9` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:12.461002 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607fd1e-b66d-4320-af4f-5335ce4ea74d admin admin] RBAC: Authorizing `identity:delete_user(user_id=20452f1132814e769d8ab6c443a8faa9)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:49:12.463165 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607fd1e-b66d-4320-af4f-5335ce4ea74d admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:49:12.545170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d607fd1e-b66d-4320-af4f-5335ce4ea74d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20452f1132814e769d8ab6c443a8faa9'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:12.560889 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d607fd1e-b66d-4320-af4f-5335ce4ea74d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20452f1132814e769d8ab6c443a8faa9'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:12.580789 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d607fd1e-b66d-4320-af4f-5335ce4ea74d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20452f1132814e769d8ab6c443a8faa9'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:12.581670 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d607fd1e-b66d-4320-af4f-5335ce4ea74d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20452f1132814e769d8ab6c443a8faa9'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:12.582324 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d607fd1e-b66d-4320-af4f-5335ce4ea74d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20452f1132814e769d8ab6c443a8faa9'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:12.602227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1380/2781] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:49:12 2022] DELETE /identity/v3/users/20452f1132814e769d8ab6c443a8faa9 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:49:12.607934 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfb5aa-b830-4f73-9428-2230fd71fb05 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:12.608713 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfb5aa-b830-4f73-9428-2230fd71fb05 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:12.608713 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfb5aa-b830-4f73-9428-2230fd71fb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:12.638390 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-efcfb5aa-b830-4f73-9428-2230fd71fb05 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:49:12.640279 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-efcfb5aa-b830-4f73-9428-2230fd71fb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:12.753508 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1402/2782] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:49:12.768628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607fd1e-b66d-4320-af4f-5335ce4ea74d admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:49:12.770880 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-d607fd1e-b66d-4320-af4f-5335ce4ea74d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:12.862302 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607fd1e-b66d-4320-af4f-5335ce4ea74d admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:49:12.867248 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f53da6-1eec-4ab2-a4e5-32f049b9703a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:49:12.867890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f53da6-1eec-4ab2-a4e5-32f049b9703a service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:12.868164 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f53da6-1eec-4ab2-a4e5-32f049b9703a service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:12.868578 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f53da6-1eec-4ab2-a4e5-32f049b9703a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:12.882449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f53da6-1eec-4ab2-a4e5-32f049b9703a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:49:12.883938 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f53da6-1eec-4ab2-a4e5-32f049b9703a service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:49:12.896797 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1381/2783] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:49:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:49:13.335073 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfb5aa-b830-4f73-9428-2230fd71fb05 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:49:13.337100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-efcfb5aa-b830-4f73-9428-2230fd71fb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:13.374443 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfb5aa-b830-4f73-9428-2230fd71fb05 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:49:13.382285 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb945df3-0ae1-41de-930f-320f8fa93bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:49:13.383536 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb945df3-0ae1-41de-930f-320f8fa93bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:13.384153 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb945df3-0ae1-41de-930f-320f8fa93bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:13.384740 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb945df3-0ae1-41de-930f-320f8fa93bd8 admin admin] PATH_INFO: `/v3/projects/a685117a4b7f46ac995d586172e8acbe` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:13.387635 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb945df3-0ae1-41de-930f-320f8fa93bd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a685117a4b7f46ac995d586172e8acbe)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:49:13.391217 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb945df3-0ae1-41de-930f-320f8fa93bd8 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:49:13.473154 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-fb945df3-0ae1-41de-930f-320f8fa93bd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a685117a4b7f46ac995d586172e8acbe', 'request_id': 'req-fb945df3-0ae1-41de-930f-320f8fa93bd8'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:13.484141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-fb945df3-0ae1-41de-930f-320f8fa93bd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a685117a4b7f46ac995d586172e8acbe', 'request_id': 'req-fb945df3-0ae1-41de-930f-320f8fa93bd8'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:13.496790 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-fb945df3-0ae1-41de-930f-320f8fa93bd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a685117a4b7f46ac995d586172e8acbe', 'request_id': 'req-fb945df3-0ae1-41de-930f-320f8fa93bd8'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:13.515915 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-fb945df3-0ae1-41de-930f-320f8fa93bd8 admin admin] The token cache is being invalidate because project a685117a4b7f46ac995d586172e8acbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:49:13.516285 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-fb945df3-0ae1-41de-930f-320f8fa93bd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:13.516907 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-fb945df3-0ae1-41de-930f-320f8fa93bd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:13.518484 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1403/2784] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:49:13 2022] DELETE /identity/v3/projects/a685117a4b7f46ac995d586172e8acbe => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:49:13.524610 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d0429-47ab-461f-98af-9884ac846ee8 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:13.525513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d0429-47ab-461f-98af-9884ac846ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:13.525513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d0429-47ab-461f-98af-9884ac846ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:13.548502 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-f36d0429-47ab-461f-98af-9884ac846ee8 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:49:13.550055 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f36d0429-47ab-461f-98af-9884ac846ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:13.578342 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:49:13.662740 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1382/2785] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:49:13.665473 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b666a-d37e-4356-8770-2e982900b312 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:13.666061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b666a-d37e-4356-8770-2e982900b312 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:13.666415 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b666a-d37e-4356-8770-2e982900b312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:13.692058 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-f21b666a-d37e-4356-8770-2e982900b312 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:49:13.693383 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f21b666a-d37e-4356-8770-2e982900b312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:13.703632 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1404/2786] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:49:13.707991 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d0429-47ab-461f-98af-9884ac846ee8 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:49:13.727856 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d0429-47ab-461f-98af-9884ac846ee8 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:49:13.727856 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad51f3a-4512-470a-9bfd-f048dd776214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:49:13.727856 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad51f3a-4512-470a-9bfd-f048dd776214 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:13.727856 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad51f3a-4512-470a-9bfd-f048dd776214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:13.728478 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad51f3a-4512-470a-9bfd-f048dd776214 admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:13.728478 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad51f3a-4512-470a-9bfd-f048dd776214 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:49:13.728478 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad51f3a-4512-470a-9bfd-f048dd776214 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:49:13.729232 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad51f3a-4512-470a-9bfd-f048dd776214 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:49:13.747091 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1383/2787] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:49:13.753846 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b666a-d37e-4356-8770-2e982900b312 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:49:13.772808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b666a-d37e-4356-8770-2e982900b312 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:49:13.783272 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050a5cf-f64b-45c4-9dfd-6f0d456dd45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:49:13.784397 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050a5cf-f64b-45c4-9dfd-6f0d456dd45a admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:13.784688 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050a5cf-f64b-45c4-9dfd-6f0d456dd45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:13.785451 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050a5cf-f64b-45c4-9dfd-6f0d456dd45a admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:13.786433 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050a5cf-f64b-45c4-9dfd-6f0d456dd45a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:49:13.789538 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050a5cf-f64b-45c4-9dfd-6f0d456dd45a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:49:13.831660 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1405/2788] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:49:13 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:49:13.838970 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad51f3a-4512-470a-9bfd-f048dd776214 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:49:13.852351 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad51f3a-4512-470a-9bfd-f048dd776214 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:49:13.929487 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefb33b-252c-481e-9cae-dc1afe5c2df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:49:13.930119 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefb33b-252c-481e-9cae-dc1afe5c2df7 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:13.930400 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefb33b-252c-481e-9cae-dc1afe5c2df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:13.930671 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefb33b-252c-481e-9cae-dc1afe5c2df7 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:13.931319 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefb33b-252c-481e-9cae-dc1afe5c2df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:49:13.933363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefb33b-252c-481e-9cae-dc1afe5c2df7 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:49:13.959463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1384/2789] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:49:13 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:49:13.963920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050a5cf-f64b-45c4-9dfd-6f0d456dd45a admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:49:13.976935 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050a5cf-f64b-45c4-9dfd-6f0d456dd45a admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:49:13.982911 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f737f1f-cdbb-4e90-8a9d-70391e3a284c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:49:13.983611 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f737f1f-cdbb-4e90-8a9d-70391e3a284c admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:13.984005 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f737f1f-cdbb-4e90-8a9d-70391e3a284c admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:13.984428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f737f1f-cdbb-4e90-8a9d-70391e3a284c admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:13.985175 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f737f1f-cdbb-4e90-8a9d-70391e3a284c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:49:13.986975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f737f1f-cdbb-4e90-8a9d-70391e3a284c admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:49:14.000023 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1406/2790] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:49:14.004855 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefb33b-252c-481e-9cae-dc1afe5c2df7 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:49:14.017115 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefb33b-252c-481e-9cae-dc1afe5c2df7 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:49:14.023682 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7b8f8-ac5b-43af-abd8-81323bebfc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:49:14.024456 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7b8f8-ac5b-43af-abd8-81323bebfc5b admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:14.024796 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7b8f8-ac5b-43af-abd8-81323bebfc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:14.025082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7b8f8-ac5b-43af-abd8-81323bebfc5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:14.025747 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7b8f8-ac5b-43af-abd8-81323bebfc5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:49:14.028019 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7b8f8-ac5b-43af-abd8-81323bebfc5b admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:49:14.048995 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1385/2791] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:49:14.054130 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f737f1f-cdbb-4e90-8a9d-70391e3a284c admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:49:14.066219 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f737f1f-cdbb-4e90-8a9d-70391e3a284c admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:49:14.075121 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364e67c-4516-4a12-a039-e6c10b120885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:49:14.076331 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364e67c-4516-4a12-a039-e6c10b120885 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:14.076841 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364e67c-4516-4a12-a039-e6c10b120885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:14.077261 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364e67c-4516-4a12-a039-e6c10b120885 admin admin] PATH_INFO: `/v3/projects/0ff93dd59c074be59101fd0fd61d62fa/users/d7f3c1c840824769b21bf0bbebd7517a/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:14.104780 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364e67c-4516-4a12-a039-e6c10b120885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ff93dd59c074be59101fd0fd61d62fa, user_id=d7f3c1c840824769b21bf0bbebd7517a, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:49:14.110342 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364e67c-4516-4a12-a039-e6c10b120885 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:49:14.132837 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1407/2792] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:49:14 2022] PUT /identity/v3/projects/0ff93dd59c074be59101fd0fd61d62fa/users/d7f3c1c840824769b21bf0bbebd7517a/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:49:14.139247 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbafaaa-a25a-47cf-a70a-f3bc57c28350 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:14.139591 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbafaaa-a25a-47cf-a70a-f3bc57c28350 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:14.140043 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbafaaa-a25a-47cf-a70a-f3bc57c28350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:14.168856 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-0dbafaaa-a25a-47cf-a70a-f3bc57c28350 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:49:14.171074 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-0dbafaaa-a25a-47cf-a70a-f3bc57c28350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:14.273252 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1386/2793] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:49:14.289182 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364e67c-4516-4a12-a039-e6c10b120885 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:49:14.291481 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3364e67c-4516-4a12-a039-e6c10b120885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:14.325795 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:49:14.388704 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364e67c-4516-4a12-a039-e6c10b120885 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:49:14.393139 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a2924-5dc5-4e01-a39b-212c17d3328f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:49:14.393813 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a2924-5dc5-4e01-a39b-212c17d3328f service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:14.394095 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a2924-5dc5-4e01-a39b-212c17d3328f service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:14.394426 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a2924-5dc5-4e01-a39b-212c17d3328f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:14.418036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a2924-5dc5-4e01-a39b-212c17d3328f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:49:14.419892 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a2924-5dc5-4e01-a39b-212c17d3328f service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:49:14.431440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1408/2794] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:49:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:49:15.571103 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2ece2-93b6-4dc6-a21d-2ef4484e90de None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:15.571847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2ece2-93b6-4dc6-a21d-2ef4484e90de None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:15.572079 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2ece2-93b6-4dc6-a21d-2ef4484e90de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:15.628810 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-62b2ece2-93b6-4dc6-a21d-2ef4484e90de None None] MFA Rules not processed for user `d7f3c1c840824769b21bf0bbebd7517a`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:49:15.630905 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-62b2ece2-93b6-4dc6-a21d-2ef4484e90de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:15.674937 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:49:15.757665 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1387/2795] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:49:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:49:15.772095 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a2924-5dc5-4e01-a39b-212c17d3328f service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:49:15.774624 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4f8a2924-5dc5-4e01-a39b-212c17d3328f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:15.877892 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a2924-5dc5-4e01-a39b-212c17d3328f service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:49:15.883536 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a0d43-c854-4dbb-830d-f78ad5322de7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:49:15.884329 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a0d43-c854-4dbb-830d-f78ad5322de7 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:15.884671 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a0d43-c854-4dbb-830d-f78ad5322de7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:15.885015 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a0d43-c854-4dbb-830d-f78ad5322de7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:15.897453 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a0d43-c854-4dbb-830d-f78ad5322de7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:49:15.900618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a0d43-c854-4dbb-830d-f78ad5322de7 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:49:15.914464 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1409/2796] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:49:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:49:17.473225 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1b528-d031-4a1d-b712-9848bb9b5032 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:17.473861 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1b528-d031-4a1d-b712-9848bb9b5032 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:17.474216 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1b528-d031-4a1d-b712-9848bb9b5032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:17.502074 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-41a1b528-d031-4a1d-b712-9848bb9b5032 None None] MFA Rules not processed for user `d7f3c1c840824769b21bf0bbebd7517a`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:49:17.503544 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-41a1b528-d031-4a1d-b712-9848bb9b5032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:17.512878 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1388/2797] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:49:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:49:21.272899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a0d43-c854-4dbb-830d-f78ad5322de7 service cinder] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:49:21.274505 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5c9a0d43-c854-4dbb-830d-f78ad5322de7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:21.295325 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a0d43-c854-4dbb-830d-f78ad5322de7 service cinder] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:49:21.309683 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75ed2d-8c20-4608-9981-2ebd474c4e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:49:21.310834 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75ed2d-8c20-4608-9981-2ebd474c4e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:21.311380 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75ed2d-8c20-4608-9981-2ebd474c4e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:21.312103 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75ed2d-8c20-4608-9981-2ebd474c4e4f admin admin] PATH_INFO: `/v3/users/32f9436b66d54c92a06728336e33138a` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:21.314287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75ed2d-8c20-4608-9981-2ebd474c4e4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=32f9436b66d54c92a06728336e33138a)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:49:21.317857 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75ed2d-8c20-4608-9981-2ebd474c4e4f admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:49:21.410418 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6f75ed2d-8c20-4608-9981-2ebd474c4e4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32f9436b66d54c92a06728336e33138a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:21.426005 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6f75ed2d-8c20-4608-9981-2ebd474c4e4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32f9436b66d54c92a06728336e33138a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:21.442740 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6f75ed2d-8c20-4608-9981-2ebd474c4e4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32f9436b66d54c92a06728336e33138a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:21.443854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6f75ed2d-8c20-4608-9981-2ebd474c4e4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32f9436b66d54c92a06728336e33138a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:21.444831 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-6f75ed2d-8c20-4608-9981-2ebd474c4e4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32f9436b66d54c92a06728336e33138a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:21.477549 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1410/2798] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:49:21 2022] DELETE /identity/v3/users/32f9436b66d54c92a06728336e33138a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:49:21.483272 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262ad8a-5165-4c40-b99b-c20b709dcca1 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:21.484242 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262ad8a-5165-4c40-b99b-c20b709dcca1 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:21.484242 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262ad8a-5165-4c40-b99b-c20b709dcca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:21.512721 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-2262ad8a-5165-4c40-b99b-c20b709dcca1 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:49:21.514577 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-2262ad8a-5165-4c40-b99b-c20b709dcca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:21.627064 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1389/2799] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:49:21.642110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75ed2d-8c20-4608-9981-2ebd474c4e4f admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:49:21.643831 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-6f75ed2d-8c20-4608-9981-2ebd474c4e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:21.702847 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:49:21.728440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75ed2d-8c20-4608-9981-2ebd474c4e4f admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:49:21.733501 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713cfea-ef96-4bb8-b97e-3fa488f560b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:49:21.734186 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713cfea-ef96-4bb8-b97e-3fa488f560b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:21.734510 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713cfea-ef96-4bb8-b97e-3fa488f560b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:21.734791 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713cfea-ef96-4bb8-b97e-3fa488f560b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:21.749731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713cfea-ef96-4bb8-b97e-3fa488f560b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:49:21.751222 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713cfea-ef96-4bb8-b97e-3fa488f560b0 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:49:21.764888 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1411/2800] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:49:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:49:22.299775 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262ad8a-5165-4c40-b99b-c20b709dcca1 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:49:22.302182 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-2262ad8a-5165-4c40-b99b-c20b709dcca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:22.323582 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262ad8a-5165-4c40-b99b-c20b709dcca1 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:49:22.331431 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192d134-a54c-49ed-993f-02fd0a5afb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:49:22.332750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192d134-a54c-49ed-993f-02fd0a5afb02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:22.333282 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192d134-a54c-49ed-993f-02fd0a5afb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:22.333870 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192d134-a54c-49ed-993f-02fd0a5afb02 admin admin] PATH_INFO: `/v3/projects/ec5f72343e774dd4ab638e694e336203` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:22.336048 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192d134-a54c-49ed-993f-02fd0a5afb02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec5f72343e774dd4ab638e694e336203)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:49:22.340256 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192d134-a54c-49ed-993f-02fd0a5afb02 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:49:22.410240 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f192d134-a54c-49ed-993f-02fd0a5afb02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec5f72343e774dd4ab638e694e336203', 'request_id': 'req-f192d134-a54c-49ed-993f-02fd0a5afb02'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:22.424342 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f192d134-a54c-49ed-993f-02fd0a5afb02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec5f72343e774dd4ab638e694e336203', 'request_id': 'req-f192d134-a54c-49ed-993f-02fd0a5afb02'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:22.433131 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f192d134-a54c-49ed-993f-02fd0a5afb02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec5f72343e774dd4ab638e694e336203', 'request_id': 'req-f192d134-a54c-49ed-993f-02fd0a5afb02'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:22.453065 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f192d134-a54c-49ed-993f-02fd0a5afb02 admin admin] The token cache is being invalidate because project ec5f72343e774dd4ab638e694e336203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:49:22.453533 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f192d134-a54c-49ed-993f-02fd0a5afb02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:22.454546 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-f192d134-a54c-49ed-993f-02fd0a5afb02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:22.456621 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1390/2801] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:49:22 2022] DELETE /identity/v3/projects/ec5f72343e774dd4ab638e694e336203 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:49:22.464233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2d2bf-e76b-4717-804b-4c4e25bdaedf None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:22.465099 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2d2bf-e76b-4717-804b-4c4e25bdaedf None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:22.465099 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2d2bf-e76b-4717-804b-4c4e25bdaedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:22.503824 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-4cd2d2bf-e76b-4717-804b-4c4e25bdaedf None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:49:22.505851 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4cd2d2bf-e76b-4717-804b-4c4e25bdaedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:22.646644 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1412/2802] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:49:22.661135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c82b31-280f-4702-af35-542b6aa7fee5 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:22.661775 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c82b31-280f-4702-af35-542b6aa7fee5 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:22.662570 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c82b31-280f-4702-af35-542b6aa7fee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:22.690333 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-63c82b31-280f-4702-af35-542b6aa7fee5 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:49:22.691773 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-63c82b31-280f-4702-af35-542b6aa7fee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:22.701715 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1391/2803] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:49:22.708024 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2d2bf-e76b-4717-804b-4c4e25bdaedf None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:49:22.726690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2d2bf-e76b-4717-804b-4c4e25bdaedf None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:49:22.737401 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5decc-f7fd-4fcd-bada-6d675a8e8fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:49:22.738341 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5decc-f7fd-4fcd-bada-6d675a8e8fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:22.738760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5decc-f7fd-4fcd-bada-6d675a8e8fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:22.739404 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5decc-f7fd-4fcd-bada-6d675a8e8fa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:22.740637 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5decc-f7fd-4fcd-bada-6d675a8e8fa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:49:22.741187 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5decc-f7fd-4fcd-bada-6d675a8e8fa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:49:22.745005 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5decc-f7fd-4fcd-bada-6d675a8e8fa2 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:49:22.772343 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1413/2804] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:49:22.775909 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c82b31-280f-4702-af35-542b6aa7fee5 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:49:22.786953 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c82b31-280f-4702-af35-542b6aa7fee5 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:49:22.792636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fefc9e-f419-4bf0-866b-8ad6e941ad0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:49:22.793415 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fefc9e-f419-4bf0-866b-8ad6e941ad0e admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:22.793808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fefc9e-f419-4bf0-866b-8ad6e941ad0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:22.794210 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fefc9e-f419-4bf0-866b-8ad6e941ad0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:22.795017 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fefc9e-f419-4bf0-866b-8ad6e941ad0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:49:22.797295 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fefc9e-f419-4bf0-866b-8ad6e941ad0e admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:49:22.841398 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1392/2805] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:49:22 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:49:22.843381 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5decc-f7fd-4fcd-bada-6d675a8e8fa2 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:49:22.859631 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5decc-f7fd-4fcd-bada-6d675a8e8fa2 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:49:22.975975 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcd8e6-fb11-445e-a178-d6fd022e457d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:49:22.976645 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcd8e6-fb11-445e-a178-d6fd022e457d admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:22.976983 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcd8e6-fb11-445e-a178-d6fd022e457d admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:22.977201 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcd8e6-fb11-445e-a178-d6fd022e457d admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:22.977865 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dcd8e6-fb11-445e-a178-d6fd022e457d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:49:22.980741 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dcd8e6-fb11-445e-a178-d6fd022e457d admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:49:23.007732 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1414/2806] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:49:22 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:49:23.012917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fefc9e-f419-4bf0-866b-8ad6e941ad0e admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:49:23.024625 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fefc9e-f419-4bf0-866b-8ad6e941ad0e admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:49:23.030365 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4e1d4-cb5f-44bf-812a-038ea574a388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:49:23.031078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4e1d4-cb5f-44bf-812a-038ea574a388 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:23.031534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4e1d4-cb5f-44bf-812a-038ea574a388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:23.031971 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4e1d4-cb5f-44bf-812a-038ea574a388 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:23.032939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4e1d4-cb5f-44bf-812a-038ea574a388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:49:23.034905 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4e1d4-cb5f-44bf-812a-038ea574a388 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:49:23.036774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:49:23.050221 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1393/2807] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:49:23.054901 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcd8e6-fb11-445e-a178-d6fd022e457d admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:49:23.067430 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcd8e6-fb11-445e-a178-d6fd022e457d admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:49:23.072730 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2f000-509a-4a98-8595-c16725554908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:49:23.073501 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2f000-509a-4a98-8595-c16725554908 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:23.073890 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2f000-509a-4a98-8595-c16725554908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:23.074388 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2f000-509a-4a98-8595-c16725554908 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:23.075290 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2f000-509a-4a98-8595-c16725554908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:49:23.077221 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2f000-509a-4a98-8595-c16725554908 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:49:23.091950 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1415/2808] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:49:23.100580 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4e1d4-cb5f-44bf-812a-038ea574a388 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:49:23.114645 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4e1d4-cb5f-44bf-812a-038ea574a388 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:49:23.120792 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586d09d-288f-4769-a247-08170e7e15ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:49:23.121471 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586d09d-288f-4769-a247-08170e7e15ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:23.121761 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586d09d-288f-4769-a247-08170e7e15ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:23.122028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586d09d-288f-4769-a247-08170e7e15ce admin admin] PATH_INFO: `/v3/projects/50aca223889b4c849956a32a151a9d64/users/ac53ce2137674953b6a6cdca8c2583d6/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:23.153921 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586d09d-288f-4769-a247-08170e7e15ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=50aca223889b4c849956a32a151a9d64, user_id=ac53ce2137674953b6a6cdca8c2583d6, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:49:23.159053 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586d09d-288f-4769-a247-08170e7e15ce admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:49:23.183511 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1394/2809] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:49:23 2022] PUT /identity/v3/projects/50aca223889b4c849956a32a151a9d64/users/ac53ce2137674953b6a6cdca8c2583d6/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:49:23.265884 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e775f6-0ce5-4300-9835-c1e9133ea35f None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:23.266953 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e775f6-0ce5-4300-9835-c1e9133ea35f None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:23.267533 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e775f6-0ce5-4300-9835-c1e9133ea35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:23.318433 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-46e775f6-0ce5-4300-9835-c1e9133ea35f None None] MFA Rules not processed for user `ac53ce2137674953b6a6cdca8c2583d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:49:23.320690 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-46e775f6-0ce5-4300-9835-c1e9133ea35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:23.373774 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:49:23.427343 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1416/2810] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:49:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:49:23.446113 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586d09d-288f-4769-a247-08170e7e15ce admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:49:23.449153 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f586d09d-288f-4769-a247-08170e7e15ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:23.547448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586d09d-288f-4769-a247-08170e7e15ce admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:49:23.554150 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffadfe8-f21e-4b6c-ab4b-dcf38e6387e4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df18e704834948c4bb480691fa8d0824', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:49:23.555399 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffadfe8-f21e-4b6c-ab4b-dcf38e6387e4 service glance] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:23.555958 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffadfe8-f21e-4b6c-ab4b-dcf38e6387e4 service glance] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:23.556389 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffadfe8-f21e-4b6c-ab4b-dcf38e6387e4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:23.573683 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffadfe8-f21e-4b6c-ab4b-dcf38e6387e4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:49:23.576795 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffadfe8-f21e-4b6c-ab4b-dcf38e6387e4 service glance] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:49:23.591533 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1395/2811] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:49:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:49:33.422376 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=11 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:49:33.586676 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:49:36.074256 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d5747-d4b6-4017-8b85-6806140aef27 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:36.074256 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d5747-d4b6-4017-8b85-6806140aef27 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:36.075210 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d5747-d4b6-4017-8b85-6806140aef27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:36.098923 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-d78d5747-d4b6-4017-8b85-6806140aef27 None None] MFA Rules not processed for user `d7f3c1c840824769b21bf0bbebd7517a`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:49:36.100912 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d78d5747-d4b6-4017-8b85-6806140aef27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:36.228277 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1417/2812] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:49:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:49:38.307559 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce181cc-9f4c-4e5c-8237-92a03936f70e None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:38.308295 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce181cc-9f4c-4e5c-8237-92a03936f70e None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:38.308539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce181cc-9f4c-4e5c-8237-92a03936f70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:38.332917 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-9ce181cc-9f4c-4e5c-8237-92a03936f70e None None] MFA Rules not processed for user `69b79740961d4100a287f62093ccae9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:49:38.334467 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-9ce181cc-9f4c-4e5c-8237-92a03936f70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:38.436664 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1396/2813] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:49:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:49:46.204017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=25 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:49:47.228860 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d5747-d4b6-4017-8b85-6806140aef27 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:49:47.231387 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-d78d5747-d4b6-4017-8b85-6806140aef27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:47.347346 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d5747-d4b6-4017-8b85-6806140aef27 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:49:47.352670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4ad78-978d-4f53-8089-75df41404602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:49:47.353320 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4ad78-978d-4f53-8089-75df41404602 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:47.353601 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4ad78-978d-4f53-8089-75df41404602 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:47.353966 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4ad78-978d-4f53-8089-75df41404602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:47.356521 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-54b4ad78-978d-4f53-8089-75df41404602 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:47.530933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4ad78-978d-4f53-8089-75df41404602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:49:47.533610 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4ad78-978d-4f53-8089-75df41404602 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:49:47.565927 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1418/2814] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:49:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:49:47.743332 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce181cc-9f4c-4e5c-8237-92a03936f70e None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:49:47.870754 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce181cc-9f4c-4e5c-8237-92a03936f70e None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:49:47.877375 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f71b1-42a9-40d9-b677-0dfabc3ae69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:49:47.878042 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f71b1-42a9-40d9-b677-0dfabc3ae69a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:47.878325 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f71b1-42a9-40d9-b677-0dfabc3ae69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:47.878613 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f71b1-42a9-40d9-b677-0dfabc3ae69a admin admin] PATH_INFO: `/v3/users/ac53ce2137674953b6a6cdca8c2583d6` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:47.880409 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f71b1-42a9-40d9-b677-0dfabc3ae69a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac53ce2137674953b6a6cdca8c2583d6)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:49:47.883476 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f71b1-42a9-40d9-b677-0dfabc3ae69a admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:49:47.959955 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-7f2f71b1-42a9-40d9-b677-0dfabc3ae69a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac53ce2137674953b6a6cdca8c2583d6'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:47.974838 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-7f2f71b1-42a9-40d9-b677-0dfabc3ae69a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac53ce2137674953b6a6cdca8c2583d6'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:47.999505 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-7f2f71b1-42a9-40d9-b677-0dfabc3ae69a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac53ce2137674953b6a6cdca8c2583d6'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:48.000663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-7f2f71b1-42a9-40d9-b677-0dfabc3ae69a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac53ce2137674953b6a6cdca8c2583d6'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:48.001840 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-7f2f71b1-42a9-40d9-b677-0dfabc3ae69a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac53ce2137674953b6a6cdca8c2583d6'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:48.024615 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1397/2815] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:49:47 2022] DELETE /identity/v3/users/ac53ce2137674953b6a6cdca8c2583d6 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:49:48.030135 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ffeb4-4b7b-446f-81e7-57980fdd2608 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:48.031039 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ffeb4-4b7b-446f-81e7-57980fdd2608 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:48.031403 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ffeb4-4b7b-446f-81e7-57980fdd2608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:48.055460 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-805ffeb4-4b7b-446f-81e7-57980fdd2608 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:49:48.056799 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-805ffeb4-4b7b-446f-81e7-57980fdd2608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:48.154810 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1419/2816] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:49:48.163194 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f71b1-42a9-40d9-b677-0dfabc3ae69a admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:49:48.165903 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-7f2f71b1-42a9-40d9-b677-0dfabc3ae69a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:48.245555 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:49:48.272862 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ffeb4-4b7b-446f-81e7-57980fdd2608 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:49:48.276349 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-805ffeb4-4b7b-446f-81e7-57980fdd2608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:48.334246 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f71b1-42a9-40d9-b677-0dfabc3ae69a admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:49:48.335773 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:49:48.342785 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7004037-105b-437a-9902-9456622b34f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:49:48.344055 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7004037-105b-437a-9902-9456622b34f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:48.344742 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7004037-105b-437a-9902-9456622b34f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:48.345166 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7004037-105b-437a-9902-9456622b34f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:48.366514 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7004037-105b-437a-9902-9456622b34f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:49:48.369475 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7004037-105b-437a-9902-9456622b34f2 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:49:48.392492 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1398/2817] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:49:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:49:48.409120 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ffeb4-4b7b-446f-81e7-57980fdd2608 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:49:48.418467 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88de15-cdde-4f8c-9e4c-fcdec6c8bb63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:49:48.420807 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88de15-cdde-4f8c-9e4c-fcdec6c8bb63 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:48.421647 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88de15-cdde-4f8c-9e4c-fcdec6c8bb63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:48.422574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88de15-cdde-4f8c-9e4c-fcdec6c8bb63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:48.427449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4e88de15-cdde-4f8c-9e4c-fcdec6c8bb63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:48.592724 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88de15-cdde-4f8c-9e4c-fcdec6c8bb63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:49:48.594596 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88de15-cdde-4f8c-9e4c-fcdec6c8bb63 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:49:48.611941 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1420/2818] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:49:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:49:48.968023 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7004037-105b-437a-9902-9456622b34f2 service neutron] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:49:48.970330 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-f7004037-105b-437a-9902-9456622b34f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:49:48.999047 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7004037-105b-437a-9902-9456622b34f2 service neutron] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:49:49.008827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f82a69-ea12-4402-9a41-133e51c10ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:49:49.010221 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f82a69-ea12-4402-9a41-133e51c10ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:49:49.010599 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f82a69-ea12-4402-9a41-133e51c10ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:49:49.011160 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f82a69-ea12-4402-9a41-133e51c10ad1 admin admin] PATH_INFO: `/v3/projects/50aca223889b4c849956a32a151a9d64` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:49:49.013570 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f82a69-ea12-4402-9a41-133e51c10ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50aca223889b4c849956a32a151a9d64)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:49:49.018376 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f82a69-ea12-4402-9a41-133e51c10ad1 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:49:49.127694 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-37f82a69-ea12-4402-9a41-133e51c10ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50aca223889b4c849956a32a151a9d64', 'request_id': 'req-37f82a69-ea12-4402-9a41-133e51c10ad1'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:49.140330 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-37f82a69-ea12-4402-9a41-133e51c10ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50aca223889b4c849956a32a151a9d64', 'request_id': 'req-37f82a69-ea12-4402-9a41-133e51c10ad1'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:49.149199 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-37f82a69-ea12-4402-9a41-133e51c10ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50aca223889b4c849956a32a151a9d64', 'request_id': 'req-37f82a69-ea12-4402-9a41-133e51c10ad1'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:49.169675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-37f82a69-ea12-4402-9a41-133e51c10ad1 admin admin] The token cache is being invalidate because project 50aca223889b4c849956a32a151a9d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:49:49.170156 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-37f82a69-ea12-4402-9a41-133e51c10ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:49.171309 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-37f82a69-ea12-4402-9a41-133e51c10ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:49:49.173876 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1399/2819] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:49:48 2022] DELETE /identity/v3/projects/50aca223889b4c849956a32a151a9d64 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:49:58.604081 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=44 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:49:59.163801 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:00.396333 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308953b-a5bb-43f3-9a41-eda527d63047 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:00.397204 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308953b-a5bb-43f3-9a41-eda527d63047 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:00.397204 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308953b-a5bb-43f3-9a41-eda527d63047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:00.434974 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-4308953b-a5bb-43f3-9a41-eda527d63047 None None] MFA Rules not processed for user `540e06e694524c4a9e84ebebd45956d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:00.436516 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4308953b-a5bb-43f3-9a41-eda527d63047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:00.517593 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1421/2820] 10.222.0.69 () {58 vars in 1009 bytes} [Mon Aug 29 21:50:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:00.593871 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f82a69-ea12-4402-9a41-133e51c10ad1 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:00.596920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-37f82a69-ea12-4402-9a41-133e51c10ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:00.747170 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f82a69-ea12-4402-9a41-133e51c10ad1 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:00.755612 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d420882-59d4-4fb6-8dd4-a60c6b094b93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '714a2ba019144211931dbe853f1960aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:00.756629 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d420882-59d4-4fb6-8dd4-a60c6b094b93 service swift] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:00.757059 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d420882-59d4-4fb6-8dd4-a60c6b094b93 service swift] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:00.757509 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d420882-59d4-4fb6-8dd4-a60c6b094b93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:00.773377 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d420882-59d4-4fb6-8dd4-a60c6b094b93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:00.776048 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d420882-59d4-4fb6-8dd4-a60c6b094b93 service swift] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:00.791593 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1400/2821] 10.222.0.69 () {60 vars in 1384 bytes} [Mon Aug 29 21:50:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:50:10.510731 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=25 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:10.785742 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=32 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:21.758341 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b5c85-1463-482b-9942-1f554decb409 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:21.759257 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b5c85-1463-482b-9942-1f554decb409 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:21.759257 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b5c85-1463-482b-9942-1f554decb409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:21.871715 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-1e6b5c85-1463-482b-9942-1f554decb409 None None] MFA Rules not processed for user `540e06e694524c4a9e84ebebd45956d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:21.874797 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1e6b5c85-1463-482b-9942-1f554decb409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:21.915840 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1422/2822] 10.222.0.69 () {58 vars in 967 bytes} [Mon Aug 29 21:50:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:50:21.939379 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d420882-59d4-4fb6-8dd4-a60c6b094b93 service swift] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:21.978513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d420882-59d4-4fb6-8dd4-a60c6b094b93 service swift] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:21.989521 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8899d-c38a-43f5-96ad-8675938b529e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '714a2ba019144211931dbe853f1960aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:21.990491 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8899d-c38a-43f5-96ad-8675938b529e service swift] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:21.990942 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8899d-c38a-43f5-96ad-8675938b529e service swift] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:21.991433 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8899d-c38a-43f5-96ad-8675938b529e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:22.009107 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8899d-c38a-43f5-96ad-8675938b529e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:22.012567 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8899d-c38a-43f5-96ad-8675938b529e service swift] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:22.033544 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1401/2823] 10.222.0.69 () {60 vars in 1384 bytes} [Mon Aug 29 21:50:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:50:24.919307 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b5c85-1463-482b-9942-1f554decb409 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:24.923831 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1e6b5c85-1463-482b-9942-1f554decb409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:25.045830 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b5c85-1463-482b-9942-1f554decb409 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:25.052431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafa32c-046e-4e28-b954-36cd14db7660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:25.053267 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafa32c-046e-4e28-b954-36cd14db7660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:25.053658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafa32c-046e-4e28-b954-36cd14db7660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:25.054036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafa32c-046e-4e28-b954-36cd14db7660 admin admin] PATH_INFO: `/v3/users/d7f3c1c840824769b21bf0bbebd7517a` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:25.055525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafa32c-046e-4e28-b954-36cd14db7660 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7f3c1c840824769b21bf0bbebd7517a)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:25.058280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafa32c-046e-4e28-b954-36cd14db7660 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:25.152509 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bfafa32c-046e-4e28-b954-36cd14db7660 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7f3c1c840824769b21bf0bbebd7517a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:25.179830 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bfafa32c-046e-4e28-b954-36cd14db7660 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7f3c1c840824769b21bf0bbebd7517a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:25.210016 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bfafa32c-046e-4e28-b954-36cd14db7660 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7f3c1c840824769b21bf0bbebd7517a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:25.210994 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bfafa32c-046e-4e28-b954-36cd14db7660 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7f3c1c840824769b21bf0bbebd7517a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:25.212740 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-bfafa32c-046e-4e28-b954-36cd14db7660 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7f3c1c840824769b21bf0bbebd7517a'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:25.263737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1423/2824] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:50:24 2022] DELETE /identity/v3/users/d7f3c1c840824769b21bf0bbebd7517a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:25.616745 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8899d-c38a-43f5-96ad-8675938b529e service swift] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:25.665082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8899d-c38a-43f5-96ad-8675938b529e service swift] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:25.786708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc376f-960f-49ba-abf3-0f8b715cb373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:25.787813 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc376f-960f-49ba-abf3-0f8b715cb373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:25.788281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc376f-960f-49ba-abf3-0f8b715cb373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:25.788704 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc376f-960f-49ba-abf3-0f8b715cb373 admin admin] PATH_INFO: `/v3/projects/0ff93dd59c074be59101fd0fd61d62fa` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:25.790783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc376f-960f-49ba-abf3-0f8b715cb373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ff93dd59c074be59101fd0fd61d62fa)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:25.793901 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc376f-960f-49ba-abf3-0f8b715cb373 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:25.909594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-56fc376f-960f-49ba-abf3-0f8b715cb373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ff93dd59c074be59101fd0fd61d62fa', 'request_id': 'req-56fc376f-960f-49ba-abf3-0f8b715cb373'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:25.923752 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-56fc376f-960f-49ba-abf3-0f8b715cb373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ff93dd59c074be59101fd0fd61d62fa', 'request_id': 'req-56fc376f-960f-49ba-abf3-0f8b715cb373'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:25.938364 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-56fc376f-960f-49ba-abf3-0f8b715cb373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ff93dd59c074be59101fd0fd61d62fa', 'request_id': 'req-56fc376f-960f-49ba-abf3-0f8b715cb373'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:25.960856 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-56fc376f-960f-49ba-abf3-0f8b715cb373 admin admin] The token cache is being invalidate because project 0ff93dd59c074be59101fd0fd61d62fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:50:25.961321 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-56fc376f-960f-49ba-abf3-0f8b715cb373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:25.962169 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-56fc376f-960f-49ba-abf3-0f8b715cb373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:25.963830 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1402/2825] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:50:25 2022] DELETE /identity/v3/projects/0ff93dd59c074be59101fd0fd61d62fa => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:25.973366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8a0e2-6660-4a49-9d51-0d65c2c2773b None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:25.974240 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8a0e2-6660-4a49-9d51-0d65c2c2773b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:25.974412 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8a0e2-6660-4a49-9d51-0d65c2c2773b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:26.020591 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-56b8a0e2-6660-4a49-9d51-0d65c2c2773b None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:26.024013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-56b8a0e2-6660-4a49-9d51-0d65c2c2773b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:26.095839 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:26.165902 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1424/2826] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:26.180681 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ac8c4-002a-46c5-90dd-0c7021a6475c None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:26.181416 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ac8c4-002a-46c5-90dd-0c7021a6475c None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:26.181791 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ac8c4-002a-46c5-90dd-0c7021a6475c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:26.233531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-a93ac8c4-002a-46c5-90dd-0c7021a6475c None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:26.237038 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a93ac8c4-002a-46c5-90dd-0c7021a6475c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:26.260768 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1403/2827] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:26.268940 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8a0e2-6660-4a49-9d51-0d65c2c2773b None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:26.289658 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8a0e2-6660-4a49-9d51-0d65c2c2773b None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:26.301033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46c4b2-a1e7-4654-b777-ae2e7f8d43d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:26.302886 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46c4b2-a1e7-4654-b777-ae2e7f8d43d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:26.303544 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46c4b2-a1e7-4654-b777-ae2e7f8d43d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:26.304118 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46c4b2-a1e7-4654-b777-ae2e7f8d43d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:26.305892 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46c4b2-a1e7-4654-b777-ae2e7f8d43d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:50:26.306562 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46c4b2-a1e7-4654-b777-ae2e7f8d43d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:26.309801 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46c4b2-a1e7-4654-b777-ae2e7f8d43d1 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:26.339459 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1425/2828] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:50:26.348528 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ac8c4-002a-46c5-90dd-0c7021a6475c None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:26.376422 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ac8c4-002a-46c5-90dd-0c7021a6475c None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:26.387173 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6deddf-72c2-4567-a375-62cb8c5d82c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:26.388327 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6deddf-72c2-4567-a375-62cb8c5d82c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:26.388870 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6deddf-72c2-4567-a375-62cb8c5d82c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:26.389383 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6deddf-72c2-4567-a375-62cb8c5d82c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:26.390622 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6deddf-72c2-4567-a375-62cb8c5d82c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:26.394533 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6deddf-72c2-4567-a375-62cb8c5d82c4 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:26.482122 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1404/2829] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:50:26 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:26.489617 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46c4b2-a1e7-4654-b777-ae2e7f8d43d1 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:26.518147 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46c4b2-a1e7-4654-b777-ae2e7f8d43d1 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:26.654761 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb88d81-199e-4930-871d-298e4042819a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:26.655495 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb88d81-199e-4930-871d-298e4042819a admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:26.655909 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb88d81-199e-4930-871d-298e4042819a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:26.656417 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb88d81-199e-4930-871d-298e4042819a admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:26.657532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb88d81-199e-4930-871d-298e4042819a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:26.660407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb88d81-199e-4930-871d-298e4042819a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:26.695130 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1426/2830] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:50:26 2022] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:26.709367 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6deddf-72c2-4567-a375-62cb8c5d82c4 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:26.731396 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6deddf-72c2-4567-a375-62cb8c5d82c4 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:26.742139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fd622-962c-4045-969b-cd8a30a6019e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:26.743270 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fd622-962c-4045-969b-cd8a30a6019e admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:26.745051 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fd622-962c-4045-969b-cd8a30a6019e admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:26.745051 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fd622-962c-4045-969b-cd8a30a6019e admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:26.745704 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fd622-962c-4045-969b-cd8a30a6019e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:26.748708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fd622-962c-4045-969b-cd8a30a6019e admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:26.771974 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1405/2831] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:26.775805 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb88d81-199e-4930-871d-298e4042819a admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:26.791265 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb88d81-199e-4930-871d-298e4042819a admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:26.798649 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d09e90-617c-42b2-b783-bed030dc9c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:26.799647 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d09e90-617c-42b2-b783-bed030dc9c17 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:26.800140 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d09e90-617c-42b2-b783-bed030dc9c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:26.800576 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d09e90-617c-42b2-b783-bed030dc9c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:26.801284 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d09e90-617c-42b2-b783-bed030dc9c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:26.803339 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d09e90-617c-42b2-b783-bed030dc9c17 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:26.823568 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1427/2832] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:26.830331 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fd622-962c-4045-969b-cd8a30a6019e admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:26.851075 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fd622-962c-4045-969b-cd8a30a6019e admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:26.860048 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0647b64-5d38-43e1-b39e-a95ff4d055f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:26.861108 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0647b64-5d38-43e1-b39e-a95ff4d055f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:26.861520 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0647b64-5d38-43e1-b39e-a95ff4d055f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:26.861907 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0647b64-5d38-43e1-b39e-a95ff4d055f0 admin admin] PATH_INFO: `/v3/projects/bf763fd45d7e4dc690ad68b28e062a1e/users/653a808616ae42fe8c13f8fe3a834ebe/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:26.892667 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0647b64-5d38-43e1-b39e-a95ff4d055f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf763fd45d7e4dc690ad68b28e062a1e, user_id=653a808616ae42fe8c13f8fe3a834ebe, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:26.897647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0647b64-5d38-43e1-b39e-a95ff4d055f0 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:26.903462 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:26.924614 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1406/2833] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:26 2022] PUT /identity/v3/projects/bf763fd45d7e4dc690ad68b28e062a1e/users/653a808616ae42fe8c13f8fe3a834ebe/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:26.945541 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7ee06-77a1-47bb-a11c-160eaf787ab5 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:26.946037 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7ee06-77a1-47bb-a11c-160eaf787ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:26.946530 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7ee06-77a1-47bb-a11c-160eaf787ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:27.003110 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-a7a7ee06-77a1-47bb-a11c-160eaf787ab5 None None] MFA Rules not processed for user `653a808616ae42fe8c13f8fe3a834ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:27.005033 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a7a7ee06-77a1-47bb-a11c-160eaf787ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:27.128135 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1428/2834] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:50:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:27.147871 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0647b64-5d38-43e1-b39e-a95ff4d055f0 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:27.150958 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-b0647b64-5d38-43e1-b39e-a95ff4d055f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:27.265909 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0647b64-5d38-43e1-b39e-a95ff4d055f0 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:27.270312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef0f92-bc01-428e-be04-369c80d49a72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:27.270951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef0f92-bc01-428e-be04-369c80d49a72 service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:27.271233 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef0f92-bc01-428e-be04-369c80d49a72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:27.271512 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef0f92-bc01-428e-be04-369c80d49a72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:27.281910 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef0f92-bc01-428e-be04-369c80d49a72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:27.283560 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef0f92-bc01-428e-be04-369c80d49a72 service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:27.298531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1407/2835] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:27.342039 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7ee06-77a1-47bb-a11c-160eaf787ab5 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:27.404751 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:27.451882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7ee06-77a1-47bb-a11c-160eaf787ab5 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:27.458176 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95e0b7-9002-4781-aa58-0d12e7cf68c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:27.459061 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95e0b7-9002-4781-aa58-0d12e7cf68c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:27.459540 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95e0b7-9002-4781-aa58-0d12e7cf68c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:27.460025 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95e0b7-9002-4781-aa58-0d12e7cf68c3 admin admin] PATH_INFO: `/v3/users/653a808616ae42fe8c13f8fe3a834ebe` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:27.461988 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95e0b7-9002-4781-aa58-0d12e7cf68c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=653a808616ae42fe8c13f8fe3a834ebe)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:27.464369 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95e0b7-9002-4781-aa58-0d12e7cf68c3 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:27.545546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3f95e0b7-9002-4781-aa58-0d12e7cf68c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '653a808616ae42fe8c13f8fe3a834ebe'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:27.554870 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3f95e0b7-9002-4781-aa58-0d12e7cf68c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '653a808616ae42fe8c13f8fe3a834ebe'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:27.569095 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3f95e0b7-9002-4781-aa58-0d12e7cf68c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '653a808616ae42fe8c13f8fe3a834ebe'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:27.569889 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3f95e0b7-9002-4781-aa58-0d12e7cf68c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '653a808616ae42fe8c13f8fe3a834ebe'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:27.570761 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-3f95e0b7-9002-4781-aa58-0d12e7cf68c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '653a808616ae42fe8c13f8fe3a834ebe'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:27.597707 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1429/2836] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:50:27 2022] DELETE /identity/v3/users/653a808616ae42fe8c13f8fe3a834ebe => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:50:27.603453 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dec36-90bb-4266-ba06-e250c0511374 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:27.603890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dec36-90bb-4266-ba06-e250c0511374 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:27.604414 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dec36-90bb-4266-ba06-e250c0511374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:27.631432 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-c13dec36-90bb-4266-ba06-e250c0511374 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:27.632951 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-c13dec36-90bb-4266-ba06-e250c0511374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:27.714826 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1408/2837] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:27.729496 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95e0b7-9002-4781-aa58-0d12e7cf68c3 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:27.731630 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-3f95e0b7-9002-4781-aa58-0d12e7cf68c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:27.838904 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95e0b7-9002-4781-aa58-0d12e7cf68c3 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:27.846109 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a3fd8-88ba-4f5b-8e2f-585f1371b692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:27.847069 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a3fd8-88ba-4f5b-8e2f-585f1371b692 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:27.847560 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a3fd8-88ba-4f5b-8e2f-585f1371b692 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:27.847993 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a3fd8-88ba-4f5b-8e2f-585f1371b692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:27.865536 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a3fd8-88ba-4f5b-8e2f-585f1371b692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:27.867830 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a3fd8-88ba-4f5b-8e2f-585f1371b692 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:27.886692 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1430/2838] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:28.369601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13dec36-90bb-4266-ba06-e250c0511374 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:28.372847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-c13dec36-90bb-4266-ba06-e250c0511374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:28.403750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13dec36-90bb-4266-ba06-e250c0511374 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:28.413914 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d3298-5d90-4c0a-b6aa-45d1beff32b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:28.415176 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d3298-5d90-4c0a-b6aa-45d1beff32b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:28.415552 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d3298-5d90-4c0a-b6aa-45d1beff32b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:28.416055 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d3298-5d90-4c0a-b6aa-45d1beff32b6 admin admin] PATH_INFO: `/v3/projects/bf763fd45d7e4dc690ad68b28e062a1e` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:28.419009 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d3298-5d90-4c0a-b6aa-45d1beff32b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf763fd45d7e4dc690ad68b28e062a1e)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:28.423211 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d3298-5d90-4c0a-b6aa-45d1beff32b6 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:28.521659 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-728d3298-5d90-4c0a-b6aa-45d1beff32b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf763fd45d7e4dc690ad68b28e062a1e', 'request_id': 'req-728d3298-5d90-4c0a-b6aa-45d1beff32b6'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:28.534230 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-728d3298-5d90-4c0a-b6aa-45d1beff32b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf763fd45d7e4dc690ad68b28e062a1e', 'request_id': 'req-728d3298-5d90-4c0a-b6aa-45d1beff32b6'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:28.542603 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-728d3298-5d90-4c0a-b6aa-45d1beff32b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf763fd45d7e4dc690ad68b28e062a1e', 'request_id': 'req-728d3298-5d90-4c0a-b6aa-45d1beff32b6'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:28.564387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-728d3298-5d90-4c0a-b6aa-45d1beff32b6 admin admin] The token cache is being invalidate because project bf763fd45d7e4dc690ad68b28e062a1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:50:28.564900 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-728d3298-5d90-4c0a-b6aa-45d1beff32b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:28.566053 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-728d3298-5d90-4c0a-b6aa-45d1beff32b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:28.568719 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1409/2839] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:50:28 2022] DELETE /identity/v3/projects/bf763fd45d7e4dc690ad68b28e062a1e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:37.878294 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=63,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:38.557733 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:43.452675 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a3fd8-88ba-4f5b-8e2f-585f1371b692 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:43.455482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1f2a3fd8-88ba-4f5b-8e2f-585f1371b692 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:43.646135 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a3fd8-88ba-4f5b-8e2f-585f1371b692 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:43.796298 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c42314-4787-40ab-83bc-4329dc2a9c31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:43.797873 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c42314-4787-40ab-83bc-4329dc2a9c31 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:43.798427 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c42314-4787-40ab-83bc-4329dc2a9c31 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:43.798897 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c42314-4787-40ab-83bc-4329dc2a9c31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:43.802059 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-92c42314-4787-40ab-83bc-4329dc2a9c31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:43.819636 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c42314-4787-40ab-83bc-4329dc2a9c31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:43.822048 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c42314-4787-40ab-83bc-4329dc2a9c31 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:43.842144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1431/2840] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:50.439712 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d3298-5d90-4c0a-b6aa-45d1beff32b6 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:50.441410 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-728d3298-5d90-4c0a-b6aa-45d1beff32b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:50.534227 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d3298-5d90-4c0a-b6aa-45d1beff32b6 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:50.539730 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362ed80-93ce-43ef-9936-6a77d0444a60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:50.540663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362ed80-93ce-43ef-9936-6a77d0444a60 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:50.541091 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362ed80-93ce-43ef-9936-6a77d0444a60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:50.541433 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362ed80-93ce-43ef-9936-6a77d0444a60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:50.544439 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-9362ed80-93ce-43ef-9936-6a77d0444a60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:50.670797 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362ed80-93ce-43ef-9936-6a77d0444a60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:50.672675 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362ed80-93ce-43ef-9936-6a77d0444a60 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:50.686273 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1410/2841] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:50:53.830833 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=62 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:55.361060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c42314-4787-40ab-83bc-4329dc2a9c31 service nova] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:55.363500 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-92c42314-4787-40ab-83bc-4329dc2a9c31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:55.471202 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362ed80-93ce-43ef-9936-6a77d0444a60 service neutron] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:55.473803 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-9362ed80-93ce-43ef-9936-6a77d0444a60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:55.497708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362ed80-93ce-43ef-9936-6a77d0444a60 service neutron] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:55.506686 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6def447-8d6d-4e1e-9adf-9a428315fc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:55.508435 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6def447-8d6d-4e1e-9adf-9a428315fc31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:55.508773 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6def447-8d6d-4e1e-9adf-9a428315fc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:55.509415 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6def447-8d6d-4e1e-9adf-9a428315fc31 admin admin] PATH_INFO: `/v3/users/69b79740961d4100a287f62093ccae9d` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:55.511970 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6def447-8d6d-4e1e-9adf-9a428315fc31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69b79740961d4100a287f62093ccae9d)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:55.516692 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6def447-8d6d-4e1e-9adf-9a428315fc31 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:55.534365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c42314-4787-40ab-83bc-4329dc2a9c31 service nova] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:55.554428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d002f-9cee-4d54-a887-49bcb487df42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7911672bb2a471daf4f69ba940ef41d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:55.555648 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d002f-9cee-4d54-a887-49bcb487df42 service placement] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:55.556281 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d002f-9cee-4d54-a887-49bcb487df42 service placement] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:55.556901 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d002f-9cee-4d54-a887-49bcb487df42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:55.560631 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-441d002f-9cee-4d54-a887-49bcb487df42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:55.587839 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d002f-9cee-4d54-a887-49bcb487df42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:55.591107 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d002f-9cee-4d54-a887-49bcb487df42 service placement] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:55.611407 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1432/2842] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:55.623747 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d6def447-8d6d-4e1e-9adf-9a428315fc31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69b79740961d4100a287f62093ccae9d'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:55.639884 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d6def447-8d6d-4e1e-9adf-9a428315fc31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69b79740961d4100a287f62093ccae9d'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:55.673716 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d6def447-8d6d-4e1e-9adf-9a428315fc31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69b79740961d4100a287f62093ccae9d'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:55.674882 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d6def447-8d6d-4e1e-9adf-9a428315fc31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69b79740961d4100a287f62093ccae9d'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:55.676036 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-d6def447-8d6d-4e1e-9adf-9a428315fc31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69b79740961d4100a287f62093ccae9d'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:55.707371 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1411/2843] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:50:55 2022] DELETE /identity/v3/users/69b79740961d4100a287f62093ccae9d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:56.037799 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d002f-9cee-4d54-a887-49bcb487df42 service placement] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:56.066421 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d002f-9cee-4d54-a887-49bcb487df42 service placement] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:56.199587 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50caf6f7-921f-4f97-84f6-b37f91d6cc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:56.204448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caf6f7-921f-4f97-84f6-b37f91d6cc45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:56.204448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caf6f7-921f-4f97-84f6-b37f91d6cc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:56.204448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caf6f7-921f-4f97-84f6-b37f91d6cc45 admin admin] PATH_INFO: `/v3/projects/8c4c6a899dc7446c88c5e7a4d3f2e717` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:56.204448 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50caf6f7-921f-4f97-84f6-b37f91d6cc45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c4c6a899dc7446c88c5e7a4d3f2e717)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:56.208315 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50caf6f7-921f-4f97-84f6-b37f91d6cc45 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:56.323141 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-50caf6f7-921f-4f97-84f6-b37f91d6cc45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c4c6a899dc7446c88c5e7a4d3f2e717', 'request_id': 'req-50caf6f7-921f-4f97-84f6-b37f91d6cc45'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:56.338384 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-50caf6f7-921f-4f97-84f6-b37f91d6cc45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c4c6a899dc7446c88c5e7a4d3f2e717', 'request_id': 'req-50caf6f7-921f-4f97-84f6-b37f91d6cc45'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:56.351023 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-50caf6f7-921f-4f97-84f6-b37f91d6cc45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c4c6a899dc7446c88c5e7a4d3f2e717', 'request_id': 'req-50caf6f7-921f-4f97-84f6-b37f91d6cc45'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:56.377376 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-50caf6f7-921f-4f97-84f6-b37f91d6cc45 admin admin] The token cache is being invalidate because project 8c4c6a899dc7446c88c5e7a4d3f2e717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:50:56.378452 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-50caf6f7-921f-4f97-84f6-b37f91d6cc45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:56.378647 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-50caf6f7-921f-4f97-84f6-b37f91d6cc45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:56.381239 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1433/2844] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:50:56 2022] DELETE /identity/v3/projects/8c4c6a899dc7446c88c5e7a4d3f2e717 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:56.387496 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0d43e-2633-4266-ab85-0717676caac3 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:56.391651 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0d43e-2633-4266-ab85-0717676caac3 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:56.393403 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0d43e-2633-4266-ab85-0717676caac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:56.422416 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-e6e0d43e-2633-4266-ab85-0717676caac3 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:56.424092 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-e6e0d43e-2633-4266-ab85-0717676caac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:56.456276 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:56.544329 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1412/2845] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:50:56.554989 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732acff-849a-4b67-85e0-700c130902c6 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:56.555334 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732acff-849a-4b67-85e0-700c130902c6 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:56.555734 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732acff-849a-4b67-85e0-700c130902c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:56.592499 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-c732acff-849a-4b67-85e0-700c130902c6 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:56.594736 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-c732acff-849a-4b67-85e0-700c130902c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:56.609561 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1434/2846] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:56.615845 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0d43e-2633-4266-ab85-0717676caac3 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:56.631560 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0d43e-2633-4266-ab85-0717676caac3 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:56.640986 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb45be3-bae4-4e95-8a2f-66ac24a08717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:56.641776 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb45be3-bae4-4e95-8a2f-66ac24a08717 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:56.642061 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb45be3-bae4-4e95-8a2f-66ac24a08717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:56.642335 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb45be3-bae4-4e95-8a2f-66ac24a08717 admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:56.643012 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb45be3-bae4-4e95-8a2f-66ac24a08717 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:50:56.643317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb45be3-bae4-4e95-8a2f-66ac24a08717 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:56.645011 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb45be3-bae4-4e95-8a2f-66ac24a08717 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:56.661148 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1413/2847] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:50:56.666246 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732acff-849a-4b67-85e0-700c130902c6 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:56.678543 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732acff-849a-4b67-85e0-700c130902c6 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:56.684843 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8e6c5-ed9e-490c-8be7-8736de206b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:56.685606 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8e6c5-ed9e-490c-8be7-8736de206b8a admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:56.685946 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8e6c5-ed9e-490c-8be7-8736de206b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:56.686262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8e6c5-ed9e-490c-8be7-8736de206b8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:56.687069 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8e6c5-ed9e-490c-8be7-8736de206b8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:56.689157 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8e6c5-ed9e-490c-8be7-8736de206b8a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:56.706126 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:56.738992 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1435/2848] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:50:56 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:50:56.746875 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb45be3-bae4-4e95-8a2f-66ac24a08717 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:56.758436 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb45be3-bae4-4e95-8a2f-66ac24a08717 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:56.849078 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29454c-8c69-4b12-ab39-660fe4fdbf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:56.849530 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29454c-8c69-4b12-ab39-660fe4fdbf6b admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:56.849789 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29454c-8c69-4b12-ab39-660fe4fdbf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:56.850062 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29454c-8c69-4b12-ab39-660fe4fdbf6b admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:56.850722 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29454c-8c69-4b12-ab39-660fe4fdbf6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:56.852936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29454c-8c69-4b12-ab39-660fe4fdbf6b admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:56.885961 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1414/2849] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:50:56 2022] POST /identity/v3/users => generated 286 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:56.894262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8e6c5-ed9e-490c-8be7-8736de206b8a admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:56.907225 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8e6c5-ed9e-490c-8be7-8736de206b8a admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:56.913295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bf0a5-48cf-4f7d-8398-86ea3710d7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:56.914337 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bf0a5-48cf-4f7d-8398-86ea3710d7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:56.914620 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bf0a5-48cf-4f7d-8398-86ea3710d7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:56.917234 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bf0a5-48cf-4f7d-8398-86ea3710d7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:56.917234 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bf0a5-48cf-4f7d-8398-86ea3710d7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:56.917589 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bf0a5-48cf-4f7d-8398-86ea3710d7b1 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:56.936393 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1436/2850] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:50:56.941761 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29454c-8c69-4b12-ab39-660fe4fdbf6b admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:56.956983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29454c-8c69-4b12-ab39-660fe4fdbf6b admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:56.964858 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e2675-ee9a-4aa6-afc5-6ff6bbb1012f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:56.966044 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e2675-ee9a-4aa6-afc5-6ff6bbb1012f admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:56.966568 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e2675-ee9a-4aa6-afc5-6ff6bbb1012f admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:56.967077 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e2675-ee9a-4aa6-afc5-6ff6bbb1012f admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:56.968317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e2675-ee9a-4aa6-afc5-6ff6bbb1012f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:56.971126 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e2675-ee9a-4aa6-afc5-6ff6bbb1012f admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:56.988268 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1415/2851] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:56.993295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bf0a5-48cf-4f7d-8398-86ea3710d7b1 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:57.014759 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bf0a5-48cf-4f7d-8398-86ea3710d7b1 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:57.021650 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d041b2-015f-44a9-a8d6-8c9a9ad85256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:57.022355 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d041b2-015f-44a9-a8d6-8c9a9ad85256 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:57.022639 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d041b2-015f-44a9-a8d6-8c9a9ad85256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:57.022920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d041b2-015f-44a9-a8d6-8c9a9ad85256 admin admin] PATH_INFO: `/v3/projects/572e80c9240b41dcab01ba6185f7fb97/users/ebf54cd040be464baa5ed5db7cf9c41a/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:57.044663 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d041b2-015f-44a9-a8d6-8c9a9ad85256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=572e80c9240b41dcab01ba6185f7fb97, user_id=ebf54cd040be464baa5ed5db7cf9c41a, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:57.047931 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d041b2-015f-44a9-a8d6-8c9a9ad85256 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:57.066242 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1437/2852] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:56 2022] PUT /identity/v3/projects/572e80c9240b41dcab01ba6185f7fb97/users/ebf54cd040be464baa5ed5db7cf9c41a/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:57.092051 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca10352-fb55-47b5-bfd6-97fbec815395 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:57.092363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca10352-fb55-47b5-bfd6-97fbec815395 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:57.092641 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca10352-fb55-47b5-bfd6-97fbec815395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:57.152356 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-bca10352-fb55-47b5-bfd6-97fbec815395 None None] MFA Rules not processed for user `ebf54cd040be464baa5ed5db7cf9c41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:57.154455 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-bca10352-fb55-47b5-bfd6-97fbec815395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:57.288874 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1416/2853] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:50:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:50:57.301637 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d041b2-015f-44a9-a8d6-8c9a9ad85256 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:57.304156 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-65d041b2-015f-44a9-a8d6-8c9a9ad85256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:57.433724 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d041b2-015f-44a9-a8d6-8c9a9ad85256 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:57.443107 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe455166-e4e7-47ec-92cf-2a1064427da4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:57.443920 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe455166-e4e7-47ec-92cf-2a1064427da4 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:57.444449 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe455166-e4e7-47ec-92cf-2a1064427da4 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:57.444852 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe455166-e4e7-47ec-92cf-2a1064427da4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:57.461850 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe455166-e4e7-47ec-92cf-2a1064427da4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:57.465005 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe455166-e4e7-47ec-92cf-2a1064427da4 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:57.480623 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1438/2854] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:51:00.659572 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca10352-fb55-47b5-bfd6-97fbec815395 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:00.696365 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:00.781462 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca10352-fb55-47b5-bfd6-97fbec815395 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:00.790186 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb244ef-1e3b-4049-9e2d-5e454611a85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:00.791278 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb244ef-1e3b-4049-9e2d-5e454611a85d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:00.791760 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb244ef-1e3b-4049-9e2d-5e454611a85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:00.792288 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb244ef-1e3b-4049-9e2d-5e454611a85d admin admin] PATH_INFO: `/v3/users/ebf54cd040be464baa5ed5db7cf9c41a` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:00.794531 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb244ef-1e3b-4049-9e2d-5e454611a85d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf54cd040be464baa5ed5db7cf9c41a)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:00.798463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb244ef-1e3b-4049-9e2d-5e454611a85d admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:00.894948 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6fb244ef-1e3b-4049-9e2d-5e454611a85d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf54cd040be464baa5ed5db7cf9c41a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:00.912888 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6fb244ef-1e3b-4049-9e2d-5e454611a85d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf54cd040be464baa5ed5db7cf9c41a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:00.934637 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6fb244ef-1e3b-4049-9e2d-5e454611a85d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf54cd040be464baa5ed5db7cf9c41a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:00.935757 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6fb244ef-1e3b-4049-9e2d-5e454611a85d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf54cd040be464baa5ed5db7cf9c41a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:00.936729 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-6fb244ef-1e3b-4049-9e2d-5e454611a85d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf54cd040be464baa5ed5db7cf9c41a'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:00.960499 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1417/2855] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:51:00 2022] DELETE /identity/v3/users/ebf54cd040be464baa5ed5db7cf9c41a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:00.967825 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab42f77-b406-47cb-9bf7-07d4f0615ac3 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:00.968736 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab42f77-b406-47cb-9bf7-07d4f0615ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:00.968736 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab42f77-b406-47cb-9bf7-07d4f0615ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:01.002166 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-fab42f77-b406-47cb-9bf7-07d4f0615ac3 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:01.004446 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fab42f77-b406-47cb-9bf7-07d4f0615ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:01.108202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1439/2856] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:51:01.126009 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb244ef-1e3b-4049-9e2d-5e454611a85d admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:01.128626 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-6fb244ef-1e3b-4049-9e2d-5e454611a85d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:01.263197 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb244ef-1e3b-4049-9e2d-5e454611a85d admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:01.273217 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494c0ec-2470-4d71-b1fd-ebe6fbdb89e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:01.274241 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494c0ec-2470-4d71-b1fd-ebe6fbdb89e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:01.274678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494c0ec-2470-4d71-b1fd-ebe6fbdb89e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:01.275114 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494c0ec-2470-4d71-b1fd-ebe6fbdb89e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:01.293890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494c0ec-2470-4d71-b1fd-ebe6fbdb89e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:01.296915 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494c0ec-2470-4d71-b1fd-ebe6fbdb89e3 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:01.318701 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1418/2857] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:01.809729 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab42f77-b406-47cb-9bf7-07d4f0615ac3 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:01.812080 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-fab42f77-b406-47cb-9bf7-07d4f0615ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:01.848335 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab42f77-b406-47cb-9bf7-07d4f0615ac3 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:01.858077 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887654a4-0250-4c0f-9643-9a28471f0a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:01.859280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887654a4-0250-4c0f-9643-9a28471f0a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:01.859778 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887654a4-0250-4c0f-9643-9a28471f0a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:01.860327 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887654a4-0250-4c0f-9643-9a28471f0a50 admin admin] PATH_INFO: `/v3/projects/572e80c9240b41dcab01ba6185f7fb97` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:01.862667 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887654a4-0250-4c0f-9643-9a28471f0a50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=572e80c9240b41dcab01ba6185f7fb97)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:01.866755 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887654a4-0250-4c0f-9643-9a28471f0a50 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:01.948717 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:01.969944 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-887654a4-0250-4c0f-9643-9a28471f0a50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '572e80c9240b41dcab01ba6185f7fb97', 'request_id': 'req-887654a4-0250-4c0f-9643-9a28471f0a50'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:01.983524 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-887654a4-0250-4c0f-9643-9a28471f0a50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '572e80c9240b41dcab01ba6185f7fb97', 'request_id': 'req-887654a4-0250-4c0f-9643-9a28471f0a50'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:01.999897 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-887654a4-0250-4c0f-9643-9a28471f0a50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '572e80c9240b41dcab01ba6185f7fb97', 'request_id': 'req-887654a4-0250-4c0f-9643-9a28471f0a50'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:02.029867 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-887654a4-0250-4c0f-9643-9a28471f0a50 admin admin] The token cache is being invalidate because project 572e80c9240b41dcab01ba6185f7fb97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:51:02.030328 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-887654a4-0250-4c0f-9643-9a28471f0a50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:02.033617 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-887654a4-0250-4c0f-9643-9a28471f0a50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:02.035438 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1440/2858] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:51:01 2022] DELETE /identity/v3/projects/572e80c9240b41dcab01ba6185f7fb97 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:02.043448 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96399ee4-2469-4150-b355-5f4bdadd78cd None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:02.044443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96399ee4-2469-4150-b355-5f4bdadd78cd None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:02.044443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96399ee4-2469-4150-b355-5f4bdadd78cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:02.078602 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-96399ee4-2469-4150-b355-5f4bdadd78cd None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:02.080045 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-96399ee4-2469-4150-b355-5f4bdadd78cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:02.141835 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:02.197388 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1419/2859] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:02.213209 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee12fc-f7de-4378-b465-6f063c1aa33a None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:02.214349 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee12fc-f7de-4378-b465-6f063c1aa33a None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:02.214349 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee12fc-f7de-4378-b465-6f063c1aa33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:02.258978 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-02ee12fc-f7de-4378-b465-6f063c1aa33a None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:02.261384 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-02ee12fc-f7de-4378-b465-6f063c1aa33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:02.276360 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1441/2860] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:02.282269 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96399ee4-2469-4150-b355-5f4bdadd78cd None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:02.296964 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96399ee4-2469-4150-b355-5f4bdadd78cd None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:02.304009 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5038b0-ab5a-4bd7-b376-390b53d09b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:02.305256 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5038b0-ab5a-4bd7-b376-390b53d09b30 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:02.305723 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5038b0-ab5a-4bd7-b376-390b53d09b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:02.305881 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5038b0-ab5a-4bd7-b376-390b53d09b30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:02.306792 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5038b0-ab5a-4bd7-b376-390b53d09b30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:51:02.307302 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5038b0-ab5a-4bd7-b376-390b53d09b30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:02.309457 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5038b0-ab5a-4bd7-b376-390b53d09b30 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:02.330980 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1420/2861] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:51:02.341099 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee12fc-f7de-4378-b465-6f063c1aa33a None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:02.358417 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee12fc-f7de-4378-b465-6f063c1aa33a None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:02.372674 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cd7a5-3150-4d56-94d4-2450eef311db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:02.373754 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cd7a5-3150-4d56-94d4-2450eef311db admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:02.374163 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cd7a5-3150-4d56-94d4-2450eef311db admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:02.374559 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cd7a5-3150-4d56-94d4-2450eef311db admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:02.375642 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622cd7a5-3150-4d56-94d4-2450eef311db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:02.378238 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622cd7a5-3150-4d56-94d4-2450eef311db admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:02.420319 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1442/2862] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:51:02 2022] POST /identity/v3/projects => generated 401 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:02.427288 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5038b0-ab5a-4bd7-b376-390b53d09b30 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:02.441408 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5038b0-ab5a-4bd7-b376-390b53d09b30 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:02.541435 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5e7d2-4be2-496d-9e1f-e194525eb17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:02.542268 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5e7d2-4be2-496d-9e1f-e194525eb17d admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:02.542671 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5e7d2-4be2-496d-9e1f-e194525eb17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:02.543064 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5e7d2-4be2-496d-9e1f-e194525eb17d admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:02.543864 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5e7d2-4be2-496d-9e1f-e194525eb17d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:02.547039 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5e7d2-4be2-496d-9e1f-e194525eb17d admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:02.585663 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1421/2863] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:51:02 2022] POST /identity/v3/users => generated 301 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:02.591843 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cd7a5-3150-4d56-94d4-2450eef311db admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:02.605038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cd7a5-3150-4d56-94d4-2450eef311db admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:02.611262 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc1821-9da5-4919-9020-4a825f474f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:02.612116 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc1821-9da5-4919-9020-4a825f474f0a admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:02.612574 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc1821-9da5-4919-9020-4a825f474f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:02.612992 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc1821-9da5-4919-9020-4a825f474f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:02.613874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc1821-9da5-4919-9020-4a825f474f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:02.615956 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc1821-9da5-4919-9020-4a825f474f0a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:02.629302 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1443/2864] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:02.636163 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5e7d2-4be2-496d-9e1f-e194525eb17d admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:02.657259 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5e7d2-4be2-496d-9e1f-e194525eb17d admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:02.665447 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc41ca-8052-48c8-b3f8-1e97712fe5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:02.666421 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc41ca-8052-48c8-b3f8-1e97712fe5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:02.666940 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc41ca-8052-48c8-b3f8-1e97712fe5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:02.667356 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc41ca-8052-48c8-b3f8-1e97712fe5e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:02.668516 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc41ca-8052-48c8-b3f8-1e97712fe5e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:02.671659 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc41ca-8052-48c8-b3f8-1e97712fe5e0 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:02.697115 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1422/2865] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:51:02.702964 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc1821-9da5-4919-9020-4a825f474f0a admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:02.717702 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc1821-9da5-4919-9020-4a825f474f0a admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:02.724646 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22df98e-8a03-4215-91a7-acb632f464b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:02.725411 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22df98e-8a03-4215-91a7-acb632f464b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:02.725782 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22df98e-8a03-4215-91a7-acb632f464b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:02.726122 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22df98e-8a03-4215-91a7-acb632f464b8 admin admin] PATH_INFO: `/v3/projects/c5a411c0514f4aefa28f6ca13d06d599/users/1c919be2ddcf42e6930b1201a31d6448/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:02.748943 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22df98e-8a03-4215-91a7-acb632f464b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a411c0514f4aefa28f6ca13d06d599, user_id=1c919be2ddcf42e6930b1201a31d6448, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:02.752124 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22df98e-8a03-4215-91a7-acb632f464b8 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:02.780247 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1444/2866] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:02 2022] PUT /identity/v3/projects/c5a411c0514f4aefa28f6ca13d06d599/users/1c919be2ddcf42e6930b1201a31d6448/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:02.799025 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab379799-105f-484d-ae79-628c55855839 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:02.799481 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab379799-105f-484d-ae79-628c55855839 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:02.799962 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab379799-105f-484d-ae79-628c55855839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:02.856296 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-ab379799-105f-484d-ae79-628c55855839 None None] MFA Rules not processed for user `1c919be2ddcf42e6930b1201a31d6448`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:02.858297 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-ab379799-105f-484d-ae79-628c55855839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:03.002411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1423/2867] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:51:02 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:03.011201 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22df98e-8a03-4215-91a7-acb632f464b8 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:03.161150 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22df98e-8a03-4215-91a7-acb632f464b8 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:03.170152 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d64d0c-ca96-4d3b-97cf-2411562158b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:03.171201 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d64d0c-ca96-4d3b-97cf-2411562158b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:03.171714 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d64d0c-ca96-4d3b-97cf-2411562158b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:03.172241 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d64d0c-ca96-4d3b-97cf-2411562158b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:03.173525 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d64d0c-ca96-4d3b-97cf-2411562158b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:03.177297 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d64d0c-ca96-4d3b-97cf-2411562158b4 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:03.232533 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1445/2868] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:51:03 2022] POST /identity/v3/projects => generated 405 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:03.239466 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab379799-105f-484d-ae79-628c55855839 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:03.260539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab379799-105f-484d-ae79-628c55855839 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:03.329260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:03.380272 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ccaac-3c05-49ae-8a31-680746838974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:03.381245 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ccaac-3c05-49ae-8a31-680746838974 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:03.381666 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ccaac-3c05-49ae-8a31-680746838974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:03.382348 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ccaac-3c05-49ae-8a31-680746838974 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:03.383374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ccaac-3c05-49ae-8a31-680746838974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:03.386662 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ccaac-3c05-49ae-8a31-680746838974 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:03.423249 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1424/2869] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:51:03 2022] POST /identity/v3/users => generated 309 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:03.429642 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d64d0c-ca96-4d3b-97cf-2411562158b4 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:03.447872 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d64d0c-ca96-4d3b-97cf-2411562158b4 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:03.456140 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc19011-b047-4dce-a5ee-b57ff4421884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:03.457442 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc19011-b047-4dce-a5ee-b57ff4421884 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:03.457882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc19011-b047-4dce-a5ee-b57ff4421884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:03.458309 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc19011-b047-4dce-a5ee-b57ff4421884 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:03.459368 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc19011-b047-4dce-a5ee-b57ff4421884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:03.462882 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc19011-b047-4dce-a5ee-b57ff4421884 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:03.487937 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1446/2870] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:03.495362 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ccaac-3c05-49ae-8a31-680746838974 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:03.515312 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ccaac-3c05-49ae-8a31-680746838974 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:03.524741 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1eda2b-9760-4fec-af2b-8494cb7fa5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:03.526033 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1eda2b-9760-4fec-af2b-8494cb7fa5b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:03.526550 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1eda2b-9760-4fec-af2b-8494cb7fa5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:03.527054 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1eda2b-9760-4fec-af2b-8494cb7fa5b0 admin admin] PATH_INFO: `/v3/projects/28d0a816d8204c38bc6a834d74e9907d/users/25fece3ee5dc438583fd4da51a1a7b22/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:03.563328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1eda2b-9760-4fec-af2b-8494cb7fa5b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28d0a816d8204c38bc6a834d74e9907d, user_id=25fece3ee5dc438583fd4da51a1a7b22, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:03.568911 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1eda2b-9760-4fec-af2b-8494cb7fa5b0 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:03.596784 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1425/2871] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:03 2022] PUT /identity/v3/projects/28d0a816d8204c38bc6a834d74e9907d/users/25fece3ee5dc438583fd4da51a1a7b22/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:03.603831 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc19011-b047-4dce-a5ee-b57ff4421884 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:03.621144 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc19011-b047-4dce-a5ee-b57ff4421884 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:03.689874 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:03.744983 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77eff37-149d-4634-9cb9-f69a2a818a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:03.746059 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77eff37-149d-4634-9cb9-f69a2a818a92 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:03.746552 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77eff37-149d-4634-9cb9-f69a2a818a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:03.747040 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77eff37-149d-4634-9cb9-f69a2a818a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:03.748316 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77eff37-149d-4634-9cb9-f69a2a818a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:03.751547 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77eff37-149d-4634-9cb9-f69a2a818a92 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:03.772387 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1447/2872] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:51:03.779908 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1eda2b-9760-4fec-af2b-8494cb7fa5b0 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:03.800682 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1eda2b-9760-4fec-af2b-8494cb7fa5b0 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:03.812636 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b00b93-defa-4feb-8256-9952c5322342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:03.813789 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b00b93-defa-4feb-8256-9952c5322342 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:03.814271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b00b93-defa-4feb-8256-9952c5322342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:03.814776 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b00b93-defa-4feb-8256-9952c5322342 admin admin] PATH_INFO: `/v3/projects/28d0a816d8204c38bc6a834d74e9907d/users/25fece3ee5dc438583fd4da51a1a7b22/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:03.818330 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b00b93-defa-4feb-8256-9952c5322342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28d0a816d8204c38bc6a834d74e9907d, user_id=25fece3ee5dc438583fd4da51a1a7b22, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:03.823886 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b00b93-defa-4feb-8256-9952c5322342 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:03.841845 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1426/2873] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:03 2022] PUT /identity/v3/projects/28d0a816d8204c38bc6a834d74e9907d/users/25fece3ee5dc438583fd4da51a1a7b22/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:51:03.863077 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c272ba-f9de-4f3e-83b4-c0ed2c473b6b None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:03.863606 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c272ba-f9de-4f3e-83b4-c0ed2c473b6b None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:03.864060 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c272ba-f9de-4f3e-83b4-c0ed2c473b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:03.919240 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-85c272ba-f9de-4f3e-83b4-c0ed2c473b6b None None] MFA Rules not processed for user `25fece3ee5dc438583fd4da51a1a7b22`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:03.921246 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-85c272ba-f9de-4f3e-83b4-c0ed2c473b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:04.045048 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1448/2874] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:51:03 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:51:04.064695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b00b93-defa-4feb-8256-9952c5322342 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:04.067302 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-20b00b93-defa-4feb-8256-9952c5322342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:04.159256 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b00b93-defa-4feb-8256-9952c5322342 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:04.164794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b8268-7477-42de-b463-25148e64e04e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:04.165594 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b8268-7477-42de-b463-25148e64e04e service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:04.165962 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b8268-7477-42de-b463-25148e64e04e service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:04.166279 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b8268-7477-42de-b463-25148e64e04e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:04.182648 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b8268-7477-42de-b463-25148e64e04e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:04.185639 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b8268-7477-42de-b463-25148e64e04e service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:04.198463 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1427/2875] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:04 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:04.417021 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c272ba-f9de-4f3e-83b4-c0ed2c473b6b None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:04.526153 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c272ba-f9de-4f3e-83b4-c0ed2c473b6b None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:04.533808 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c77fa-f0c7-41c2-a685-ff90e0d9e555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:04.534571 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c77fa-f0c7-41c2-a685-ff90e0d9e555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:04.534893 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c77fa-f0c7-41c2-a685-ff90e0d9e555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:04.535184 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c77fa-f0c7-41c2-a685-ff90e0d9e555 admin admin] PATH_INFO: `/v3/users/1c919be2ddcf42e6930b1201a31d6448` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:04.536847 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c77fa-f0c7-41c2-a685-ff90e0d9e555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c919be2ddcf42e6930b1201a31d6448)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:04.539942 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c77fa-f0c7-41c2-a685-ff90e0d9e555 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:04.623849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-782c77fa-f0c7-41c2-a685-ff90e0d9e555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c919be2ddcf42e6930b1201a31d6448'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:04.638146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-782c77fa-f0c7-41c2-a685-ff90e0d9e555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c919be2ddcf42e6930b1201a31d6448'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:04.643784 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:04.653837 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-782c77fa-f0c7-41c2-a685-ff90e0d9e555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c919be2ddcf42e6930b1201a31d6448'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:04.657705 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-782c77fa-f0c7-41c2-a685-ff90e0d9e555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c919be2ddcf42e6930b1201a31d6448'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:04.658130 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-782c77fa-f0c7-41c2-a685-ff90e0d9e555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c919be2ddcf42e6930b1201a31d6448'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:04.693644 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1449/2876] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:51:04 2022] DELETE /identity/v3/users/1c919be2ddcf42e6930b1201a31d6448 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:04.700028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790464c-b973-46c1-ab89-f421d75db0b4 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:04.700846 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790464c-b973-46c1-ab89-f421d75db0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:04.700846 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790464c-b973-46c1-ab89-f421d75db0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:04.727759 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-4790464c-b973-46c1-ab89-f421d75db0b4 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:04.729176 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-4790464c-b973-46c1-ab89-f421d75db0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:04.830087 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1428/2877] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:04.844765 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c77fa-f0c7-41c2-a685-ff90e0d9e555 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:04.847198 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-782c77fa-f0c7-41c2-a685-ff90e0d9e555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:04.959601 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c77fa-f0c7-41c2-a685-ff90e0d9e555 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:04.966754 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3032fc-a287-409a-b9a7-7f375b49575b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:04.971887 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3032fc-a287-409a-b9a7-7f375b49575b service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:04.974573 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3032fc-a287-409a-b9a7-7f375b49575b service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:04.975025 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3032fc-a287-409a-b9a7-7f375b49575b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:04.991682 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3032fc-a287-409a-b9a7-7f375b49575b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:04.993657 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3032fc-a287-409a-b9a7-7f375b49575b service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:05.010219 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1450/2878] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:51:05.553208 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790464c-b973-46c1-ab89-f421d75db0b4 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:05.556238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-4790464c-b973-46c1-ab89-f421d75db0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:05.580260 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790464c-b973-46c1-ab89-f421d75db0b4 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:05.589720 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fbcf2-5e31-4cb8-a0ec-7a4f45a87de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:05.591614 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fbcf2-5e31-4cb8-a0ec-7a4f45a87de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:05.591614 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fbcf2-5e31-4cb8-a0ec-7a4f45a87de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:05.592139 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fbcf2-5e31-4cb8-a0ec-7a4f45a87de5 admin admin] PATH_INFO: `/v3/projects/c5a411c0514f4aefa28f6ca13d06d599` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:05.594408 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fbcf2-5e31-4cb8-a0ec-7a4f45a87de5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5a411c0514f4aefa28f6ca13d06d599)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:05.597978 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fbcf2-5e31-4cb8-a0ec-7a4f45a87de5 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:05.665453 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:05.699226 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a33fbcf2-5e31-4cb8-a0ec-7a4f45a87de5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5a411c0514f4aefa28f6ca13d06d599', 'request_id': 'req-a33fbcf2-5e31-4cb8-a0ec-7a4f45a87de5'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:05.709449 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a33fbcf2-5e31-4cb8-a0ec-7a4f45a87de5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5a411c0514f4aefa28f6ca13d06d599', 'request_id': 'req-a33fbcf2-5e31-4cb8-a0ec-7a4f45a87de5'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:05.721376 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a33fbcf2-5e31-4cb8-a0ec-7a4f45a87de5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5a411c0514f4aefa28f6ca13d06d599', 'request_id': 'req-a33fbcf2-5e31-4cb8-a0ec-7a4f45a87de5'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:05.747114 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a33fbcf2-5e31-4cb8-a0ec-7a4f45a87de5 admin admin] The token cache is being invalidate because project c5a411c0514f4aefa28f6ca13d06d599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:51:05.747640 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a33fbcf2-5e31-4cb8-a0ec-7a4f45a87de5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:05.748947 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-a33fbcf2-5e31-4cb8-a0ec-7a4f45a87de5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:05.751629 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1429/2879] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:51:05 2022] DELETE /identity/v3/projects/c5a411c0514f4aefa28f6ca13d06d599 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:51:05.759108 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3032fc-a287-409a-b9a7-7f375b49575b service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:05.777354 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3032fc-a287-409a-b9a7-7f375b49575b service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:05.869412 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a110f-d30b-4d1c-b361-bf68e26c2fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:05.870277 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a110f-d30b-4d1c-b361-bf68e26c2fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:05.870764 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a110f-d30b-4d1c-b361-bf68e26c2fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:05.871295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a110f-d30b-4d1c-b361-bf68e26c2fbd admin admin] PATH_INFO: `/v3/users/25fece3ee5dc438583fd4da51a1a7b22` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:05.873473 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a110f-d30b-4d1c-b361-bf68e26c2fbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=25fece3ee5dc438583fd4da51a1a7b22)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:05.877269 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a110f-d30b-4d1c-b361-bf68e26c2fbd admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:05.971670 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f98a110f-d30b-4d1c-b361-bf68e26c2fbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25fece3ee5dc438583fd4da51a1a7b22'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:05.985595 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f98a110f-d30b-4d1c-b361-bf68e26c2fbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25fece3ee5dc438583fd4da51a1a7b22'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:05.998594 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f98a110f-d30b-4d1c-b361-bf68e26c2fbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25fece3ee5dc438583fd4da51a1a7b22'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:05.999322 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f98a110f-d30b-4d1c-b361-bf68e26c2fbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25fece3ee5dc438583fd4da51a1a7b22'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:06.000017 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f98a110f-d30b-4d1c-b361-bf68e26c2fbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25fece3ee5dc438583fd4da51a1a7b22'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:06.022709 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:06.030392 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1451/2880] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:51:05 2022] DELETE /identity/v3/users/25fece3ee5dc438583fd4da51a1a7b22 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:51:06.531223 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fbcf2-5e31-4cb8-a0ec-7a4f45a87de5 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:06.533088 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-a33fbcf2-5e31-4cb8-a0ec-7a4f45a87de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:06.551135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fbcf2-5e31-4cb8-a0ec-7a4f45a87de5 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:06.681885 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd8185-462a-4d23-9b23-61fb29661cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:06.683323 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd8185-462a-4d23-9b23-61fb29661cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:06.683842 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd8185-462a-4d23-9b23-61fb29661cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:06.684402 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd8185-462a-4d23-9b23-61fb29661cfc admin admin] PATH_INFO: `/v3/projects/28d0a816d8204c38bc6a834d74e9907d` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:06.686583 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd8185-462a-4d23-9b23-61fb29661cfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=28d0a816d8204c38bc6a834d74e9907d)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:06.690341 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd8185-462a-4d23-9b23-61fb29661cfc admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:06.784827 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-29bd8185-462a-4d23-9b23-61fb29661cfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28d0a816d8204c38bc6a834d74e9907d', 'request_id': 'req-29bd8185-462a-4d23-9b23-61fb29661cfc'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:06.793220 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-29bd8185-462a-4d23-9b23-61fb29661cfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28d0a816d8204c38bc6a834d74e9907d', 'request_id': 'req-29bd8185-462a-4d23-9b23-61fb29661cfc'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:06.802270 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-29bd8185-462a-4d23-9b23-61fb29661cfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28d0a816d8204c38bc6a834d74e9907d', 'request_id': 'req-29bd8185-462a-4d23-9b23-61fb29661cfc'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:06.823646 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-29bd8185-462a-4d23-9b23-61fb29661cfc admin admin] The token cache is being invalidate because project 28d0a816d8204c38bc6a834d74e9907d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:51:06.823969 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-29bd8185-462a-4d23-9b23-61fb29661cfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:06.824783 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-29bd8185-462a-4d23-9b23-61fb29661cfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:06.826659 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1430/2881] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:51:06 2022] DELETE /identity/v3/projects/28d0a816d8204c38bc6a834d74e9907d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:51:06.832036 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99449c3-ae76-467a-8871-2e7b481548fa None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:06.832664 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99449c3-ae76-467a-8871-2e7b481548fa None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:06.832851 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99449c3-ae76-467a-8871-2e7b481548fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:06.860069 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-e99449c3-ae76-467a-8871-2e7b481548fa None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:06.862628 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-e99449c3-ae76-467a-8871-2e7b481548fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:06.949816 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1452/2882] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:06.961207 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36936d79-c418-4017-9655-09e9eabe217d None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:06.961564 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36936d79-c418-4017-9655-09e9eabe217d None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:06.961849 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36936d79-c418-4017-9655-09e9eabe217d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:06.987883 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-36936d79-c418-4017-9655-09e9eabe217d None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:06.989804 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-36936d79-c418-4017-9655-09e9eabe217d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:07.000671 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1431/2883] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:07.006755 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99449c3-ae76-467a-8871-2e7b481548fa None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:07.020455 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99449c3-ae76-467a-8871-2e7b481548fa None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:07.028032 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a930d-c867-4d63-b76d-091ee29f1f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:07.029149 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a930d-c867-4d63-b76d-091ee29f1f69 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:07.029629 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a930d-c867-4d63-b76d-091ee29f1f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:07.030440 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a930d-c867-4d63-b76d-091ee29f1f69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:07.032995 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a930d-c867-4d63-b76d-091ee29f1f69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:51:07.033553 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a930d-c867-4d63-b76d-091ee29f1f69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:07.035553 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a930d-c867-4d63-b76d-091ee29f1f69 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:07.054737 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1453/2884] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:51:07.060549 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36936d79-c418-4017-9655-09e9eabe217d None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:07.072913 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36936d79-c418-4017-9655-09e9eabe217d None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:07.080392 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04072ed3-5814-4250-92e5-75ebf314c8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:07.081300 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04072ed3-5814-4250-92e5-75ebf314c8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:07.081748 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04072ed3-5814-4250-92e5-75ebf314c8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:07.082194 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04072ed3-5814-4250-92e5-75ebf314c8a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:07.083141 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04072ed3-5814-4250-92e5-75ebf314c8a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:07.086567 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04072ed3-5814-4250-92e5-75ebf314c8a0 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:07.127089 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1432/2885] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:51:07 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:07.132813 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a930d-c867-4d63-b76d-091ee29f1f69 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:07.145272 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a930d-c867-4d63-b76d-091ee29f1f69 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:07.240196 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21994233-8d7c-4a4d-8383-973bd1168b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:07.240850 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21994233-8d7c-4a4d-8383-973bd1168b44 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:07.241131 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21994233-8d7c-4a4d-8383-973bd1168b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:07.241432 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21994233-8d7c-4a4d-8383-973bd1168b44 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:07.242921 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21994233-8d7c-4a4d-8383-973bd1168b44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:07.244927 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21994233-8d7c-4a4d-8383-973bd1168b44 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:07.277626 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1454/2886] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:51:07 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:07.282309 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04072ed3-5814-4250-92e5-75ebf314c8a0 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:07.297357 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04072ed3-5814-4250-92e5-75ebf314c8a0 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:07.303555 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a95b4-15d9-493d-aa0e-7a218589b71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:07.304759 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a95b4-15d9-493d-aa0e-7a218589b71e admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:07.305021 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a95b4-15d9-493d-aa0e-7a218589b71e admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:07.305306 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a95b4-15d9-493d-aa0e-7a218589b71e admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:07.305988 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a95b4-15d9-493d-aa0e-7a218589b71e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:07.307651 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a95b4-15d9-493d-aa0e-7a218589b71e admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:07.323008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1433/2887] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:51:07.327949 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21994233-8d7c-4a4d-8383-973bd1168b44 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:07.341037 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21994233-8d7c-4a4d-8383-973bd1168b44 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:07.346899 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b2167-6dbc-4c80-bd2b-07ef660a2d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:07.347578 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b2167-6dbc-4c80-bd2b-07ef660a2d47 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:07.347860 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b2167-6dbc-4c80-bd2b-07ef660a2d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:07.348137 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b2167-6dbc-4c80-bd2b-07ef660a2d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:07.348854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b2167-6dbc-4c80-bd2b-07ef660a2d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:07.350527 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b2167-6dbc-4c80-bd2b-07ef660a2d47 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:07.362906 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1455/2888] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:07.370206 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a95b4-15d9-493d-aa0e-7a218589b71e admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:07.381878 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:07.387315 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a95b4-15d9-493d-aa0e-7a218589b71e admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:07.395973 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ef75e-8cbe-462c-a1e6-99424f40c581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:07.397249 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ef75e-8cbe-462c-a1e6-99424f40c581 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:07.397807 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ef75e-8cbe-462c-a1e6-99424f40c581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:07.398890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ef75e-8cbe-462c-a1e6-99424f40c581 admin admin] PATH_INFO: `/v3/projects/98f27c89d0c147e4947eace7666cdef2/users/0e35b449e2314159928859a7e3131e94/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:07.420164 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ef75e-8cbe-462c-a1e6-99424f40c581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98f27c89d0c147e4947eace7666cdef2, user_id=0e35b449e2314159928859a7e3131e94, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:07.423363 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ef75e-8cbe-462c-a1e6-99424f40c581 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:07.443443 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1434/2889] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:07 2022] PUT /identity/v3/projects/98f27c89d0c147e4947eace7666cdef2/users/0e35b449e2314159928859a7e3131e94/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:07.453860 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a721aab-6ebb-4450-a951-1fa1fb5acde1 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:07.454157 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a721aab-6ebb-4450-a951-1fa1fb5acde1 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:07.454405 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a721aab-6ebb-4450-a951-1fa1fb5acde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:07.494774 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-4a721aab-6ebb-4450-a951-1fa1fb5acde1 None None] MFA Rules not processed for user `0e35b449e2314159928859a7e3131e94`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:07.496311 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-4a721aab-6ebb-4450-a951-1fa1fb5acde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:07.598197 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:07.611507 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1456/2890] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:51:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:51:07.617326 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ef75e-8cbe-462c-a1e6-99424f40c581 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:07.698191 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ef75e-8cbe-462c-a1e6-99424f40c581 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:07.703347 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64312af-4a5d-490d-ac27-8f85444b2ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:07.704135 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64312af-4a5d-490d-ac27-8f85444b2ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:07.704590 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64312af-4a5d-490d-ac27-8f85444b2ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:07.704920 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64312af-4a5d-490d-ac27-8f85444b2ec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:07.705778 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64312af-4a5d-490d-ac27-8f85444b2ec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:07.708034 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64312af-4a5d-490d-ac27-8f85444b2ec1 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:07.742405 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1435/2891] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:51:07 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:07.748559 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a721aab-6ebb-4450-a951-1fa1fb5acde1 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:07.762597 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a721aab-6ebb-4450-a951-1fa1fb5acde1 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:07.842223 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fed2b-8861-4252-bfec-42efeaa55167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:07.842960 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fed2b-8861-4252-bfec-42efeaa55167 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:07.843161 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fed2b-8861-4252-bfec-42efeaa55167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:07.843617 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fed2b-8861-4252-bfec-42efeaa55167 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:07.844776 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fed2b-8861-4252-bfec-42efeaa55167 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:07.848453 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fed2b-8861-4252-bfec-42efeaa55167 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:07.888397 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1457/2892] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:51:07 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:51:07.894875 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64312af-4a5d-490d-ac27-8f85444b2ec1 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:07.915857 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64312af-4a5d-490d-ac27-8f85444b2ec1 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:07.924881 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe3216-74b1-42b7-bf11-f54865aff5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:07.926147 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe3216-74b1-42b7-bf11-f54865aff5cd admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:07.926654 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe3216-74b1-42b7-bf11-f54865aff5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:07.927144 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe3216-74b1-42b7-bf11-f54865aff5cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:07.928457 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe3216-74b1-42b7-bf11-f54865aff5cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:07.932293 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe3216-74b1-42b7-bf11-f54865aff5cd admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:07.953750 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1436/2893] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:07.961374 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fed2b-8861-4252-bfec-42efeaa55167 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:07.974052 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fed2b-8861-4252-bfec-42efeaa55167 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:07.980167 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e703d3-6952-4dd5-877d-be96e86c0fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:07.981029 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e703d3-6952-4dd5-877d-be96e86c0fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:07.981603 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e703d3-6952-4dd5-877d-be96e86c0fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:07.981996 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e703d3-6952-4dd5-877d-be96e86c0fd0 admin admin] PATH_INFO: `/v3/projects/a2181ebdfa13456990f665317155ad7e/users/538913515c3341d5bffa8985529517b2/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:08.007112 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e703d3-6952-4dd5-877d-be96e86c0fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2181ebdfa13456990f665317155ad7e, user_id=538913515c3341d5bffa8985529517b2, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:08.010146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e703d3-6952-4dd5-877d-be96e86c0fd0 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:08.035069 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1458/2894] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:07 2022] PUT /identity/v3/projects/a2181ebdfa13456990f665317155ad7e/users/538913515c3341d5bffa8985529517b2/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:51:08.042387 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe3216-74b1-42b7-bf11-f54865aff5cd admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:08.061802 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe3216-74b1-42b7-bf11-f54865aff5cd admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:08.172028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048be12-1f72-4128-8c3b-9f42dd0d5793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:08.173048 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048be12-1f72-4128-8c3b-9f42dd0d5793 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:08.173511 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048be12-1f72-4128-8c3b-9f42dd0d5793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:08.173983 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048be12-1f72-4128-8c3b-9f42dd0d5793 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:08.175264 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048be12-1f72-4128-8c3b-9f42dd0d5793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:08.178437 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048be12-1f72-4128-8c3b-9f42dd0d5793 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:08.199353 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1437/2895] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:08.206716 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e703d3-6952-4dd5-877d-be96e86c0fd0 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:08.235602 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e703d3-6952-4dd5-877d-be96e86c0fd0 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:08.247894 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f7e77-5553-463a-9fe2-006960076944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:08.249217 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f7e77-5553-463a-9fe2-006960076944 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:08.249699 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f7e77-5553-463a-9fe2-006960076944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:08.250114 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f7e77-5553-463a-9fe2-006960076944 admin admin] PATH_INFO: `/v3/projects/a2181ebdfa13456990f665317155ad7e/users/538913515c3341d5bffa8985529517b2/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:08.254035 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f7e77-5553-463a-9fe2-006960076944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2181ebdfa13456990f665317155ad7e, user_id=538913515c3341d5bffa8985529517b2, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:08.259942 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f7e77-5553-463a-9fe2-006960076944 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:08.280854 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1459/2896] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:08 2022] PUT /identity/v3/projects/a2181ebdfa13456990f665317155ad7e/users/538913515c3341d5bffa8985529517b2/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:08.366317 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54c74d-9310-469d-baf7-25bad6ebcf0d None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:08.366779 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54c74d-9310-469d-baf7-25bad6ebcf0d None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:08.367166 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54c74d-9310-469d-baf7-25bad6ebcf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:08.410185 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-9f54c74d-9310-469d-baf7-25bad6ebcf0d None None] MFA Rules not processed for user `538913515c3341d5bffa8985529517b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:08.412319 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-9f54c74d-9310-469d-baf7-25bad6ebcf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:08.489842 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:08.541289 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1438/2897] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:51:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:51:08.560338 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f7e77-5553-463a-9fe2-006960076944 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:08.562917 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b72f7e77-5553-463a-9fe2-006960076944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:08.676042 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f7e77-5553-463a-9fe2-006960076944 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:08.681799 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaee32a-27c1-40c8-8aa8-1af043b44603 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:08.682853 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaee32a-27c1-40c8-8aa8-1af043b44603 service cinder] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:08.683339 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaee32a-27c1-40c8-8aa8-1af043b44603 service cinder] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:08.683828 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaee32a-27c1-40c8-8aa8-1af043b44603 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:08.701706 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaee32a-27c1-40c8-8aa8-1af043b44603 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:08.704537 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaee32a-27c1-40c8-8aa8-1af043b44603 service cinder] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:08.724035 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1460/2898] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:51:09.207374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54c74d-9310-469d-baf7-25bad6ebcf0d None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:09.292720 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54c74d-9310-469d-baf7-25bad6ebcf0d None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:09.298327 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce734ac9-891c-4cf8-8db2-071e1f5a1454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:09.299478 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce734ac9-891c-4cf8-8db2-071e1f5a1454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:09.299890 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce734ac9-891c-4cf8-8db2-071e1f5a1454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:09.300328 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce734ac9-891c-4cf8-8db2-071e1f5a1454 admin admin] PATH_INFO: `/v3/users/0e35b449e2314159928859a7e3131e94` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:09.302082 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce734ac9-891c-4cf8-8db2-071e1f5a1454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e35b449e2314159928859a7e3131e94)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:09.304420 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce734ac9-891c-4cf8-8db2-071e1f5a1454 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:09.387727 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-ce734ac9-891c-4cf8-8db2-071e1f5a1454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e35b449e2314159928859a7e3131e94'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:09.403877 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-ce734ac9-891c-4cf8-8db2-071e1f5a1454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e35b449e2314159928859a7e3131e94'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:09.426222 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-ce734ac9-891c-4cf8-8db2-071e1f5a1454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e35b449e2314159928859a7e3131e94'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:09.427847 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-ce734ac9-891c-4cf8-8db2-071e1f5a1454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e35b449e2314159928859a7e3131e94'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:09.429453 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-ce734ac9-891c-4cf8-8db2-071e1f5a1454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e35b449e2314159928859a7e3131e94'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:09.450762 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1439/2899] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:51:09 2022] DELETE /identity/v3/users/0e35b449e2314159928859a7e3131e94 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:09.456486 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238ba5d-1788-4ba1-9ba1-17ce220a5302 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:09.457343 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238ba5d-1788-4ba1-9ba1-17ce220a5302 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:09.457515 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238ba5d-1788-4ba1-9ba1-17ce220a5302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:09.480546 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-2238ba5d-1788-4ba1-9ba1-17ce220a5302 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:09.482112 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2238ba5d-1788-4ba1-9ba1-17ce220a5302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:09.560759 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:09.586580 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1461/2900] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:09.601474 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce734ac9-891c-4cf8-8db2-071e1f5a1454 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:09.603873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-ce734ac9-891c-4cf8-8db2-071e1f5a1454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:09.692759 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce734ac9-891c-4cf8-8db2-071e1f5a1454 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:09.697440 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0684a-5e7c-47f1-a270-a527ead732c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:09.698110 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0684a-5e7c-47f1-a270-a527ead732c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:09.698401 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0684a-5e7c-47f1-a270-a527ead732c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:09.698678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0684a-5e7c-47f1-a270-a527ead732c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:09.716052 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0684a-5e7c-47f1-a270-a527ead732c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:09.717661 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0684a-5e7c-47f1-a270-a527ead732c6 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:09.722616 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:09.733678 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1440/2901] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:10.193330 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238ba5d-1788-4ba1-9ba1-17ce220a5302 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:10.195381 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2238ba5d-1788-4ba1-9ba1-17ce220a5302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:10.223788 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238ba5d-1788-4ba1-9ba1-17ce220a5302 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:10.232776 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73fa1e-7d47-4bb5-821b-59962b96a5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:10.234048 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73fa1e-7d47-4bb5-821b-59962b96a5ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:10.234669 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73fa1e-7d47-4bb5-821b-59962b96a5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:10.235162 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73fa1e-7d47-4bb5-821b-59962b96a5ca admin admin] PATH_INFO: `/v3/projects/98f27c89d0c147e4947eace7666cdef2` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:10.237897 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73fa1e-7d47-4bb5-821b-59962b96a5ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=98f27c89d0c147e4947eace7666cdef2)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:10.242320 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73fa1e-7d47-4bb5-821b-59962b96a5ca admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:10.319584 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5b73fa1e-7d47-4bb5-821b-59962b96a5ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98f27c89d0c147e4947eace7666cdef2', 'request_id': 'req-5b73fa1e-7d47-4bb5-821b-59962b96a5ca'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:10.327333 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5b73fa1e-7d47-4bb5-821b-59962b96a5ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98f27c89d0c147e4947eace7666cdef2', 'request_id': 'req-5b73fa1e-7d47-4bb5-821b-59962b96a5ca'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:10.336956 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5b73fa1e-7d47-4bb5-821b-59962b96a5ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98f27c89d0c147e4947eace7666cdef2', 'request_id': 'req-5b73fa1e-7d47-4bb5-821b-59962b96a5ca'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:10.364001 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5b73fa1e-7d47-4bb5-821b-59962b96a5ca admin admin] The token cache is being invalidate because project 98f27c89d0c147e4947eace7666cdef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:51:10.364491 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5b73fa1e-7d47-4bb5-821b-59962b96a5ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:10.365638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-5b73fa1e-7d47-4bb5-821b-59962b96a5ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:10.368082 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1462/2902] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:51:10 2022] DELETE /identity/v3/projects/98f27c89d0c147e4947eace7666cdef2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:10.374465 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0684a-5e7c-47f1-a270-a527ead732c6 service neutron] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:10.387364 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0684a-5e7c-47f1-a270-a527ead732c6 service neutron] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:10.483024 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18666c56-d596-4d95-a035-5b8b179c74f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:10.483646 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18666c56-d596-4d95-a035-5b8b179c74f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:10.484238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18666c56-d596-4d95-a035-5b8b179c74f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:10.484845 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18666c56-d596-4d95-a035-5b8b179c74f5 admin admin] PATH_INFO: `/v3/users/538913515c3341d5bffa8985529517b2` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:10.486439 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18666c56-d596-4d95-a035-5b8b179c74f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=538913515c3341d5bffa8985529517b2)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:10.488676 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18666c56-d596-4d95-a035-5b8b179c74f5 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:10.561513 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-18666c56-d596-4d95-a035-5b8b179c74f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '538913515c3341d5bffa8985529517b2'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:10.573655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-18666c56-d596-4d95-a035-5b8b179c74f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '538913515c3341d5bffa8985529517b2'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:10.591873 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-18666c56-d596-4d95-a035-5b8b179c74f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '538913515c3341d5bffa8985529517b2'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:10.592886 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-18666c56-d596-4d95-a035-5b8b179c74f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '538913515c3341d5bffa8985529517b2'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:10.593690 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-18666c56-d596-4d95-a035-5b8b179c74f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '538913515c3341d5bffa8985529517b2'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:10.621434 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1441/2903] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:51:10 2022] DELETE /identity/v3/users/538913515c3341d5bffa8985529517b2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:11.096625 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73fa1e-7d47-4bb5-821b-59962b96a5ca admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:11.100134 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-5b73fa1e-7d47-4bb5-821b-59962b96a5ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:11.126318 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73fa1e-7d47-4bb5-821b-59962b96a5ca admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:11.263520 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6f014-05e6-432e-b6d8-9332ef19dfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:11.264507 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6f014-05e6-432e-b6d8-9332ef19dfbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:11.264794 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6f014-05e6-432e-b6d8-9332ef19dfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:11.265358 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6f014-05e6-432e-b6d8-9332ef19dfbc admin admin] PATH_INFO: `/v3/projects/a2181ebdfa13456990f665317155ad7e` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:11.266897 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6f014-05e6-432e-b6d8-9332ef19dfbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2181ebdfa13456990f665317155ad7e)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:11.269613 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6f014-05e6-432e-b6d8-9332ef19dfbc admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:11.346582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-fac6f014-05e6-432e-b6d8-9332ef19dfbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2181ebdfa13456990f665317155ad7e', 'request_id': 'req-fac6f014-05e6-432e-b6d8-9332ef19dfbc'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:11.356612 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-fac6f014-05e6-432e-b6d8-9332ef19dfbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2181ebdfa13456990f665317155ad7e', 'request_id': 'req-fac6f014-05e6-432e-b6d8-9332ef19dfbc'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:11.364709 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-fac6f014-05e6-432e-b6d8-9332ef19dfbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2181ebdfa13456990f665317155ad7e', 'request_id': 'req-fac6f014-05e6-432e-b6d8-9332ef19dfbc'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:11.388518 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-fac6f014-05e6-432e-b6d8-9332ef19dfbc admin admin] The token cache is being invalidate because project a2181ebdfa13456990f665317155ad7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81658) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:51:11.389050 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-fac6f014-05e6-432e-b6d8-9332ef19dfbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:11.390683 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-fac6f014-05e6-432e-b6d8-9332ef19dfbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:11.393888 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1463/2904] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:51:11 2022] DELETE /identity/v3/projects/a2181ebdfa13456990f665317155ad7e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:11.404028 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c6e1f-74a0-48fa-a987-be188cd285d5 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:11.404935 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c6e1f-74a0-48fa-a987-be188cd285d5 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:11.405313 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c6e1f-74a0-48fa-a987-be188cd285d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:11.433822 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-674c6e1f-74a0-48fa-a987-be188cd285d5 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:11.435295 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-674c6e1f-74a0-48fa-a987-be188cd285d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:11.551361 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1442/2905] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:11.568062 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d31b41-a75a-4d29-afc2-a86d5bce1a4c None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:11.568618 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d31b41-a75a-4d29-afc2-a86d5bce1a4c None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:11.569225 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d31b41-a75a-4d29-afc2-a86d5bce1a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:11.579693 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:11.603087 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-17d31b41-a75a-4d29-afc2-a86d5bce1a4c None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:11.604861 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-17d31b41-a75a-4d29-afc2-a86d5bce1a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:11.621469 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1464/2906] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:51:11.628053 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c6e1f-74a0-48fa-a987-be188cd285d5 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:11.642411 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c6e1f-74a0-48fa-a987-be188cd285d5 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:11.648939 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684ff1d-303b-4f25-b5b7-82a433750946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:11.649493 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684ff1d-303b-4f25-b5b7-82a433750946 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:11.649725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684ff1d-303b-4f25-b5b7-82a433750946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:11.650048 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684ff1d-303b-4f25-b5b7-82a433750946 admin admin] PATH_INFO: `/v3/domains` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:11.650755 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684ff1d-303b-4f25-b5b7-82a433750946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81659) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:51:11.651060 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684ff1d-303b-4f25-b5b7-82a433750946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:11.653504 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684ff1d-303b-4f25-b5b7-82a433750946 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:11.670272 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1443/2907] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:51:11.676005 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d31b41-a75a-4d29-afc2-a86d5bce1a4c None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:11.694777 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d31b41-a75a-4d29-afc2-a86d5bce1a4c None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:11.703128 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3443d2-f862-4a7b-b0c0-001ed8f37329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:11.704167 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3443d2-f862-4a7b-b0c0-001ed8f37329 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:11.704709 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3443d2-f862-4a7b-b0c0-001ed8f37329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:11.705177 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3443d2-f862-4a7b-b0c0-001ed8f37329 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:11.706280 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3443d2-f862-4a7b-b0c0-001ed8f37329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:11.709889 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3443d2-f862-4a7b-b0c0-001ed8f37329 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:11.764396 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1465/2908] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:51:11 2022] POST /identity/v3/projects => generated 371 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:11.771017 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684ff1d-303b-4f25-b5b7-82a433750946 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:11.778440 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:11.785372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684ff1d-303b-4f25-b5b7-82a433750946 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:11.871031 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594218bd-b5e5-4fe7-b7db-154263336239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:11.871568 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594218bd-b5e5-4fe7-b7db-154263336239 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:11.871912 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594218bd-b5e5-4fe7-b7db-154263336239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:11.872161 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594218bd-b5e5-4fe7-b7db-154263336239 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:11.872856 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594218bd-b5e5-4fe7-b7db-154263336239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:11.875027 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594218bd-b5e5-4fe7-b7db-154263336239 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:11.901534 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1444/2909] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:51:11 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:51:11.906351 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3443d2-f862-4a7b-b0c0-001ed8f37329 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:11.919367 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3443d2-f862-4a7b-b0c0-001ed8f37329 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:11.925385 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4353de-966f-4d29-bfcf-5198079bfaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:11.926229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4353de-966f-4d29-bfcf-5198079bfaed admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:11.926573 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4353de-966f-4d29-bfcf-5198079bfaed admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:11.926918 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4353de-966f-4d29-bfcf-5198079bfaed admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:11.927655 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4353de-966f-4d29-bfcf-5198079bfaed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:11.930202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4353de-966f-4d29-bfcf-5198079bfaed admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:11.951015 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1466/2910] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:51:11.956054 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594218bd-b5e5-4fe7-b7db-154263336239 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:11.972061 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594218bd-b5e5-4fe7-b7db-154263336239 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:11.977708 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f5286-6d3f-4eec-ab6c-0aa4eeeab165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:11.978374 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f5286-6d3f-4eec-ab6c-0aa4eeeab165 admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:11.978653 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f5286-6d3f-4eec-ab6c-0aa4eeeab165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:11.978929 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f5286-6d3f-4eec-ab6c-0aa4eeeab165 admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:11.979601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f5286-6d3f-4eec-ab6c-0aa4eeeab165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:11.981373 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f5286-6d3f-4eec-ab6c-0aa4eeeab165 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:11.995400 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1445/2911] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:11.999901 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4353de-966f-4d29-bfcf-5198079bfaed admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:12.013719 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4353de-966f-4d29-bfcf-5198079bfaed admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:12.019136 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b837116-6bc4-483e-877c-06cf4862b044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:12.019847 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b837116-6bc4-483e-877c-06cf4862b044 admin admin] REQUEST_METHOD: `PUT` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:12.020133 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b837116-6bc4-483e-877c-06cf4862b044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:12.020456 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b837116-6bc4-483e-877c-06cf4862b044 admin admin] PATH_INFO: `/v3/projects/791d93cc31404a3da11a40a77c62ad39/users/0fe38df4db034bcf888f61bd4ddd2ec3/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:12.040226 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b837116-6bc4-483e-877c-06cf4862b044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=791d93cc31404a3da11a40a77c62ad39, user_id=0fe38df4db034bcf888f61bd4ddd2ec3, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:12.043064 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b837116-6bc4-483e-877c-06cf4862b044 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:12.066389 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1467/2912] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:11 2022] PUT /identity/v3/projects/791d93cc31404a3da11a40a77c62ad39/users/0fe38df4db034bcf888f61bd4ddd2ec3/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:12.074936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f76c01-8060-494d-bc54-730720a094c1 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:12.075386 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f76c01-8060-494d-bc54-730720a094c1 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:12.075796 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f76c01-8060-494d-bc54-730720a094c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:12.106025 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-c9f76c01-8060-494d-bc54-730720a094c1 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:12.107720 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-c9f76c01-8060-494d-bc54-730720a094c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:12.202010 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1446/2913] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:12.217695 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b837116-6bc4-483e-877c-06cf4862b044 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:12.221022 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-2b837116-6bc4-483e-877c-06cf4862b044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:12.339467 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b837116-6bc4-483e-877c-06cf4862b044 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:12.344366 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a815d-88ef-4a39-b55a-6aafa4dbd0dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:12.345124 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a815d-88ef-4a39-b55a-6aafa4dbd0dc service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:12.345450 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a815d-88ef-4a39-b55a-6aafa4dbd0dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:12.345767 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a815d-88ef-4a39-b55a-6aafa4dbd0dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:12.359184 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a815d-88ef-4a39-b55a-6aafa4dbd0dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:12.361028 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a815d-88ef-4a39-b55a-6aafa4dbd0dc service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:12.374207 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1468/2914] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:13.383695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce283d-3411-4aab-91db-4be4fc23b0b5 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:13.384359 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce283d-3411-4aab-91db-4be4fc23b0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:13.384359 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce283d-3411-4aab-91db-4be4fc23b0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:13.424423 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-04ce283d-3411-4aab-91db-4be4fc23b0b5 None None] MFA Rules not processed for user `0fe38df4db034bcf888f61bd4ddd2ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:13.425889 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-04ce283d-3411-4aab-91db-4be4fc23b0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:13.544572 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1447/2915] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:51:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:13.551251 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a815d-88ef-4a39-b55a-6aafa4dbd0dc service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:13.565100 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a815d-88ef-4a39-b55a-6aafa4dbd0dc service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:13.572782 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8af9fb-b070-4bcb-a78d-29a83474fc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:13.573638 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8af9fb-b070-4bcb-a78d-29a83474fc18 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:13.574037 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8af9fb-b070-4bcb-a78d-29a83474fc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:13.574381 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8af9fb-b070-4bcb-a78d-29a83474fc18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:13.575195 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8af9fb-b070-4bcb-a78d-29a83474fc18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:13.577927 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8af9fb-b070-4bcb-a78d-29a83474fc18 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:13.621219 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1469/2916] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:51:13 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:13.626436 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce283d-3411-4aab-91db-4be4fc23b0b5 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:13.645219 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce283d-3411-4aab-91db-4be4fc23b0b5 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:13.657556 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:13.738979 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695a7fa-80b8-47ca-abcd-ac2ab7a741f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:13.740025 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695a7fa-80b8-47ca-abcd-ac2ab7a741f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:13.740800 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695a7fa-80b8-47ca-abcd-ac2ab7a741f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:13.741648 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695a7fa-80b8-47ca-abcd-ac2ab7a741f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:13.742887 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695a7fa-80b8-47ca-abcd-ac2ab7a741f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:13.746870 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695a7fa-80b8-47ca-abcd-ac2ab7a741f0 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:13.778614 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1448/2917] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:51:13 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:13.783865 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8af9fb-b070-4bcb-a78d-29a83474fc18 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:13.800575 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8af9fb-b070-4bcb-a78d-29a83474fc18 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:13.807504 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851b143-1fd0-4bf4-81f7-371b6425df3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:13.808425 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851b143-1fd0-4bf4-81f7-371b6425df3a admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:13.808788 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851b143-1fd0-4bf4-81f7-371b6425df3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:13.809202 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851b143-1fd0-4bf4-81f7-371b6425df3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:13.810057 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851b143-1fd0-4bf4-81f7-371b6425df3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:13.812455 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851b143-1fd0-4bf4-81f7-371b6425df3a admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:13.830406 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1470/2918] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:51:13.838009 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695a7fa-80b8-47ca-abcd-ac2ab7a741f0 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:13.857054 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695a7fa-80b8-47ca-abcd-ac2ab7a741f0 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:13.865416 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c7895-1186-43cf-9261-7e6fe45c3bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:13.866710 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c7895-1186-43cf-9261-7e6fe45c3bf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:13.866996 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c7895-1186-43cf-9261-7e6fe45c3bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:13.867389 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c7895-1186-43cf-9261-7e6fe45c3bf4 admin admin] PATH_INFO: `/v3/projects/db04797d011b49a8b92208ccf1e4f065/users/fe9ef40249b84441a589415f3fa5c34b/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:13.893314 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c7895-1186-43cf-9261-7e6fe45c3bf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db04797d011b49a8b92208ccf1e4f065, user_id=fe9ef40249b84441a589415f3fa5c34b, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:13.896631 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c7895-1186-43cf-9261-7e6fe45c3bf4 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:13.919314 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1449/2919] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:13 2022] PUT /identity/v3/projects/db04797d011b49a8b92208ccf1e4f065/users/fe9ef40249b84441a589415f3fa5c34b/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:13.925577 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851b143-1fd0-4bf4-81f7-371b6425df3a admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:13.942583 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851b143-1fd0-4bf4-81f7-371b6425df3a admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:14.055431 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525ef5a-33f8-49bf-bf4b-4efdf82ab4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:14.056133 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525ef5a-33f8-49bf-bf4b-4efdf82ab4be admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:14.056487 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525ef5a-33f8-49bf-bf4b-4efdf82ab4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:14.056922 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525ef5a-33f8-49bf-bf4b-4efdf82ab4be admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:14.058114 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2525ef5a-33f8-49bf-bf4b-4efdf82ab4be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:14.059933 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2525ef5a-33f8-49bf-bf4b-4efdf82ab4be admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:14.074007 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1471/2920] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:14.079114 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c7895-1186-43cf-9261-7e6fe45c3bf4 admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:14.094923 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c7895-1186-43cf-9261-7e6fe45c3bf4 admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:14.105796 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a8621-d4f5-46d3-b5e8-d5d9187c5151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:14.106600 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a8621-d4f5-46d3-b5e8-d5d9187c5151 admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:14.106877 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a8621-d4f5-46d3-b5e8-d5d9187c5151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:14.107152 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a8621-d4f5-46d3-b5e8-d5d9187c5151 admin admin] PATH_INFO: `/v3/projects/db04797d011b49a8b92208ccf1e4f065/users/fe9ef40249b84441a589415f3fa5c34b/roles/69369872661e4179bb51cd1ca76e28c3` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:14.110281 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a8621-d4f5-46d3-b5e8-d5d9187c5151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db04797d011b49a8b92208ccf1e4f065, user_id=fe9ef40249b84441a589415f3fa5c34b, role_id=69369872661e4179bb51cd1ca76e28c3)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:14.114613 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a8621-d4f5-46d3-b5e8-d5d9187c5151 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:14.132043 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1450/2921] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:14 2022] PUT /identity/v3/projects/db04797d011b49a8b92208ccf1e4f065/users/fe9ef40249b84441a589415f3fa5c34b/roles/69369872661e4179bb51cd1ca76e28c3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:51:15.161050 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06889ae1-2e54-4c2a-971a-3e69bdafe0c2 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:15.161863 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06889ae1-2e54-4c2a-971a-3e69bdafe0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:15.162156 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06889ae1-2e54-4c2a-971a-3e69bdafe0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:15.177404 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:15.230551 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-06889ae1-2e54-4c2a-971a-3e69bdafe0c2 None None] MFA Rules not processed for user `fe9ef40249b84441a589415f3fa5c34b`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:15.232972 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-06889ae1-2e54-4c2a-971a-3e69bdafe0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:15.369002 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1472/2922] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:51:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:15.384725 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d599807-96bc-4a02-9bff-ddd6dafe1127 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:15.385616 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d599807-96bc-4a02-9bff-ddd6dafe1127 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:15.385941 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d599807-96bc-4a02-9bff-ddd6dafe1127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:15.415837 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-3d599807-96bc-4a02-9bff-ddd6dafe1127 None None] MFA Rules not processed for user `0fe38df4db034bcf888f61bd4ddd2ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:15.417427 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-3d599807-96bc-4a02-9bff-ddd6dafe1127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:15.510379 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1451/2923] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:51:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:51:15.528794 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06889ae1-2e54-4c2a-971a-3e69bdafe0c2 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:15.531003 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-06889ae1-2e54-4c2a-971a-3e69bdafe0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:15.644861 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06889ae1-2e54-4c2a-971a-3e69bdafe0c2 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:15.653736 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d1893-9e8c-4581-b3ec-7bf0df2eea90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:15.654653 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d1893-9e8c-4581-b3ec-7bf0df2eea90 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:15.655099 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d1893-9e8c-4581-b3ec-7bf0df2eea90 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:15.655547 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d1893-9e8c-4581-b3ec-7bf0df2eea90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:15.669916 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d1893-9e8c-4581-b3ec-7bf0df2eea90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:15.672788 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d1893-9e8c-4581-b3ec-7bf0df2eea90 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:15.689438 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1473/2924] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:16.068138 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d599807-96bc-4a02-9bff-ddd6dafe1127 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:16.070862 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-3d599807-96bc-4a02-9bff-ddd6dafe1127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:16.184523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d599807-96bc-4a02-9bff-ddd6dafe1127 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:16.190134 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425efc49-d727-4e86-a5db-54f3f9c061d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:16.190774 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425efc49-d727-4e86-a5db-54f3f9c061d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:16.191052 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425efc49-d727-4e86-a5db-54f3f9c061d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:16.191325 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425efc49-d727-4e86-a5db-54f3f9c061d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:16.193430 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-425efc49-d727-4e86-a5db-54f3f9c061d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:16.212474 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425efc49-d727-4e86-a5db-54f3f9c061d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:16.214346 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425efc49-d727-4e86-a5db-54f3f9c061d2 service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:16.227008 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1452/2925] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:16.763268 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d1893-9e8c-4581-b3ec-7bf0df2eea90 service nova] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:16.765747 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-499d1893-9e8c-4581-b3ec-7bf0df2eea90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:16.892706 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d1893-9e8c-4581-b3ec-7bf0df2eea90 service nova] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:16.898178 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593271e-2ae4-49bf-9617-b134d2ce8c12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7911672bb2a471daf4f69ba940ef41d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:16.898804 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593271e-2ae4-49bf-9617-b134d2ce8c12 service placement] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:16.899089 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593271e-2ae4-49bf-9617-b134d2ce8c12 service placement] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:16.899365 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593271e-2ae4-49bf-9617-b134d2ce8c12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:16.902044 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b593271e-2ae4-49bf-9617-b134d2ce8c12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:16.923995 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593271e-2ae4-49bf-9617-b134d2ce8c12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:16.926954 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593271e-2ae4-49bf-9617-b134d2ce8c12 service placement] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:16.943955 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1474/2926] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:19.342686 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425efc49-d727-4e86-a5db-54f3f9c061d2 service neutron] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:19.365120 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425efc49-d727-4e86-a5db-54f3f9c061d2 service neutron] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:19.372839 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9cbc8-f8f3-4a4f-a1e9-ca741ac7aa8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:19.374221 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9cbc8-f8f3-4a4f-a1e9-ca741ac7aa8f service neutron] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:19.374690 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9cbc8-f8f3-4a4f-a1e9-ca741ac7aa8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:19.375178 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9cbc8-f8f3-4a4f-a1e9-ca741ac7aa8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:19.378747 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-23e9cbc8-f8f3-4a4f-a1e9-ca741ac7aa8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:19.398255 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9cbc8-f8f3-4a4f-a1e9-ca741ac7aa8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:19.401506 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9cbc8-f8f3-4a4f-a1e9-ca741ac7aa8f service neutron] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:19.410068 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:19.418621 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1453/2927] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:26.220616 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593271e-2ae4-49bf-9617-b134d2ce8c12 service placement] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:26.223045 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-b593271e-2ae4-49bf-9617-b134d2ce8c12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:26.246591 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=100 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:26.260557 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593271e-2ae4-49bf-9617-b134d2ce8c12 service placement] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:26.272351 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dce56-e3ed-4a27-8c31-54e22e579803 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96c35c544cae4ad187f1a1be723e0d21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:26.273167 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dce56-e3ed-4a27-8c31-54e22e579803 service nova] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:26.273573 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dce56-e3ed-4a27-8c31-54e22e579803 service nova] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:26.273976 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dce56-e3ed-4a27-8c31-54e22e579803 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:26.276663 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-522dce56-e3ed-4a27-8c31-54e22e579803 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:26.295079 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522dce56-e3ed-4a27-8c31-54e22e579803 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:26.298395 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522dce56-e3ed-4a27-8c31-54e22e579803 service nova] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:26.312532 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1475/2928] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:51:31.426772 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9cbc8-f8f3-4a4f-a1e9-ca741ac7aa8f service neutron] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:31.428424 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-23e9cbc8-f8f3-4a4f-a1e9-ca741ac7aa8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:31.494925 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9cbc8-f8f3-4a4f-a1e9-ca741ac7aa8f service neutron] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:31.498656 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cbf120-ee20-4151-b23e-df053665aafb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:31.499279 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbf120-ee20-4151-b23e-df053665aafb service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:31.499556 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbf120-ee20-4151-b23e-df053665aafb service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:31.499826 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbf120-ee20-4151-b23e-df053665aafb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:31.510427 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cbf120-ee20-4151-b23e-df053665aafb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:31.512162 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cbf120-ee20-4151-b23e-df053665aafb service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:31.523687 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1454/2929] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:36.306320 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:41.518878 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=26 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:54.257345 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dce56-e3ed-4a27-8c31-54e22e579803 service nova] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:54.361334 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dce56-e3ed-4a27-8c31-54e22e579803 service nova] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:54.367993 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869f063-ba42-410a-b69f-300f7da5f26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:54.368734 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869f063-ba42-410a-b69f-300f7da5f26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:54.369047 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869f063-ba42-410a-b69f-300f7da5f26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:54.369494 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869f063-ba42-410a-b69f-300f7da5f26e admin admin] PATH_INFO: `/v3/users/0fe38df4db034bcf888f61bd4ddd2ec3` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:54.371875 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869f063-ba42-410a-b69f-300f7da5f26e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fe38df4db034bcf888f61bd4ddd2ec3)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:54.374776 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869f063-ba42-410a-b69f-300f7da5f26e admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:54.453611 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f869f063-ba42-410a-b69f-300f7da5f26e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fe38df4db034bcf888f61bd4ddd2ec3'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:54.468428 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f869f063-ba42-410a-b69f-300f7da5f26e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fe38df4db034bcf888f61bd4ddd2ec3'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:54.484038 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f869f063-ba42-410a-b69f-300f7da5f26e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fe38df4db034bcf888f61bd4ddd2ec3'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:54.484822 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f869f063-ba42-410a-b69f-300f7da5f26e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fe38df4db034bcf888f61bd4ddd2ec3'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:54.486219 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-f869f063-ba42-410a-b69f-300f7da5f26e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fe38df4db034bcf888f61bd4ddd2ec3'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:54.512353 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1476/2930] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:51:54 2022] DELETE /identity/v3/users/0fe38df4db034bcf888f61bd4ddd2ec3 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:54.818445 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cbf120-ee20-4151-b23e-df053665aafb service cinder] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:54.842436 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cbf120-ee20-4151-b23e-df053665aafb service cinder] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:54.930891 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6900ce-1a87-471b-bc22-3a61ee02939c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:54.931556 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6900ce-1a87-471b-bc22-3a61ee02939c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:54.931838 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6900ce-1a87-471b-bc22-3a61ee02939c admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:54.932116 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6900ce-1a87-471b-bc22-3a61ee02939c admin admin] PATH_INFO: `/v3/projects/791d93cc31404a3da11a40a77c62ad39` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:54.933590 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6900ce-1a87-471b-bc22-3a61ee02939c admin admin] RBAC: Authorizing `identity:delete_project(project_id=791d93cc31404a3da11a40a77c62ad39)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:54.935629 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6900ce-1a87-471b-bc22-3a61ee02939c admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:55.015426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-1f6900ce-1a87-471b-bc22-3a61ee02939c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '791d93cc31404a3da11a40a77c62ad39', 'request_id': 'req-1f6900ce-1a87-471b-bc22-3a61ee02939c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:55.023825 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-1f6900ce-1a87-471b-bc22-3a61ee02939c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '791d93cc31404a3da11a40a77c62ad39', 'request_id': 'req-1f6900ce-1a87-471b-bc22-3a61ee02939c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:55.032930 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-1f6900ce-1a87-471b-bc22-3a61ee02939c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '791d93cc31404a3da11a40a77c62ad39', 'request_id': 'req-1f6900ce-1a87-471b-bc22-3a61ee02939c'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:55.053745 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-1f6900ce-1a87-471b-bc22-3a61ee02939c admin admin] The token cache is being invalidate because project 791d93cc31404a3da11a40a77c62ad39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:51:55.054145 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-1f6900ce-1a87-471b-bc22-3a61ee02939c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:55.059190 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-1f6900ce-1a87-471b-bc22-3a61ee02939c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:55.061988 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1455/2931] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:51:54 2022] DELETE /identity/v3/projects/791d93cc31404a3da11a40a77c62ad39 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:55.068229 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869f063-ba42-410a-b69f-300f7da5f26e admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:55.069906 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-f869f063-ba42-410a-b69f-300f7da5f26e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:55.085324 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869f063-ba42-410a-b69f-300f7da5f26e admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:55.178757 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e26f5-f7e5-491c-aa17-fcdec7cb5ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:55.179729 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e26f5-f7e5-491c-aa17-fcdec7cb5ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:55.180150 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e26f5-f7e5-491c-aa17-fcdec7cb5ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:55.180614 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e26f5-f7e5-491c-aa17-fcdec7cb5ffa admin admin] PATH_INFO: `/v3/users/fe9ef40249b84441a589415f3fa5c34b` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:55.182455 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e26f5-f7e5-491c-aa17-fcdec7cb5ffa admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe9ef40249b84441a589415f3fa5c34b)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:55.184835 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e26f5-f7e5-491c-aa17-fcdec7cb5ffa admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:55.214921 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:55.263024 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-223e26f5-f7e5-491c-aa17-fcdec7cb5ffa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe9ef40249b84441a589415f3fa5c34b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:55.279445 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-223e26f5-f7e5-491c-aa17-fcdec7cb5ffa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe9ef40249b84441a589415f3fa5c34b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:55.298856 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-223e26f5-f7e5-491c-aa17-fcdec7cb5ffa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe9ef40249b84441a589415f3fa5c34b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:55.300029 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-223e26f5-f7e5-491c-aa17-fcdec7cb5ffa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe9ef40249b84441a589415f3fa5c34b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:55.301235 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-223e26f5-f7e5-491c-aa17-fcdec7cb5ffa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe9ef40249b84441a589415f3fa5c34b'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:55.340375 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1477/2932] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:51:55 2022] DELETE /identity/v3/users/fe9ef40249b84441a589415f3fa5c34b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:55.602797 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6900ce-1a87-471b-bc22-3a61ee02939c admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:55.604941 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-1f6900ce-1a87-471b-bc22-3a61ee02939c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:55.636765 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6900ce-1a87-471b-bc22-3a61ee02939c admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:55.735300 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220c5d9-b2d2-4dcf-b869-ecd209f3b044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:55.736541 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220c5d9-b2d2-4dcf-b869-ecd209f3b044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:55.736822 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220c5d9-b2d2-4dcf-b869-ecd209f3b044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:55.737097 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220c5d9-b2d2-4dcf-b869-ecd209f3b044 admin admin] PATH_INFO: `/v3/projects/db04797d011b49a8b92208ccf1e4f065` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:55.738574 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220c5d9-b2d2-4dcf-b869-ecd209f3b044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db04797d011b49a8b92208ccf1e4f065)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:55.741511 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220c5d9-b2d2-4dcf-b869-ecd209f3b044 admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:55.787058 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:55.807457 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e220c5d9-b2d2-4dcf-b869-ecd209f3b044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db04797d011b49a8b92208ccf1e4f065', 'request_id': 'req-e220c5d9-b2d2-4dcf-b869-ecd209f3b044'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:55.816065 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e220c5d9-b2d2-4dcf-b869-ecd209f3b044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db04797d011b49a8b92208ccf1e4f065', 'request_id': 'req-e220c5d9-b2d2-4dcf-b869-ecd209f3b044'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:55.827076 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e220c5d9-b2d2-4dcf-b869-ecd209f3b044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db04797d011b49a8b92208ccf1e4f065', 'request_id': 'req-e220c5d9-b2d2-4dcf-b869-ecd209f3b044'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:55.850319 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e220c5d9-b2d2-4dcf-b869-ecd209f3b044 admin admin] The token cache is being invalidate because project db04797d011b49a8b92208ccf1e4f065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:51:55.850667 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e220c5d9-b2d2-4dcf-b869-ecd209f3b044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:55.851695 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-e220c5d9-b2d2-4dcf-b869-ecd209f3b044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:55.854284 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1456/2933] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:51:55 2022] DELETE /identity/v3/projects/db04797d011b49a8b92208ccf1e4f065 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:55.862146 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5ec67-08d1-4229-aebb-30e26bb06bd7 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:55.862653 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5ec67-08d1-4229-aebb-30e26bb06bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:55.863138 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5ec67-08d1-4229-aebb-30e26bb06bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:55.896681 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-0ca5ec67-08d1-4229-aebb-30e26bb06bd7 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:55.897958 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-0ca5ec67-08d1-4229-aebb-30e26bb06bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:55.979482 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1478/2934] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:55.994565 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f73e84-4d8b-4c02-b497-4a42d7143868 None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:55.995071 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f73e84-4d8b-4c02-b497-4a42d7143868 None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:55.995495 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f73e84-4d8b-4c02-b497-4a42d7143868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:56.034254 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-26f73e84-4d8b-4c02-b497-4a42d7143868 None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:56.036809 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-26f73e84-4d8b-4c02-b497-4a42d7143868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:56.052922 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1457/2935] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:56.057441 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5ec67-08d1-4229-aebb-30e26bb06bd7 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:56.070370 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5ec67-08d1-4229-aebb-30e26bb06bd7 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:56.080488 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e124eb-43ab-47db-adb3-50f1ff572e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:56.081582 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e124eb-43ab-47db-adb3-50f1ff572e54 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:56.082233 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e124eb-43ab-47db-adb3-50f1ff572e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:56.082730 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e124eb-43ab-47db-adb3-50f1ff572e54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:56.083950 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e124eb-43ab-47db-adb3-50f1ff572e54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81658) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:51:56.084873 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e124eb-43ab-47db-adb3-50f1ff572e54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:56.088642 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e124eb-43ab-47db-adb3-50f1ff572e54 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:56.115863 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1479/2936] 10.222.0.69 () {58 vars in 1153 bytes} [Mon Aug 29 21:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:51:56.121070 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f73e84-4d8b-4c02-b497-4a42d7143868 None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:56.136046 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f73e84-4d8b-4c02-b497-4a42d7143868 None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:56.145456 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58784d7-1872-4542-aec0-10ee23fb7d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:56.146238 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58784d7-1872-4542-aec0-10ee23fb7d7c admin admin] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:56.146523 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58784d7-1872-4542-aec0-10ee23fb7d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:56.146808 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58784d7-1872-4542-aec0-10ee23fb7d7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:56.147539 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58784d7-1872-4542-aec0-10ee23fb7d7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:56.149647 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58784d7-1872-4542-aec0-10ee23fb7d7c admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:56.184974 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1458/2937] 10.222.0.69 () {60 vars in 1153 bytes} [Mon Aug 29 21:51:56 2022] POST /identity/v3/projects => generated 399 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:51:56.190086 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e124eb-43ab-47db-adb3-50f1ff572e54 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:56.206720 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e124eb-43ab-47db-adb3-50f1ff572e54 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:56.305032 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff582d-7552-4393-99ad-fdf2a26bdf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:56.305993 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff582d-7552-4393-99ad-fdf2a26bdf19 admin admin] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:56.306172 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff582d-7552-4393-99ad-fdf2a26bdf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:56.306550 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff582d-7552-4393-99ad-fdf2a26bdf19 admin admin] PATH_INFO: `/v3/users` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:56.307424 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff582d-7552-4393-99ad-fdf2a26bdf19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:56.310013 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff582d-7552-4393-99ad-fdf2a26bdf19 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:56.347885 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1480/2938] 10.222.0.69 () {60 vars in 1144 bytes} [Mon Aug 29 21:51:56 2022] POST /identity/v3/users => generated 300 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:51:56.349259 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58784d7-1872-4542-aec0-10ee23fb7d7c admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:56.361603 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58784d7-1872-4542-aec0-10ee23fb7d7c admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:56.367011 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56464465-d954-4cae-8182-7cd4efb9aa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:56.367579 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56464465-d954-4cae-8182-7cd4efb9aa7d admin admin] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:56.367860 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56464465-d954-4cae-8182-7cd4efb9aa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:56.368154 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56464465-d954-4cae-8182-7cd4efb9aa7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:56.368940 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56464465-d954-4cae-8182-7cd4efb9aa7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:56.370590 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56464465-d954-4cae-8182-7cd4efb9aa7d admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:56.383655 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1459/2939] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:51:56.390760 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff582d-7552-4393-99ad-fdf2a26bdf19 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:56.406344 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff582d-7552-4393-99ad-fdf2a26bdf19 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:56.415099 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a17804-e389-4333-9f4d-4fbf3ccab315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:56.416295 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a17804-e389-4333-9f4d-4fbf3ccab315 admin admin] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:56.416616 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a17804-e389-4333-9f4d-4fbf3ccab315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:56.417074 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a17804-e389-4333-9f4d-4fbf3ccab315 admin admin] PATH_INFO: `/v3/roles` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:56.417612 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a17804-e389-4333-9f4d-4fbf3ccab315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:56.419299 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a17804-e389-4333-9f4d-4fbf3ccab315 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:56.439289 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1481/2940] 10.222.0.69 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:56.444489 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56464465-d954-4cae-8182-7cd4efb9aa7d admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:56.464763 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56464465-d954-4cae-8182-7cd4efb9aa7d admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:56.473751 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be3ae2-e4b4-47f9-81bd-5e63b668097e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:56.474862 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be3ae2-e4b4-47f9-81bd-5e63b668097e admin admin] REQUEST_METHOD: `PUT` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:56.475368 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be3ae2-e4b4-47f9-81bd-5e63b668097e admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:56.475857 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be3ae2-e4b4-47f9-81bd-5e63b668097e admin admin] PATH_INFO: `/v3/projects/3e5927fbb47f4d4eb7c8bff044403b62/users/e946d72e08514d5b801dae603374fe52/roles/29d2c7708bea4287a21112bb7ffa72df` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:56.507930 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be3ae2-e4b4-47f9-81bd-5e63b668097e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e5927fbb47f4d4eb7c8bff044403b62, user_id=e946d72e08514d5b801dae603374fe52, role_id=29d2c7708bea4287a21112bb7ffa72df)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:56.513861 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be3ae2-e4b4-47f9-81bd-5e63b668097e admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:56.545763 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1460/2941] 10.222.0.69 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:56 2022] PUT /identity/v3/projects/3e5927fbb47f4d4eb7c8bff044403b62/users/e946d72e08514d5b801dae603374fe52/roles/29d2c7708bea4287a21112bb7ffa72df => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:56.564893 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f923f6c-bd30-4113-bd94-4ad36de0e906 None None] REQUEST_METHOD: `POST` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:56.565347 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f923f6c-bd30-4113-bd94-4ad36de0e906 None None] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:56.565780 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f923f6c-bd30-4113-bd94-4ad36de0e906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:56.580497 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:56.616261 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.auth.core [None req-1f923f6c-bd30-4113-bd94-4ad36de0e906 None None] MFA Rules not processed for user `e946d72e08514d5b801dae603374fe52`. Rule list: `[]` (Enabled: `True`). {{(pid=81658) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:56.617794 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-1f923f6c-bd30-4113-bd94-4ad36de0e906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:56.706699 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1482/2942] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:51:56 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:56.723162 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be3ae2-e4b4-47f9-81bd-5e63b668097e admin admin] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:56.725357 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-d5be3ae2-e4b4-47f9-81bd-5e63b668097e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:56.826628 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be3ae2-e4b4-47f9-81bd-5e63b668097e admin admin] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:56.835271 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733d48c-410a-49ca-a6f1-62b1257cf64a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad05a52c8aec4744a41639f2343eb54f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:56.836390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733d48c-410a-49ca-a6f1-62b1257cf64a service cinder] REQUEST_METHOD: `GET` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:56.836390 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733d48c-410a-49ca-a6f1-62b1257cf64a service cinder] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:56.836756 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733d48c-410a-49ca-a6f1-62b1257cf64a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:56.848394 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733d48c-410a-49ca-a6f1-62b1257cf64a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:56.850298 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733d48c-410a-49ca-a6f1-62b1257cf64a service cinder] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:56.863372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1461/2943] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:56 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:02.311704 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f923f6c-bd30-4113-bd94-4ad36de0e906 None None] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:02.396387 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f923f6c-bd30-4113-bd94-4ad36de0e906 None None] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:02.401558 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35eb06e-20cb-4123-9a8b-cfb6e335bda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:02.402312 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eb06e-20cb-4123-9a8b-cfb6e335bda1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:02.402644 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eb06e-20cb-4123-9a8b-cfb6e335bda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:02.402997 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eb06e-20cb-4123-9a8b-cfb6e335bda1 admin admin] PATH_INFO: `/v3/users/e946d72e08514d5b801dae603374fe52` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:02.404251 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35eb06e-20cb-4123-9a8b-cfb6e335bda1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e946d72e08514d5b801dae603374fe52)` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:02.406279 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35eb06e-20cb-4123-9a8b-cfb6e335bda1 admin admin] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:02.463012 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a35eb06e-20cb-4123-9a8b-cfb6e335bda1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e946d72e08514d5b801dae603374fe52'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:02.472464 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a35eb06e-20cb-4123-9a8b-cfb6e335bda1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e946d72e08514d5b801dae603374fe52'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:02.482224 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a35eb06e-20cb-4123-9a8b-cfb6e335bda1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e946d72e08514d5b801dae603374fe52'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:02.482865 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a35eb06e-20cb-4123-9a8b-cfb6e335bda1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e946d72e08514d5b801dae603374fe52'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:02.483492 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.notifications [None req-a35eb06e-20cb-4123-9a8b-cfb6e335bda1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e946d72e08514d5b801dae603374fe52'} {{(pid=81658) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:02.506795 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1483/2944] 10.222.0.69 () {58 vars in 1224 bytes} [Mon Aug 29 21:52:02 2022] DELETE /identity/v3/users/e946d72e08514d5b801dae603374fe52 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:02.512023 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63005a33-39fe-4db1-b896-903fccbccb8b None None] REQUEST_METHOD: `POST` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:02.512757 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63005a33-39fe-4db1-b896-903fccbccb8b None None] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:02.512757 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63005a33-39fe-4db1-b896-903fccbccb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:02.537484 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.auth.core [None req-63005a33-39fe-4db1-b896-903fccbccb8b None None] MFA Rules not processed for user `3e753cc042b14c47bd5d1c6394848500`. Rule list: `[]` (Enabled: `True`). {{(pid=81659) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:02.538916 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-63005a33-39fe-4db1-b896-903fccbccb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:02.614677 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:02.628641 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1462/2945] 10.222.0.69 () {58 vars in 958 bytes} [Mon Aug 29 21:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:02.639712 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35eb06e-20cb-4123-9a8b-cfb6e335bda1 admin admin] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:02.642680 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-a35eb06e-20cb-4123-9a8b-cfb6e335bda1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:02.674640 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:02.733030 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35eb06e-20cb-4123-9a8b-cfb6e335bda1 admin admin] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:02.737645 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afac34c-645d-45ac-b991-b0085da57408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfa16ba58c0040f8bdfa5e46f2681395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:02.738287 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afac34c-645d-45ac-b991-b0085da57408 service neutron] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:02.738571 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afac34c-645d-45ac-b991-b0085da57408 service neutron] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:02.738849 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afac34c-645d-45ac-b991-b0085da57408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:02.751446 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afac34c-645d-45ac-b991-b0085da57408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:02.753138 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afac34c-645d-45ac-b991-b0085da57408 service neutron] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:02.765359 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1484/2946] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:03.574936 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63005a33-39fe-4db1-b896-903fccbccb8b None None] Authenticating user token {{(pid=81659) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:03.577193 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.fernet_utils [None req-63005a33-39fe-4db1-b896-903fccbccb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81659) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:03.597451 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63005a33-39fe-4db1-b896-903fccbccb8b None None] Validating token access rules against request {{(pid=81659) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:03.607019 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78ea75-ad58-4fde-8b8d-ccca102da5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e753cc042b14c47bd5d1c6394848500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8cd30653804c0ead71897871920ce2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81659) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:03.608426 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78ea75-ad58-4fde-8b8d-ccca102da5dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:03.610286 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78ea75-ad58-4fde-8b8d-ccca102da5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:03.610794 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78ea75-ad58-4fde-8b8d-ccca102da5dc admin admin] PATH_INFO: `/v3/projects/3e5927fbb47f4d4eb7c8bff044403b62` {{(pid=81659) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:03.613601 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe78ea75-ad58-4fde-8b8d-ccca102da5dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e5927fbb47f4d4eb7c8bff044403b62)` {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:03.617696 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe78ea75-ad58-4fde-8b8d-ccca102da5dc admin admin] RBAC: Authorization granted {{(pid=81659) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:03.700427 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-fe78ea75-ad58-4fde-8b8d-ccca102da5dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e5927fbb47f4d4eb7c8bff044403b62', 'request_id': 'req-fe78ea75-ad58-4fde-8b8d-ccca102da5dc'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:03.711243 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-fe78ea75-ad58-4fde-8b8d-ccca102da5dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e5927fbb47f4d4eb7c8bff044403b62', 'request_id': 'req-fe78ea75-ad58-4fde-8b8d-ccca102da5dc'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:03.718120 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-fe78ea75-ad58-4fde-8b8d-ccca102da5dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e5927fbb47f4d4eb7c8bff044403b62', 'request_id': 'req-fe78ea75-ad58-4fde-8b8d-ccca102da5dc'} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:03.736372 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-fe78ea75-ad58-4fde-8b8d-ccca102da5dc admin admin] The token cache is being invalidate because project 3e5927fbb47f4d4eb7c8bff044403b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81659) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:52:03.736700 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-fe78ea75-ad58-4fde-8b8d-ccca102da5dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:03.737649 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG keystone.notifications [None req-fe78ea75-ad58-4fde-8b8d-ccca102da5dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81659) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:03.739366 dv-cinder-854267-3-smb devstack@keystone.service[81659]: [pid: 81659|app: 0|req: 1463/2947] 10.222.0.69 () {58 vars in 1233 bytes} [Mon Aug 29 21:52:03 2022] DELETE /identity/v3/projects/3e5927fbb47f4d4eb7c8bff044403b62 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:12.759862 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=20 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:13.731379 dv-cinder-854267-3-smb devstack@keystone.service[81659]: DEBUG dbcounter [-] [81659] Writing DB stats keystone:SELECT=27,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:43.538029 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afac34c-645d-45ac-b991-b0085da57408 service neutron] Authenticating user token {{(pid=81658) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:43.540796 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-7afac34c-645d-45ac-b991-b0085da57408 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:43.671845 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afac34c-645d-45ac-b991-b0085da57408 service neutron] Validating token access rules against request {{(pid=81658) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:43.782833 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fc979-0020-4352-8a95-b9dd8f296130 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7911672bb2a471daf4f69ba940ef41d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a302406c548c43c983625c0d66da47cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81658) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:43.783801 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fc979-0020-4352-8a95-b9dd8f296130 service placement] REQUEST_METHOD: `GET` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:43.784327 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fc979-0020-4352-8a95-b9dd8f296130 service placement] SCRIPT_NAME: `/identity` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:43.784826 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fc979-0020-4352-8a95-b9dd8f296130 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81658) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:43.788581 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.fernet_utils [None req-678fc979-0020-4352-8a95-b9dd8f296130 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81658) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:43.810259 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fc979-0020-4352-8a95-b9dd8f296130 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:43.813370 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fc979-0020-4352-8a95-b9dd8f296130 service placement] RBAC: Authorization granted {{(pid=81658) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:43.833244 dv-cinder-854267-3-smb devstack@keystone.service[81658]: [pid: 81658|app: 0|req: 1485/2948] 10.222.0.69 () {60 vars in 1365 bytes} [Mon Aug 29 21:53:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:53:53.824596 dv-cinder-854267-3-smb devstack@keystone.service[81658]: DEBUG dbcounter [-] [81658] Writing DB stats keystone:SELECT=58 {{(pid=81658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}